【犀牛鸟·视野】SIGGRAPH Asia 2017 (DAY 3)：领略前沿poster papers，关注WebXR新技术

今天是SIGGRAPH Asia 2017的第三天，也是Poster papers讲解的最后一天（总共两天，每天中午13:00-14:00）。今年中了poster的文章总共有58篇，分为10个类别，分别有：Animation，Hardware，Image and Video，Interaction，Methods and Applications，Modeling，Multimedia，Rendering，Virtual Environments和Visualization。大部分的文章都附有演示的DEMO和视频，可以帮助快速理解。这里在文末给大家整理分享论文列表，大家可以自行从网上查找相关资料进行进一步研究。

接下来重点介绍一篇Imaging and Video方向的来自中国北京Llvision Technology、NLPR和CASIA团队的文章《Style-Oriented Representative Paintings Selection》。目前根据大师作品的风格来生成或者转化图像的研究和应用比较多。就在昨天的Symposium On Mobile Graphics And Interactive Applications Demonstrations专题上，还展示和交流了一个名为Pictory的作品，App Store有下载，内容就是通过神经网络来实时转换图片风格，通过交流还送了我一张风格化的明信片。

哈哈，跑题了。回到这篇poster文章，它的创意点在于反其道而行之，它的目的是从一堆图像作品中选出最能代表画作作者的作品。它的实现方法是先VGG-19提取图像特征生成content-style feature vector，然后基于自主研发的聚类和抑制框架来对上一步生成的特征向量组进行分类，这里分为两步：1）利用K-means算法基于特征向量组分成K个类；2）然后根据贝叶斯概率分布来找到异类的图片（如下图所示）；3）最后，更新这个K个分类并找到具有代表性的图片。

Computer Animation Festival

今年Computer Animation Festival获奖的作品如下（由于会场不允许拍照，所以无法提供更多的图片和视频）：

BEST STUDENT FILM: GARDEN PARTY

BEST IN SHOW: AFTERWORK

JURY AWARD: HERE’S THE PLAN

JURY AWARD: (OO)

GARDEN PARTY讲述的是一只青蛙和一只蟾蜍在废弃的豪宅内自由的探索，最后无意中发现了这个豪宅内最大的秘密。

AFTERWORK设想的是卡通人物在娱乐我们人类的同时，它们自己的生活是怎样的呢？它们是不是也会像我们一样每天下班之后感觉到孤独呢？作者以卡通人物的角度来反思我们现在这种工作和生活的意义。

HERE’S THE PLAN讲述的是一对猫和狗的夫妇梦想开一间自己的蛋糕店，但是由于烤箱坏了它们不得不推迟梦想去挣取更多的钱来购买新的烤箱，但是在某个时刻开始，它们渐渐地偏离了自己的梦想，也偏离了彼此。

(OO)是一个天马行空的作品，正如标题的形状一样，这个作品讲述的是基于两个鼻孔的故事，极大地夸大了我们鼻孔在日常生活中会遇到的各种场景。个人表示欣赏不来这个作品。

今年的Computer Animation Festival还有一个看点是在动画中融入了AR/VR的场景，比如《FLY》这个作品，讲述的是孙子通过VR技术让年迈的爷爷重温了他年轻时开战斗机作战的一些场景（如果没猜错，这场战斗是二战）。

WebAR/WebVR

今天还有一个重头戏是GOOGLE和Mozilla关于WebAR/WebVR的专题报告。先声明一下，这场报告非常多的代码展示和讲解，另外，GOOGLE的工程师还是超有型的，不信你看这个帅哥。

言归正传，他们认为AR/VR的未来其实更像是现在的WEB，可以通过JS接口来与AR/VR设备进行交互，他们开发了three.js/AR.js等并展示了基于WEB的AR/VR应用DEMO。他们目前正在做的是建设更多的原型来更好地探索AR/VR的想象空间。其中包括：具有影响力的示例；制定设计标准；提供沉浸式的接口；渲染技术；研发的工作流程等。让我们拭目以待吧。

请输入标题 bcdef

附录：Poster Papers

Animation

User Pose Estimation based on multiple depth sensors

Seongmin Baek, Myunggyu Kim

Liquid wetting across porous anisotropic textiles

Aihua Mao, Mingle Wang, Yong-jin Liu, Huamin Wang, Guiqing Li

4D Computed Tomography Measurement for Growing Plant Animation

Sakiho Kato, Tomofumi Narita, Chika Tomiyama, Takashi Ijiri, Hiroya Tanaka

Motion Sickness Simulation Based on Sensorimotor Control

Chen-Hui Hu, Ping Chen, Yan-Ting Liu, Wen-Chieh Lin

Hardware

Real-time Temporal Quality Compensation Technique for Head Mounted Displays

Jung-Woo Chang, Suk-Ju Kang, Min-Woo Seo, Song-Woo Choi, Sang-Lyn Lee, Ho-Chul Lee, Eui-Yeol Oh, Jong-Sang Baek

Multi-DOF 3D Printing with Visual Surveillance

Lifang Wu, Miao Yu, Yisong Gao, Dong-Ming Yan, Ligang Liu

Aerial Image on Retroreflective Particles

Shinnosuke Ando, Kazuki Otao, Kazuki Takazawa, Yusuke Tanemura, Yoichi Ochiai

Aerial Light-Field Image Augmented Between You and Your Mirrored Image

Tomofumi Kobori, Kazuki Shimose, Sho Onose, Tomoyuki Okamoto, Masao Nakajima, Toru Iwane, Hirotsugu Yamamoto

A Proposal for Wearable Controller Device and Finger Gesture Recognition using Surface Electromyography

Ayumu Tsuboi, Mamoru Hirota, Junki Sato, Masayuki Yokoyama, Masao Yanagisawa

Improvement of A Finger-Mounted Haptic Device Using Surface Contact

Makoto Yoda, Hiroki Imamura

Imaging and Video

Seamless Video Scene Transition Using Hierarchical Graph Cuts

Tatsunori Hirai

Style-Oriented Representative Paintings Selection

Yingying Deng, Fan Tang, Weiming Dong, Hanxing Yao, Bao-Gang Hu

A Deep Convolutional Neural Network for Continuous Zoom with Dual Cameras

Hsueh-I Chen, Claire Chen, Yung-Yu Chuang

An Application of a Halftone Pattern Coding in Augmented Reality

Bruno Patrão, Leandro Cruz, Nuno Gonçalves

Subtitle Positioning for E-learning Videos Based on Rough Gaze Estimation and Saliency Detection

Bo Jiang, Sijiang Liu, Liping He, Weimin Wu, Hongli Chen, Yunfei Shen

Estimating the Simulator Sickness in Immersive Virtual Reality with Optical Flow Analysis

Jiun-Yu Lee, Ping-Hsuan Han, Ling Tsai, Rih-Ding Peng, Yang-Sheng Chen, Kuan-Wen Chen, Yi-Ping Hung

Interaction

MistFlow : A Fog Display for Visualization of Adaptive Shape-Changing Flow

Kazuki Otao, Takanori Koga

Prototyping Digital Signage Systems with High-Low Tech Interfaces

Ting-Wen Chin, Yu-Yen Chuang, Yu-Ling Fan, Ye-Ning Jiang, Yi-Ching Kang, Wei-Hsin Kuo, Tzu-Wen To, Hiroki Nishino

DupRobo: An Interactive Robotic Platform for Phyiscal Block-based Autocompletion

Taizhou Chen, Yi-Shiun Wu, Feng Han, Baochuan Yue, Kening Zhu

Tactile Braille Learning System to Assist Visual Impaired Users to Learn Taiwanese Braille

Tao-Jen Yang, Wei-An Chen, Yung-Long Chu, Zi-Xin You, Chien-Hsing Chou

User Interface Applications in Desktop VR using a Mirror Metaphor

Santawat Thanyadit, Ting-Chuen Pong

Deformation Simulation Based on Model Reduction with Rigidity Sampling

Shuo-Ting Chien, Chen-Hui Hu, Cheng-Yang Huang, Yu-Ting Tsai, Wen-Chieh Lin

Perception Adjustment for Egocentric Moving Distance between Real Space and Virtual Space with See-closed-type HMD

Ungyeon Yang, Nam-Gyu Kim, Ki-Hong Kim

Dualboard : Integrated User Interface between Typing and Handwriting

Seunghyun Woo, Jia Lee, Changmok Kim

Spin and Roll: Convex Solids of Revolution as Playful Interface

Akihiro Matsuura, Yuma Ikawa, Yuka Takahashi, Hiroki Tone

Natural Interaction for Media Consumption in VR Environment

Seung-Hwan Choi, Hyun-Jin Kim, Sang-Woong Hwang, Jae-Young Lee

Exploring Mixed-Scale Gesture Interaction

Barrett Ens, Aaron Quigley, Hui-Shyong Yeo, Pourang Irani, Thammathip Piumsomboon, Mark Billinghurst

Methods and Applications

An image generation system of delicious food in a manga style

Sakiko Fujieda, Yuki Morimoto, Kazuo Ohzeki

DeepHolo: Recognizing 3D Objects using a Binary-weighted Computer-Generated Hologram

Naoya Muramatsu, Chun Wei Ooi, Yuta Itoh, Yoichi Ochiai

Affordable System for Measuring Motion-to-Photon Latency of Virtual Reality in Mobile Devices

Yu-Ju Tsai, Yu-Xiang Wang, Ming Ouhyoung

Visualization and Labeling of Point Clouds in Virtual Reality

Jonathan Dyssel Stets, Yongbin Sun, Wiley Corning, Scott W. Greenwald

MitsuDomoe: Ecosystem Simulator of Virtual Creatures in Mixed Reality Petri Dish

Toshikazu Ohshima, Kenzo Kojima

Haptic Marionette: Wrist Control Technology Combined with Electrical Muscle Stimulation and Hanger Reflex

Mose Sakashita, Yuta Sato, Ayaka Ebisu, Keisuke Kawahara, Satoshi Hashizume, Naoya Muramatsu, Yoichi Ochiai

Sketch2Normal: Deep Networks for Normal Map Generation

Wanchao Su, Xin Yang, Hongbo Fu

Improved and Accessible E-book Reader Application for Visually Impaired People

Heesook Shin, Youn-Hee Gil, ChoRong Yu, Hee-Kwon Kim, Jisu Lee, Hyung-Keun Jee

Modeling

Polyhedral Meshes with Concave Faces

Caigui Jiang, Renjie Chen

Spring-Pen: reproduction of any softness with the 3D printed spring

Kengo Tanaka, Taisuke Ohshima, Yoichi Ochiai

Bidirectional Pyramid-based PMVS with Automatic Sky Masking

Jung-Jae Yu, Chang-Joon Park

SmartSweep: Context-aware Modeling on a Single Image

Yilan Chen, Wenlong Meng, Shi-Qing Xin, Hongbo Fu

Multimedia

A Fast And Efficient Content Aware Downscaling Based Image Compression Method For Mobile Devices

Rahul Upadhyay, Ajay Surendranath

Automatic Generation of Visual-TextualWeb Video Thumbnail

Baoquan Zha, Shujin Lin, Xin Qi, Zhiquan Zhang, Xiaonan Luo, Ruomei Wang

Aesthetic Temporal and Spatial Editing of Casual Videos

Jun-Ho Choi, Jong-Seok Lee

Content-Based Measure of Image Set Diversity

Xingjia Pan, Juntao Ye, Fan Tang, Weiming Dong, Feiyue Huang, Xiaopeng Zhang

Rendering

Spatial Multisampling and Multipass Occlusion Testing for Screen Space Shadows

Stefan Seibert, Stefan Radicke

Importance Sampling Measured BRDFs Based on Second Order Spherical Moment

Jie Guo, Yanwen Guo, Jingui Pan

Silk Fabricator: Using Silkworms as 3D Printers

Riku Iwasaki, Yuta Sato, Ippei Suzuki, Atsushi Shinoda, Kenta Yamamot, Kohei Ogawa, Yoichi Ochiai

Eyeshine Rendering: A Real Time Rendering Method for Realistic Animal Eyes

Yuna Omae, Tokiichiro Takahashi

Method for Quantitative Evaluation of the Realism of CG Images Using Deep Learning

Masaaki Sato, Masataka Imura

Virtual Environments

Emotion Induction in Virtual Environments: A Novel Paradigm Using Immersive Scenarios in Driving Simulators

Seunghyun Woo, Dong-Seon Chang, Daeyun An, Dongjin Hyun, Christian Wallraven, Manfred Dangelmaier

Marker-less Real-Time Tracking of Texture-less 3D objects from a Monocular Image

Yuki Morikubo, Naoki Hashimoto

A Spatial User Interface Design Using Accordion Metaphor for VR Systems

JoungHuem Kwon, YoungEun Kim, SangHun Nam

Room VR: A VR Therapy Game For Children Who Fear The Dark

Vy Dang Ha Thanh, Ondris Pui, Martin Constable

VR Lighting Design

Chi-Yang Lee, Hsuan-Ming Chang, Chun-Heng Lin, Ming-Han Tsai, Wen-Chieh Lin, Pei-Hsien Hsu, I-Chen Lin, Yu-Shuen Wang, Jung-Hong Chuang

O-Displaying: An Orientation-Based Augmented Reality Display on a Smart Glass with a User Tracking from a Depth Camera

Yi-Shan Lan, Shih-Wei Sun, Kai-Lung Hua, Wen-Huang Cheng

Immersive VR Environment for Architectural Design Education

Chia-Hung Tsou, Ting-Wei Hsu, Chun-Heng Lin, Ming-Han Tsai, Pei-Hsien Hsu, I-Chen Lin, Yu-Shuen Wang, Wen-Chieh Lin, Jung-Hong Chuang

Visualization

Data Jalebi Bot

Gaurav Patekar, Karan Dudeja

Speech Balloon System Using Single-Channel Microphone Array on See-Through Head-Mounted Display

Keiichi Zempo, Tomoki Kurahashi, Koichi Mizutani, Naoto Wakatsuki