Facial Performance Capture by Embedded Photo Reflective Sensors on A Smart Eyewear

• Asano Nao

  Keio University

• Masai Katsutoshi

  Keio University

• Sugiura Yuta

  Keio University

• Sugimoto Maki

  Keio University

Bibliographic Information

Other Title

• 反射型光センサを用いた眼鏡型ウェアラブルデバイスによる顔表情パフォーマンスキャプチャ

Abstract

Facial performance capture is used for animation production that projects a performer's facial expression to a computer graphics model. Retro-reflective markers and cameras are widely used for the performance capture. To capture expressions, we need to place the markers on the performer's face and calibrate the intrinsic and extrinsic parameters of the cameras in advance. However, the tracmeasurable space is limited to the calibrated area. In this paper, we propose a system to capture facial performance using a smart eyewear with photo reflective sensors and machine learning technique.

Journal

• Transactions of the Virtual Reality Society of Japan

  Transactions of the Virtual Reality Society of Japan 23 (3), 197-206, 2018

  THE VIRTUAL REALITY SOCIETY OF JAPAN

Keywords

• Facial Performance Capture
• Wearable Device
• Photo Reflective Sensor

Details

• CRID: 1390282763049488640
• NII Article ID: 130007492963
• DOI: 10.18974/tvrsj.23.3_197
• ISSN: 24239593
• ISSN: 1344011X
• Text Lang: ja
• Data Source:
  • JaLC
  • CiNii Articles
  • KAKEN
• Abstract License Flag: Disallowed