JackIn:一人称視点と体外離脱視点を融合した人間による人間のオーグメンテーションの枠組み  [in Japanese] JackIn: Integrating the First Person View with Out-of-body Vision Generation for Human Augmenting Human  [in Japanese]

Access this Article

Search this Article

Author(s)

    • 笠原 俊一
    • ソニーコンピュータサイエンス研究所|東京大学大学院情報学環
    • 暦本 純一
    • ソニーコンピュータサイエンス研究所|東京大学大学院情報学環

Abstract

本論文では,JackInと呼ぶ,人間が他の人間の環境に没入し,その状況や体験を共有したり共同作業を行ったりする際のインタラクションの枠組みを提案する.このようなインタフェースは,現場の作業を遠隔地の専門家が支援したり,遠隔から作業者を誘導する,または現地での体験を他の利用者に伝送するなどの応用に適用できる.Bodyと呼ぶ,実環境にいる利用者の一人称映像を遠隔地の利用者(Ghost)が観察し状況を共有する.さらに,Ghostが自由な視点位置で環境を観察することを可能にするために,一人称映像のシーケンスからSLAMに基づいて空間をモデリングし,擬似的にBodyの視点外から状況を観察することを可能にする「体外離脱視点」を提供する.これにより,GhostはBodyに追従しながらも独立な視点で環境を観察することができ,一人称映像特有のモーションシックネスを軽減できる可能性がある.また,GhostがBodyを効果的に支援できるように,Bodyの視野外にある事物をポインティングするための視覚化技法を提案する.本論文ではこの発想に基づくシステムを試作し,JackInインタフェースの有効性を利用者実験によって確認した.JackIn is a new human-human communication framework that connects two or more people. With 1st-person view streaming from a person (called Body) wearing a see-through HMD with a camera, other person (called Ghost) intervenes into the shared 1st-person view. Through the interaction of JackIn, people's activities will be shared and assisted or guided by other people's expertise. Applications include several situations that a local person can acquire assistance from remote exports, such as rescue in a disaster, teaching cooking or fabrication, and another situations can be sharing experience with sports and live events. For better viewing experience for 1st-person view, we introduce the Out-of-Body view where 1st-person images are integrated to construct the scene around the Body, and the Ghost can virtually control the viewpoint to look around the space surrounding the Body and we also provide tele-pointing gesture interface. We conducted an experiment to evaluate how effective this architecture is, and found that Ghosts understand the spatial situation of the Body.

JackIn is a new human-human communication framework that connects two or more people. With 1st-person view streaming from a person (called Body) wearing a see-through HMD with a camera, other person (called Ghost) intervenes into the shared 1st-person view. Through the interaction of JackIn, people's activities will be shared and assisted or guided by other people's expertise. Applications include several situations that a local person can acquire assistance from remote exports, such as rescue in a disaster, teaching cooking or fabrication, and another situations can be sharing experience with sports and live events. For better viewing experience for 1st-person view, we introduce the Out-of-Body view where 1st-person images are integrated to construct the scene around the Body, and the Ghost can virtually control the viewpoint to look around the space surrounding the Body and we also provide tele-pointing gesture interface. We conducted an experiment to evaluate how effective this architecture is, and found that Ghosts understand the spatial situation of the Body.

Journal

  • IPSJ Journal

    IPSJ Journal 56(4), 1248-1257, 2015-04-15

    Information Processing Society of Japan (IPSJ)

Codes

  • NII Article ID (NAID)
    110009890364
  • NII NACSIS-CAT ID (NCID)
    AN00116647
  • Text Lang
    JPN
  • Article Type
    Journal Article
  • ISSN
    1882-7764
  • Data Source
    NII-ELS  IPSJ 
Page Top