Hotspot Modeling of Hand-Machine Interaction Experiences from a Head-Mounted RGB-D Camera

Access this Article

Author(s)

Abstract

<p>This paper presents an approach to analyze and model tasks of machines being operated. The executions of the tasks were captured through egocentric vision. Each task was decomposed into a sequence of physical hand-machine interactions, which are described with touch-based hotspots and interaction patterns. Modeling the tasks was achieved by integrating the experiences of multiple experts and using a hidden Markov model (HMM). Here, we present the results of more than 70 recorded egocentric experiences of the operation of a sewing machine. Our methods show good potential for the detection of hand-machine interactions and modeling of machine operation tasks.</p>

Journal

  • IEICE Transactions on Information and Systems

    IEICE Transactions on Information and Systems E102.D(2), 319-330, 2019

    Institute of Electronics, Information and Communications Engineers (IEICE)

Codes

  • NII Article ID (NAID)
    130007590025
  • Text Lang
    ENG
  • Article Type
    journal article
  • ISSN
    0916-8532
  • Data Source
    IR  J-STAGE 
Page Top