Hotspot Modeling of Hand-Machine Interaction Experiences from a Head-Mounted RGB-D Camera

Access this Article



<p>This paper presents an approach to analyze and model tasks of machines being operated. The executions of the tasks were captured through egocentric vision. Each task was decomposed into a sequence of physical hand-machine interactions, which are described with touch-based hotspots and interaction patterns. Modeling the tasks was achieved by integrating the experiences of multiple experts and using a hidden Markov model (HMM). Here, we present the results of more than 70 recorded egocentric experiences of the operation of a sewing machine. Our methods show good potential for the detection of hand-machine interactions and modeling of machine operation tasks.</p>


  • IEICE Transactions on Information and Systems

    IEICE Transactions on Information and Systems E102.D(2), 319-330, 2019

    Institute of Electronics, Information and Communications Engineers (IEICE)


  • NII Article ID (NAID)
  • Text Lang
  • Article Type
    journal article
  • ISSN
  • Data Source
    IR  J-STAGE 
Page Top