A Preliminary Study of Kinect-Based Real-Time Hand Gesture Interaction Systems for Touchless Visualizations of Hepatic Structures in Surgery

DOI Open Access
  • LIU Jiaqing
    Graduate School of Information Science and Engineering, Ritsumeikan University
  • TATEYAMA Tomoko
    Department of Computer Science Hiroshima Institute of Technology
  • IWAMOTO Yutaro
    Graduate School of Information Science and Engineering, Ritsumeikan University
  • CHEN Yen-Wei
    Graduate School of Information Science and Engineering, Ritsumeikan University

Search this article

Abstract

<p>We present a real-time hand gesture interaction system for the touchless visualization of hepatic structure in surgery, for which real-time visualization is important, particularly, during operations, but often faces the challenge of efficiently reviewing a 3D model of a patient's anatomy without requiring the surgeon to touch an input device, such as a mouse or keyboard, to maintain a sterile field. To solve this problem, we developed a touchless system based on hand gesture interaction. We used a Microsoft Kinect sensor as an input device, which performs hand detection and tracking. Our approach combines three kinds of hand states and their movements to control the visualizations of hepatic structures. Experiments demonstrate that our system can realize real-time hand gesture interactions and visualizations.</p>

Journal

Related Projects

See more

Keywords

Details 詳細情報について

Report a problem

Back to top