A method to interpret 3D motions using neural networks

• WATANABE A.

  Department of Electronics and Communication, Musashi Institute of Technology

• Yazawa Nobuyuki

  Department of Electronics and Communication, Musashi Institute of Technology

• Miyauchi Arata

  Department of Electronics and Communication, Musashi Institute of Technology

• Miyauchi Minami

  Department of Management and Informatics, Sanno College

抄録

In computer vision, the interpretion of 3D motion of an object in the physical world is an important task. This study proposes a 3D motion interpretation method which uses a neural network system consisting of three kinds of neural networks. This system estimates the solutions of 3D motion of an object by interpreting three optical flow (OF-motion vector field calculated from images) patterns obtained at the different view points for the same object. In the system, OF normalization network is used to normalize diverse OF patterns into the normalized OF format. Then 2D motion interpretation network is used to interpret the normalized OF pattern and to obtain the object's projected motion onto an image plane. Finally, 3D motion interpretation network totally interprets the three sets of the projected motions and it derives the solutions of the object's D motion from the inputs. A complex numbered version of the back-propagation (Complex-BP) algorithm is applied to OF normalization netwerk and to 2D motion interpretation network, so that these networks can learn graphical patterns as complex numbers. Also a 3D vector version of the back-propagation (3DV-BP) algorithm is applied to 3D motion interpretation network so that the network can learn the spatial relationship between the object's 3D motion and the corresponding three OF patterns. Though the interpretation system is trained for only basic 3D motions consisting of a single motion component, the system can interpret unknown multiple 3D motions consisting of several motion components. The generalization capacity of the proposed system was confirmed using diverse test patterns. Also the robustness of the system to noise was probed experimentally. The experimental results showed that this method has suitable features for applying to real images.

収録刊行物

• IEICE Transactions on Fundamentals in Electronics, Communications and Computer Sciences

  IEICE Transactions on Fundamentals in Electronics, Communications and Computer Sciences 77 (8), 1361-1370, 1994

  一般社団法人電子情報通信学会

詳細情報

• CRID: 1571698602418413696
• NII論文ID: 110003215881
• NII書誌ID: AA10826239
• ISSN: 09168508
• 本文言語コード: en
• データソース種別:
  • CiNii Articles