Phase-Based Window Matching with Geometric Correction for Multi-View Stereo

• SAKAI Shuji

  Graduate School of Information Sciences, Tohoku University

• ITO Koichi

  Graduate School of Information Sciences, Tohoku University

• AOKI Takafumi

  Graduate School of Information Sciences, Tohoku University

• WATANABE Takafumi

  Toppan Printing Co., Ltd.

• UNTEN Hiroki

  Toppan Printing Co., Ltd.

Abstract

Methods of window matching to estimate 3D points are the most serious factors affecting the accuracy, robustness, and computational cost of Multi-View Stereo (MVS) algorithms. Most existing MVS algorithms employ window matching based on Normalized Cross-Correlation (NCC) to estimate the depth of a 3D point. NCC-based window matching estimates the displacement between matching windows with sub-pixel accuracy by linear/cubic interpolation, which does not represent accurate sub-pixel values of matching windows. This paper proposes a technique of window matching that is very accurate using Phase-Only Correlation (POC) with geometric correction for MVS. The accurate sub-pixel displacement between two matching windows can be estimated by fitting the analytical correlation peak model of the POC function. The proposed method also corrects the geometric transformations of matching windows by taking into consideration the 3D shape of a target object. The use of the proposed geometric correction approach makes it possible to achieve accurate 3D reconstruction from multi-view images even for images with large transformations. The proposed method demonstrates more accurate 3D reconstruction from multi-view images than the conventional methods in a set of experiments.

Journal

• IEICE Transactions on Information and Systems

  IEICE Transactions on Information and Systems E98.D (10), 1818-1828, 2015

  The Institute of Electronics, Information and Communication Engineers

Keywords

• multi-view stereo
• window matching
• geometric correction
• phase-only correlation

Details

• CRID: 1390001204378403840
• NII Article ID: 130005101297
• DOI: 10.1587/transinf.2014edp7409
• ISSN: 17451361
• ISSN: 09168532
• Web Site: https://www.jstage.jst.go.jp/article/transinf/E98.D/10/E98.D_2014EDP7409/_pdf
• Text Lang: en
• Data Source:
  • JaLC
  • Crossref
  • CiNii Articles
  • KAKEN
• Abstract License Flag: Disallowed