3D surface reconstruction based on image stitching from gastric endoscopic video sequence

Mengyao Duan, Rong Xu, Jun Ohya

研究成果: Conference contribution

1 被引用数 (Scopus)


This paper proposes a method for reconstructing 3D detailed structures of internal organs such as gastric wall from endoscopic video sequences. The proposed method consists of the four major steps: Feature-point-based 3D reconstruction, 3D point cloud stitching, dense point cloud creation and Poisson surface reconstruction. Before the first step, we partition one video sequence into groups, where each group consists of two successive frames (image pairs), and each pair in each group contains one overlapping part, which is used as a stitching region. Fist, the 3D point cloud of each group is reconstructed by utilizing structure from motion (SFM). Secondly, a scheme based on SIFT features registers and stitches the obtained 3D point clouds, by estimating the transformation matrix of the overlapping part between different groups with high accuracy and efficiency. Thirdly, we select the most robust SIFT feature points as the seed points, and then obtain the dense point cloud from sparse point cloud via a depth testing method presented by Furukawa. Finally, by utilizing Poisson surface reconstruction, polygonal patches for the internal organs are obtained. Experimental results demonstrate that the proposed method achieves a high accuracy and efficiency for 3D reconstruction of gastric surface from an endoscopic video sequence.

ホスト出版物のタイトルApplications of Digital Image Processing XXXVI
出版ステータスPublished - 2013
イベントApplications of Digital Image Processing XXXVI - San Diego, CA, United States
継続期間: 2013 8月 262013 8月 29


名前Proceedings of SPIE - The International Society for Optical Engineering


ConferenceApplications of Digital Image Processing XXXVI
国/地域United States
CitySan Diego, CA

ASJC Scopus subject areas

  • 電子材料、光学材料、および磁性材料
  • 凝縮系物理学
  • コンピュータ サイエンスの応用
  • 応用数学
  • 電子工学および電気工学


「3D surface reconstruction based on image stitching from gastric endoscopic video sequence」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。