TY - JOUR
T1 - 3D Reconstruction for motion blurred images using deep learning-based intelligent systems
AU - Zhang, Jing
AU - Yu, Keping
AU - Wen, Zheng
AU - Qi, Xin
AU - Paul, Anup Kumar
N1 - Publisher Copyright:
© 2021 Tech Science Press. All rights reserved.
PY - 2020
Y1 - 2020
N2 - The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual's height and shape quickly and accurately through 2D motion-blurred images. Generally, during the acquisition of images in real-time, motion blur, caused by camera shaking or human motion, appears. Deep learning-based intelligent control applied in vision can help us solve the problem. To this end, we propose a 3D reconstruction method for motion-blurred images using deep learning. First, we develop a BF-WGAN algorithm that combines the bilateral filtering (BF) denoising theory with a Wasserstein generative adversarial network (WGAN) to remove motion blur. The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image. Then, the blurred image and the corresponding sharp image are input into the WGAN. This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions. Next, we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction. We propose a threshold optimization random sample consensus (TO-RANSAC) algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately. Compared with the traditional RANSAC algorithm, the TO-RANSAC algorithm can adjust the threshold adaptively, which improves the accuracy of the 3D reconstruction results. The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms. In addition, the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.
AB - The 3D reconstruction using deep learning-based intelligent systems can provide great help for measuring an individual's height and shape quickly and accurately through 2D motion-blurred images. Generally, during the acquisition of images in real-time, motion blur, caused by camera shaking or human motion, appears. Deep learning-based intelligent control applied in vision can help us solve the problem. To this end, we propose a 3D reconstruction method for motion-blurred images using deep learning. First, we develop a BF-WGAN algorithm that combines the bilateral filtering (BF) denoising theory with a Wasserstein generative adversarial network (WGAN) to remove motion blur. The bilateral filter denoising algorithm is used to remove the noise and to retain the details of the blurred image. Then, the blurred image and the corresponding sharp image are input into the WGAN. This algorithm distinguishes the motion-blurred image from the corresponding sharp image according to the WGAN loss and perceptual loss functions. Next, we use the deblurred images generated by the BFWGAN algorithm for 3D reconstruction. We propose a threshold optimization random sample consensus (TO-RANSAC) algorithm that can remove the wrong relationship between two views in the 3D reconstructed model relatively accurately. Compared with the traditional RANSAC algorithm, the TO-RANSAC algorithm can adjust the threshold adaptively, which improves the accuracy of the 3D reconstruction results. The experimental results show that our BF-WGAN algorithm has a better deblurring effect and higher efficiency than do other representative algorithms. In addition, the TO-RANSAC algorithm yields a calculation accuracy considerably higher than that of the traditional RANSAC algorithm.
KW - 3D reconstruction
KW - Bilateral filtering
KW - Deep learning
KW - Intelligent systems
KW - Motion blurring
KW - Random sample consensus
UR - http://www.scopus.com/inward/record.url?scp=85097158718&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85097158718&partnerID=8YFLogxK
U2 - 10.32604/cmc.2020.014220
DO - 10.32604/cmc.2020.014220
M3 - Article
AN - SCOPUS:85097158718
SN - 1546-2218
VL - 66
SP - 2087
EP - 2104
JO - Computers, Materials and Continua
JF - Computers, Materials and Continua
IS - 2
ER -