TY - JOUR
T1 - 3D Reconstruction for Super-Resolution CT Images in the Internet of Health Things Using Deep Learning
AU - Zhang, Jing
AU - Gong, Ling Rui
AU - Yu, Keping
AU - Qi, Xin
AU - Wen, Zheng
AU - Hua, Qiaozhi
AU - Myint, San Hlaing
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2020
Y1 - 2020
N2 - The Internet of Health Things (IoHT) enables health devices to connect to the Internet and communicate with each other, which provides the high-accuracy and high-security diagnosis result in the medical area. As essential parts of the IoHT, computed tomography (CT) images help doctors diagnose disease. In the traditional disease diagnosing process, low-resolution medical CT images produce low-accuracy diagnosis results for microlesions. Moreover, CT images can only provide 2D information about organs, and doctors should estimate the 3D shape of a lesion based on experience. To solve these problems, we propose a 3D reconstruction method for secure super-resolution computed tomography (SRCT) images in the IoHT using deep learning. First, we use deep learning to obtain secure SRCT images from low-resolution images in the IoHT. To this end, we adopt a conditional generative adversarial network (CGAN) based on the edge detection loss function (EDLF) in the deep learning process, namely EDLF-CGAN algorithm. In this algorithm, the CGAN is employed to generate SRCT images with luminance and contrast as the input auxiliary conditions, which can improve the accuracy of super-resolution (SR) images. An EDLF is proposed to consider the edge features in the generated SRCT images, which reduces the deformation of generated image. Second, we apply the secure SR images generated from the deep learning method to perform 3D reconstruction. An advanced ray casting 3D reconstruction algorithm that can reduce the number of rays by selecting the appropriate bounding box is proposed. Compared with the traditional algorithm, the proposed ray casting 3D reconstruction algorithm can reduce the time and memory cost. The experimental results show that our EDLF-CGAN has a better SR reconstruction effect than other algorithms via the indicators of the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). In addition, our advanced ray casting 3D reconstruction algorithm greatly improves the efficiency compared with the traditional ray casting algorithm.
AB - The Internet of Health Things (IoHT) enables health devices to connect to the Internet and communicate with each other, which provides the high-accuracy and high-security diagnosis result in the medical area. As essential parts of the IoHT, computed tomography (CT) images help doctors diagnose disease. In the traditional disease diagnosing process, low-resolution medical CT images produce low-accuracy diagnosis results for microlesions. Moreover, CT images can only provide 2D information about organs, and doctors should estimate the 3D shape of a lesion based on experience. To solve these problems, we propose a 3D reconstruction method for secure super-resolution computed tomography (SRCT) images in the IoHT using deep learning. First, we use deep learning to obtain secure SRCT images from low-resolution images in the IoHT. To this end, we adopt a conditional generative adversarial network (CGAN) based on the edge detection loss function (EDLF) in the deep learning process, namely EDLF-CGAN algorithm. In this algorithm, the CGAN is employed to generate SRCT images with luminance and contrast as the input auxiliary conditions, which can improve the accuracy of super-resolution (SR) images. An EDLF is proposed to consider the edge features in the generated SRCT images, which reduces the deformation of generated image. Second, we apply the secure SR images generated from the deep learning method to perform 3D reconstruction. An advanced ray casting 3D reconstruction algorithm that can reduce the number of rays by selecting the appropriate bounding box is proposed. Compared with the traditional algorithm, the proposed ray casting 3D reconstruction algorithm can reduce the time and memory cost. The experimental results show that our EDLF-CGAN has a better SR reconstruction effect than other algorithms via the indicators of the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). In addition, our advanced ray casting 3D reconstruction algorithm greatly improves the efficiency compared with the traditional ray casting algorithm.
KW - 3D reconstruction
KW - Conditional generative adversarial network
KW - Internet of Health Things
KW - edge detection
KW - super-resolution image
UR - http://www.scopus.com/inward/record.url?scp=85089306059&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85089306059&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2020.3007024
DO - 10.1109/ACCESS.2020.3007024
M3 - Article
AN - SCOPUS:85089306059
SN - 2169-3536
VL - 8
SP - 121513
EP - 121525
JO - IEEE Access
JF - IEEE Access
M1 - 9133099
ER -