TY - JOUR
T1 - Deep-Learning-Enhanced Human Activity Recognition for Internet of Healthcare Things
AU - Zhou, Xiaokang
AU - Liang, Wei
AU - Wang, Kevin I.Kai
AU - Wang, Hao
AU - Yang, Laurence T.
AU - Jin, Qun
N1 - Funding Information:
Manuscript received October 27, 2019; revised January 17, 2020 and March 7, 2020; accepted March 18, 2020. Date of publication April 2, 2020; date of current version July 10, 2020. This work was supported in part by the National Key Research and Development Program of China under Grant 2017YFE0117500, in part by the Natural Science Foundation of Hunan Province of China under Grant 2019JJ40150, in part by the Hunan Provincial Education Department Foundation for Excellent Youth Scholars under Grant 17B146, and in part by the Key Project of Hunan Provincial Education Department under Grant 17A113. (Corresponding author: Wei Liang.) Xiaokang Zhou is with the Faculty of Data Science, Shiga University, Hikone 522-8522, Japan, and also with the RIKEN Center for Advanced Intelligence Project, RIKEN, Tokyo 103-0027, Japan (e-mail: zhou@biwako.shiga-u.ac.jp).
Publisher Copyright:
© 2014 IEEE.
PY - 2020/7
Y1 - 2020/7
N2 - Along with the advancement of several emerging computing paradigms and technologies, such as cloud computing, mobile computing, artificial intelligence, and big data, Internet of Things (IoT) technologies have been applied in a variety of fields. In particular, the Internet of Healthcare Things (IoHT) is becoming increasingly important in human activity recognition (HAR) due to the rapid development of wearable and mobile devices. In this article, we focus on the deep-learning-enhanced HAR in IoHT environments. A semisupervised deep learning framework is designed and built for more accurate HAR, which efficiently uses and analyzes the weakly labeled sensor data to train the classifier learning model. To better solve the problem of the inadequately labeled sample, an intelligent autolabeling scheme based on deep Q-network (DQN) is developed with a newly designed distance-based reward rule which can improve the learning efficiency in IoT environments. A multisensor based data fusion mechanism is then developed to seamlessly integrate the on-body sensor data, context sensor data, and personal profile data together, and a long short-term memory (LSTM)-based classification method is proposed to identify fine-grained patterns according to the high-level features contextually extracted from the sequential motion data. Finally, experiments and evaluations are conducted to demonstrate the usefulness and effectiveness of the proposed method using real-world data.
AB - Along with the advancement of several emerging computing paradigms and technologies, such as cloud computing, mobile computing, artificial intelligence, and big data, Internet of Things (IoT) technologies have been applied in a variety of fields. In particular, the Internet of Healthcare Things (IoHT) is becoming increasingly important in human activity recognition (HAR) due to the rapid development of wearable and mobile devices. In this article, we focus on the deep-learning-enhanced HAR in IoHT environments. A semisupervised deep learning framework is designed and built for more accurate HAR, which efficiently uses and analyzes the weakly labeled sensor data to train the classifier learning model. To better solve the problem of the inadequately labeled sample, an intelligent autolabeling scheme based on deep Q-network (DQN) is developed with a newly designed distance-based reward rule which can improve the learning efficiency in IoT environments. A multisensor based data fusion mechanism is then developed to seamlessly integrate the on-body sensor data, context sensor data, and personal profile data together, and a long short-term memory (LSTM)-based classification method is proposed to identify fine-grained patterns according to the high-level features contextually extracted from the sequential motion data. Finally, experiments and evaluations are conducted to demonstrate the usefulness and effectiveness of the proposed method using real-world data.
KW - Deep learning
KW - Internet of Things (IoT)
KW - human activity recognition (HAR)
KW - reinforcement learning
KW - smart healthcare
KW - weakly labeled data
UR - http://www.scopus.com/inward/record.url?scp=85089308697&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85089308697&partnerID=8YFLogxK
U2 - 10.1109/JIOT.2020.2985082
DO - 10.1109/JIOT.2020.2985082
M3 - Article
AN - SCOPUS:85089308697
SN - 2327-4662
VL - 7
SP - 6429
EP - 6438
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 7
M1 - 9055403
ER -