TY - JOUR
T1 - Digital Twin and Meta RL Empowered Fast-Adaptation of Joint User Scheduling and Task Offloading for Mobile Industrial IoT
AU - Xu, Hansong
AU - Wu, Jun
AU - Pan, Qianqian
AU - Liu, Xing
AU - Verikoukis, Christos
N1 - Publisher Copyright:
© 1983-2012 IEEE.
PY - 2023/10/1
Y1 - 2023/10/1
N2 - The industrial Internet of Things (IoT) system is integrated with the emerging artificial intelligence (AI) paradigms to empower industrial automation and self-evolving capabilities. AI-driven resource allocation across cyber-physical domains for mobile industrial IoT must consider its fundamental requirements and key characteristics such as high reliability, low latency, and environmental dynamics. The challenge is twofold. Industrial systems are fault-sensitive, which makes them intolerable of trial-And-error-based learning and optimization approaches. In addition, learning models cannot adapt to changing industrial IoT environment with dynamic communication noise and machinery disturbances. In this paper, we propose joint optimization for the nonorthogonal multiple access (NOMA) and multi-Tier hybrid cloud-edge computing empowered industrial IoT that results in improved utilization of communication and computing resources. Second, we establish the fine-grained digital twin for industrial IoT (DT-IIoT) to simulate the changing industrial environment to support trial-And-error-based safe learning. Third, we leverage meta reinforcement learning (meta RL) to improve the generalization and fast adaptation of the learning models for DT-IIoT. Finally, the feasibility and efficiency of these schemes are evaluated through extensive experiments.
AB - The industrial Internet of Things (IoT) system is integrated with the emerging artificial intelligence (AI) paradigms to empower industrial automation and self-evolving capabilities. AI-driven resource allocation across cyber-physical domains for mobile industrial IoT must consider its fundamental requirements and key characteristics such as high reliability, low latency, and environmental dynamics. The challenge is twofold. Industrial systems are fault-sensitive, which makes them intolerable of trial-And-error-based learning and optimization approaches. In addition, learning models cannot adapt to changing industrial IoT environment with dynamic communication noise and machinery disturbances. In this paper, we propose joint optimization for the nonorthogonal multiple access (NOMA) and multi-Tier hybrid cloud-edge computing empowered industrial IoT that results in improved utilization of communication and computing resources. Second, we establish the fine-grained digital twin for industrial IoT (DT-IIoT) to simulate the changing industrial environment to support trial-And-error-based safe learning. Third, we leverage meta reinforcement learning (meta RL) to improve the generalization and fast adaptation of the learning models for DT-IIoT. Finally, the feasibility and efficiency of these schemes are evaluated through extensive experiments.
KW - Digital twin
KW - industrial IoT
KW - meta reinforcement learning
KW - multi-Tier computing
KW - non-orthogonal multiple access
UR - http://www.scopus.com/inward/record.url?scp=85171575655&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85171575655&partnerID=8YFLogxK
U2 - 10.1109/JSAC.2023.3310081
DO - 10.1109/JSAC.2023.3310081
M3 - Article
AN - SCOPUS:85171575655
SN - 0733-8716
VL - 41
SP - 3254
EP - 3266
JO - IEEE Journal on Selected Areas in Communications
JF - IEEE Journal on Selected Areas in Communications
IS - 10
ER -