When digital twin meets deep reinforcement learning in multi-UAV path planning

Siyuan Li, Xi Lin*, Jun Wu*, Ali Kashif Bashir, Raheel Nawaz

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

Unmanned aerial vehicles (UAVs) path planning is one of the promising technologies in the fifth-generation wireless communications. The gap between simulation and reality limits the application of deep reinforcement learning (DRL) in UAV path planning. Therefore, we propose a digital twin-based deep reinforcement learning training framework. With the help of digital twin, DRL model can be trained more effectively deployed to real UAVs. In this training framework, we propose a deep deterministic policy gradient (DDPG) based multi-UAV path planning algorithm. Based on decomposed actor structure in DRL, we design a pooling-based combined LSTM network to better understand different state information in a multi-UAV path planning task. Moreover, we also establish a digital twin platform for multi-UAV system, which has a high degree of simulation and visualization. The simulation result shows that the proposed algorithm can achieve higher mean rewards, and outperforms DDPG in average arrival rate by more than 30%.

Original languageEnglish
Title of host publicationDroneCom 2022 - Proceedings of the 5th International ACM Mobicom Workshop on Drone Assisted Wireless Communications for 5G and Beyond
PublisherAssociation for Computing Machinery, Inc
Pages61-66
Number of pages6
ISBN (Electronic)9781450395144
DOIs
Publication statusPublished - 2022 Oct 17
Externally publishedYes
Event5th International ACM Mobicom Workshop on Drone Assisted Wireless Communications for 5G and Beyond, DroneCom 2022 - Sydney, Australia
Duration: 2022 Oct 21 → …

Publication series

NameDroneCom 2022 - Proceedings of the 5th International ACM Mobicom Workshop on Drone Assisted Wireless Communications for 5G and Beyond

Conference

Conference5th International ACM Mobicom Workshop on Drone Assisted Wireless Communications for 5G and Beyond, DroneCom 2022
Country/TerritoryAustralia
CitySydney
Period22/10/21 → …

Keywords

  • deep reinforcement learning
  • digital twin
  • flocking motion
  • multi-UAV system
  • path planning

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems

Fingerprint

Dive into the research topics of 'When digital twin meets deep reinforcement learning in multi-UAV path planning'. Together they form a unique fingerprint.

Cite this