Communication-assisted multi-agent reinforcement learning improves task-offloading in UAV-aided edge-computing networks
Communication-assisted multi-agent reinforcement learning improves task-offloading in UAV-aided edge-computing networks
Equipping unmanned aerial vehicles (UAVs) with computing servers allows the ground-users to offload complex tasks to the UAVs, but the trajectory optimization of UAVs is critical for fully exploiting their maneuverability. Existing studies either employ a centralized controller having prohibitive communication overhead, or fail to glean the benefits of interaction and coordination among agents. To circumvent this impediment, we propose to intelligently exchange critical information among agents for assisting their decision-making. We first formulate a problem for maximizing the number of offloaded tasks and the offloading fairness by optimizing the trajectory of UAVs. We then conceive a multi-agent deep reinforcement learning (DRL) framework by harnessing communication among agents, and design a communication-assisted decentralized trajectory control algorithm based on value-decomposition networks (VDN) for fully exploiting the benefits of messages exchange among agents. Simulation results demonstrate the superiority of the proposed
algorithm over the state-of-the-art DRL-based algorithms.
Multi-agent reinforcement learning, UAV, trajectory planning
2233 - 2237
Tan, Siyang
0c4095d5-08b0-431f-96d4-1507f3f721bd
Chen, Binqiang
62107585-d06e-472f-9487-e6dace363ceb
Liu, Dong
7a88f69c-c83c-4837-bf7a-49879392c32f
Zhang, Jiankang
7f2ffa44-52d3-4388-9d98-10506eb07bf9
Hanzo, Lajos
66e7266f-3066-4fc0-8391-e000acce71a1
1 December 2023
Tan, Siyang
0c4095d5-08b0-431f-96d4-1507f3f721bd
Chen, Binqiang
62107585-d06e-472f-9487-e6dace363ceb
Liu, Dong
7a88f69c-c83c-4837-bf7a-49879392c32f
Zhang, Jiankang
7f2ffa44-52d3-4388-9d98-10506eb07bf9
Hanzo, Lajos
66e7266f-3066-4fc0-8391-e000acce71a1
Tan, Siyang, Chen, Binqiang, Liu, Dong, Zhang, Jiankang and Hanzo, Lajos
(2023)
Communication-assisted multi-agent reinforcement learning improves task-offloading in UAV-aided edge-computing networks.
IEEE Wireless Communications Letters, 12 (12), .
(doi:10.1109/LWC.2023.3316794).
Abstract
Equipping unmanned aerial vehicles (UAVs) with computing servers allows the ground-users to offload complex tasks to the UAVs, but the trajectory optimization of UAVs is critical for fully exploiting their maneuverability. Existing studies either employ a centralized controller having prohibitive communication overhead, or fail to glean the benefits of interaction and coordination among agents. To circumvent this impediment, we propose to intelligently exchange critical information among agents for assisting their decision-making. We first formulate a problem for maximizing the number of offloaded tasks and the offloading fairness by optimizing the trajectory of UAVs. We then conceive a multi-agent deep reinforcement learning (DRL) framework by harnessing communication among agents, and design a communication-assisted decentralized trajectory control algorithm based on value-decomposition networks (VDN) for fully exploiting the benefits of messages exchange among agents. Simulation results demonstrate the superiority of the proposed
algorithm over the state-of-the-art DRL-based algorithms.
Text
wcl_final
- Accepted Manuscript
More information
Accepted/In Press date: 14 September 2023
e-pub ahead of print date: 18 September 2023
Published date: 1 December 2023
Additional Information:
Funding Information:
This work was supported in part by the National Natural Science Foundation of China under Grant 62001509 and Grant 62301015; in part by the Youth Top Talent Support Program of Beihang University under Grant YWF-22-L-1269; and in part by the CAAC Key Laboratory of General Aviation Operation under Grant CAMICKFJJ-2020-4. The work of Lajos Hanzo was supported in part by the Engineering and Physical Sciences Research Council under Project EP/W016605/1, Project EP/X01228X/1, and Project EP/Y026721/1; and in part by the Eurospean Research Council's Advanced Fellow Grant QuantCom under Grant 789028.
Publisher Copyright:
© 2012 IEEE.
Keywords:
Multi-agent reinforcement learning, UAV, trajectory planning
Identifiers
Local EPrints ID: 482220
URI: http://eprints.soton.ac.uk/id/eprint/482220
ISSN: 2162-2337
PURE UUID: ce9d9d1e-6ada-4527-ab77-7901e3f02708
Catalogue record
Date deposited: 21 Sep 2023 16:51
Last modified: 18 Mar 2024 05:13
Export record
Altmetrics
Contributors
Author:
Siyang Tan
Author:
Binqiang Chen
Author:
Dong Liu
Author:
Jiankang Zhang
Author:
Lajos Hanzo
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics