The University of Southampton
University of Southampton Institutional Repository

Communication-assisted multi-agent reinforcement learning improves task-offloading in UAV-aided edge-computing networks

Communication-assisted multi-agent reinforcement learning improves task-offloading in UAV-aided edge-computing networks
Communication-assisted multi-agent reinforcement learning improves task-offloading in UAV-aided edge-computing networks
Equipping unmanned aerial vehicles (UAVs) with computing servers allows the ground-users to offload complex tasks to the UAVs, but the trajectory optimization of UAVs is critical for fully exploiting their maneuverability. Existing studies either employ a centralized controller having prohibitive communication overhead, or fail to glean the benefits of interaction and coordination among agents. To circumvent this impediment, we propose to intelligently exchange critical information among agents for assisting their decision-making. We first formulate a problem for maximizing the number of offloaded tasks and the offloading fairness by optimizing the trajectory of UAVs. We then conceive a multi-agent deep reinforcement learning (DRL) framework by harnessing communication among agents, and design a communication-assisted decentralized trajectory control algorithm based on value-decomposition networks (VDN) for fully exploiting the benefits of messages exchange among agents. Simulation results demonstrate the superiority of the proposed
algorithm over the state-of-the-art DRL-based algorithms.
Multi-agent reinforcement learning, UAV, trajectory planning
2162-2337
2233 - 2237
Tan, Siyang
0c4095d5-08b0-431f-96d4-1507f3f721bd
Chen, Binqiang
62107585-d06e-472f-9487-e6dace363ceb
Liu, Dong
7a88f69c-c83c-4837-bf7a-49879392c32f
Zhang, Jiankang
7f2ffa44-52d3-4388-9d98-10506eb07bf9
Hanzo, Lajos
66e7266f-3066-4fc0-8391-e000acce71a1
Tan, Siyang
0c4095d5-08b0-431f-96d4-1507f3f721bd
Chen, Binqiang
62107585-d06e-472f-9487-e6dace363ceb
Liu, Dong
7a88f69c-c83c-4837-bf7a-49879392c32f
Zhang, Jiankang
7f2ffa44-52d3-4388-9d98-10506eb07bf9
Hanzo, Lajos
66e7266f-3066-4fc0-8391-e000acce71a1

Tan, Siyang, Chen, Binqiang, Liu, Dong, Zhang, Jiankang and Hanzo, Lajos (2023) Communication-assisted multi-agent reinforcement learning improves task-offloading in UAV-aided edge-computing networks. IEEE Wireless Communications Letters, 12 (12), 2233 - 2237. (doi:10.1109/LWC.2023.3316794).

Record type: Article

Abstract

Equipping unmanned aerial vehicles (UAVs) with computing servers allows the ground-users to offload complex tasks to the UAVs, but the trajectory optimization of UAVs is critical for fully exploiting their maneuverability. Existing studies either employ a centralized controller having prohibitive communication overhead, or fail to glean the benefits of interaction and coordination among agents. To circumvent this impediment, we propose to intelligently exchange critical information among agents for assisting their decision-making. We first formulate a problem for maximizing the number of offloaded tasks and the offloading fairness by optimizing the trajectory of UAVs. We then conceive a multi-agent deep reinforcement learning (DRL) framework by harnessing communication among agents, and design a communication-assisted decentralized trajectory control algorithm based on value-decomposition networks (VDN) for fully exploiting the benefits of messages exchange among agents. Simulation results demonstrate the superiority of the proposed
algorithm over the state-of-the-art DRL-based algorithms.

Text
wcl_final - Accepted Manuscript
Download (1MB)

More information

Accepted/In Press date: 14 September 2023
e-pub ahead of print date: 18 September 2023
Published date: 1 December 2023
Additional Information: Funding Information: This work was supported in part by the National Natural Science Foundation of China under Grant 62001509 and Grant 62301015; in part by the Youth Top Talent Support Program of Beihang University under Grant YWF-22-L-1269; and in part by the CAAC Key Laboratory of General Aviation Operation under Grant CAMICKFJJ-2020-4. The work of Lajos Hanzo was supported in part by the Engineering and Physical Sciences Research Council under Project EP/W016605/1, Project EP/X01228X/1, and Project EP/Y026721/1; and in part by the Eurospean Research Council's Advanced Fellow Grant QuantCom under Grant 789028. Publisher Copyright: © 2012 IEEE.
Keywords: Multi-agent reinforcement learning, UAV, trajectory planning

Identifiers

Local EPrints ID: 482220
URI: http://eprints.soton.ac.uk/id/eprint/482220
ISSN: 2162-2337
PURE UUID: ce9d9d1e-6ada-4527-ab77-7901e3f02708
ORCID for Lajos Hanzo: ORCID iD orcid.org/0000-0002-2636-5214

Catalogue record

Date deposited: 21 Sep 2023 16:51
Last modified: 18 Mar 2024 05:13

Export record

Altmetrics

Contributors

Author: Siyang Tan
Author: Binqiang Chen
Author: Dong Liu
Author: Jiankang Zhang
Author: Lajos Hanzo ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×