The University of Southampton
University of Southampton Institutional Repository

Hybrid edge-cloud collaborator resource scheduling approach based on deep reinforcement learning and multi-objective optimization

Hybrid edge-cloud collaborator resource scheduling approach based on deep reinforcement learning and multi-objective optimization
Hybrid edge-cloud collaborator resource scheduling approach based on deep reinforcement learning and multi-objective optimization
Collaborative resource scheduling between edge terminals and cloud centers is regarded as a promising means of effectively completing computing tasks and enhancing quality of service. In this paper, to further improve the achievable performance, the edge cloud resource scheduling (ECRS) problem is transformed into a multi-objective Markov decision process based on task dependency and features extraction. A multi-objective ECRS model is proposed by considering the task completion time, cost, energy consumption and system reliability as the four objectives. Furthermore, a hybrid approach based on deep reinforcement learning (DRL) and multi-objective optimization are employed in our work. Specifically, DRL preprocesses the workflow, and a multi-objective optimization method strives to find the Pareto-optimal workflow scheduling decision. Various experiments are performed on three real data sets with different numbers of tasks. The results obtained demonstrate that the proposed hybrid DRL and multi-objective optimization design outperforms existing design approaches.
0018-9340
192-205
Zhang, Jiangjiang
97465283-8fad-499d-9b2c-48ab34aed836
Ning, Zhenhu
f783e6e3-f191-4e1a-b835-28c049a94327
Waqas, Muhammad
28f978b5-2da0-4060-aa7c-d5cadc1a48e1
Alasmary, Hisham
5f38ead1-f928-4f7d-bc0d-81a3ccb53034
Tu, Shanshan
ef946f84-9863-4438-a847-0171915b0651
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Zhang, Jiangjiang
97465283-8fad-499d-9b2c-48ab34aed836
Ning, Zhenhu
f783e6e3-f191-4e1a-b835-28c049a94327
Waqas, Muhammad
28f978b5-2da0-4060-aa7c-d5cadc1a48e1
Alasmary, Hisham
5f38ead1-f928-4f7d-bc0d-81a3ccb53034
Tu, Shanshan
ef946f84-9863-4438-a847-0171915b0651
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80

Zhang, Jiangjiang, Ning, Zhenhu, Waqas, Muhammad, Alasmary, Hisham, Tu, Shanshan and Chen, Sheng (2024) Hybrid edge-cloud collaborator resource scheduling approach based on deep reinforcement learning and multi-objective optimization. IEEE Transactions on Computers, 73 (1), 192-205. (doi:10.1109/TC.2023.3326977).

Record type: Article

Abstract

Collaborative resource scheduling between edge terminals and cloud centers is regarded as a promising means of effectively completing computing tasks and enhancing quality of service. In this paper, to further improve the achievable performance, the edge cloud resource scheduling (ECRS) problem is transformed into a multi-objective Markov decision process based on task dependency and features extraction. A multi-objective ECRS model is proposed by considering the task completion time, cost, energy consumption and system reliability as the four objectives. Furthermore, a hybrid approach based on deep reinforcement learning (DRL) and multi-objective optimization are employed in our work. Specifically, DRL preprocesses the workflow, and a multi-objective optimization method strives to find the Pareto-optimal workflow scheduling decision. Various experiments are performed on three real data sets with different numbers of tasks. The results obtained demonstrate that the proposed hybrid DRL and multi-objective optimization design outperforms existing design approaches.

Text
TransComputer - Accepted Manuscript
Download (1MB)
Text
TransComp2024-Jan - Version of Record
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 16 October 2023
e-pub ahead of print date: 2 November 2023
Published date: January 2024
Additional Information: Funding Information: This work was supported in part by the National Key Research and Development Project of China under Grant 2019YFB2102300 and in part by the National Natural Science Foundation of China under Grant 61971014. The authors also extend their appreciation at King Khalid University for funding this work through Large Group Project under Grant RGP.2/312/44J. Recommended for acceptance by R. Marculescu. Publisher Copyright: © 2023 IEEE.

Identifiers

Local EPrints ID: 483583
URI: http://eprints.soton.ac.uk/id/eprint/483583
ISSN: 0018-9340
PURE UUID: 641cd0cf-b75f-4546-b7b2-4a068d69ca9e

Catalogue record

Date deposited: 01 Nov 2023 18:17
Last modified: 17 Mar 2024 05:16

Export record

Altmetrics

Contributors

Author: Jiangjiang Zhang
Author: Zhenhu Ning
Author: Muhammad Waqas
Author: Hisham Alasmary
Author: Shanshan Tu
Author: Sheng Chen

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×