Hybrid edge-cloud collaborator resource scheduling approach based on deep reinforcement learning and multi-objective optimization
Hybrid edge-cloud collaborator resource scheduling approach based on deep reinforcement learning and multi-objective optimization
Collaborative resource scheduling between edge terminals and cloud centers is regarded as a promising means of effectively completing computing tasks and enhancing quality of service. In this paper, to further improve the achievable performance, the edge cloud resource scheduling (ECRS) problem is transformed into a multi-objective Markov decision process based on task dependency and features extraction. A multi-objective ECRS model is proposed by considering the task completion time, cost, energy consumption and system reliability as the four objectives. Furthermore, a hybrid approach based on deep reinforcement learning (DRL) and multi-objective optimization are employed in our work. Specifically, DRL preprocesses the workflow, and a multi-objective optimization method strives to find the Pareto-optimal workflow scheduling decision. Various experiments are performed on three real data sets with different numbers of tasks. The results obtained demonstrate that the proposed hybrid DRL and multi-objective optimization design outperforms existing design approaches.
192-205
Zhang, Jiangjiang
97465283-8fad-499d-9b2c-48ab34aed836
Ning, Zhenhu
f783e6e3-f191-4e1a-b835-28c049a94327
Waqas, Muhammad
28f978b5-2da0-4060-aa7c-d5cadc1a48e1
Alasmary, Hisham
5f38ead1-f928-4f7d-bc0d-81a3ccb53034
Tu, Shanshan
ef946f84-9863-4438-a847-0171915b0651
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
January 2024
Zhang, Jiangjiang
97465283-8fad-499d-9b2c-48ab34aed836
Ning, Zhenhu
f783e6e3-f191-4e1a-b835-28c049a94327
Waqas, Muhammad
28f978b5-2da0-4060-aa7c-d5cadc1a48e1
Alasmary, Hisham
5f38ead1-f928-4f7d-bc0d-81a3ccb53034
Tu, Shanshan
ef946f84-9863-4438-a847-0171915b0651
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Zhang, Jiangjiang, Ning, Zhenhu, Waqas, Muhammad, Alasmary, Hisham, Tu, Shanshan and Chen, Sheng
(2024)
Hybrid edge-cloud collaborator resource scheduling approach based on deep reinforcement learning and multi-objective optimization.
IEEE Transactions on Computers, 73 (1), .
(doi:10.1109/TC.2023.3326977).
Abstract
Collaborative resource scheduling between edge terminals and cloud centers is regarded as a promising means of effectively completing computing tasks and enhancing quality of service. In this paper, to further improve the achievable performance, the edge cloud resource scheduling (ECRS) problem is transformed into a multi-objective Markov decision process based on task dependency and features extraction. A multi-objective ECRS model is proposed by considering the task completion time, cost, energy consumption and system reliability as the four objectives. Furthermore, a hybrid approach based on deep reinforcement learning (DRL) and multi-objective optimization are employed in our work. Specifically, DRL preprocesses the workflow, and a multi-objective optimization method strives to find the Pareto-optimal workflow scheduling decision. Various experiments are performed on three real data sets with different numbers of tasks. The results obtained demonstrate that the proposed hybrid DRL and multi-objective optimization design outperforms existing design approaches.
Text
TransComputer
- Accepted Manuscript
Text
TransComp2024-Jan
- Version of Record
Restricted to Repository staff only
Request a copy
More information
Accepted/In Press date: 16 October 2023
e-pub ahead of print date: 2 November 2023
Published date: January 2024
Additional Information:
Funding Information:
This work was supported in part by the National Key Research and Development Project of China under Grant 2019YFB2102300 and in part by the National Natural Science Foundation of China under Grant 61971014. The authors also extend their appreciation at King Khalid University for funding this work through Large Group Project under Grant RGP.2/312/44J. Recommended for acceptance by R. Marculescu.
Publisher Copyright:
© 2023 IEEE.
Identifiers
Local EPrints ID: 483583
URI: http://eprints.soton.ac.uk/id/eprint/483583
ISSN: 0018-9340
PURE UUID: 641cd0cf-b75f-4546-b7b2-4a068d69ca9e
Catalogue record
Date deposited: 01 Nov 2023 18:17
Last modified: 21 Oct 2024 16:54
Export record
Altmetrics
Contributors
Author:
Jiangjiang Zhang
Author:
Zhenhu Ning
Author:
Muhammad Waqas
Author:
Hisham Alasmary
Author:
Shanshan Tu
Author:
Sheng Chen
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics