The University of Southampton
University of Southampton Institutional Repository
Warning ePrints Soton is experiencing an issue with some file downloads not being available. We are working hard to fix this. Please bear with us.

A proactive Q-learning approach for autoscaling heterogeneous cloud servers

A proactive Q-learning approach for autoscaling heterogeneous cloud servers
A proactive Q-learning approach for autoscaling heterogeneous cloud servers

Cloud providers offer different physical or virtual machine (VM) types that have different computational power and cost. Choosing the right configuration in a such heterogeneous environment able to sustain a workload while minimising costs is a challenging key aspect. Furthermore, turning-on/off a VM does not come for free, but introduce a reconfiguration overhead that might bring additional costs (e.g. time for moving to the new state and wasted resources for reconfiguration process). In this paper, we aim to find at run time a configuration s.t. (i) is able to sustain an input workload, (ii) does not over-provide resources, and that (iii) is as close as possible to the current one, to minimise the number of involved VMs in the reconfiguration, and thus, minimise the reconfiguration overhead. We propose here a Q-Learning approach to automatically learn the best policy to move from a configuration to another according to a predicted workload. We defined two reward functions which respectively look for (i) a configuration which perfectly fits the requested workload and (ii) a configuration which arrives close to the requested workload, to minimise the reconfiguration overhead. We compared the results with the two reward functions in term of average number of VMs involved in a reconfiguration and we show as with the first reward function we need to change in average 2.3 VM/reconfiguration while with the second reward function we can reduce such number up to 1 VM per reconfiguration with some over-provisioning.

automatic scaling, heterogeneous cloud, q-learning
166-172
Institute of Electrical and Electronics Engineers Inc.
Lombardi, Federico
78e41297-64c9-4c1e-9515-8eb59334a795
Lombardi, Federico
78e41297-64c9-4c1e-9515-8eb59334a795

Lombardi, Federico (2018) A proactive Q-learning approach for autoscaling heterogeneous cloud servers. In Proceedings - 2018 14th European Dependable Computing Conference, EDCC 2018. Institute of Electrical and Electronics Engineers Inc. pp. 166-172 . (doi:10.1109/EDCC.2018.00038).

Record type: Conference or Workshop Item (Paper)

Abstract

Cloud providers offer different physical or virtual machine (VM) types that have different computational power and cost. Choosing the right configuration in a such heterogeneous environment able to sustain a workload while minimising costs is a challenging key aspect. Furthermore, turning-on/off a VM does not come for free, but introduce a reconfiguration overhead that might bring additional costs (e.g. time for moving to the new state and wasted resources for reconfiguration process). In this paper, we aim to find at run time a configuration s.t. (i) is able to sustain an input workload, (ii) does not over-provide resources, and that (iii) is as close as possible to the current one, to minimise the number of involved VMs in the reconfiguration, and thus, minimise the reconfiguration overhead. We propose here a Q-Learning approach to automatically learn the best policy to move from a configuration to another according to a predicted workload. We defined two reward functions which respectively look for (i) a configuration which perfectly fits the requested workload and (ii) a configuration which arrives close to the requested workload, to minimise the reconfiguration overhead. We compared the results with the two reward functions in term of average number of VMs involved in a reconfiguration and we show as with the first reward function we need to change in average 2.3 VM/reconfiguration while with the second reward function we can reduce such number up to 1 VM per reconfiguration with some over-provisioning.

This record has no associated files available for download.

More information

Published date: 9 November 2018
Venue - Dates: 14th European Dependable Computing Conference, EDCC 2018, , Iasi, 2018-09-09 - 2018-09-13
Keywords: automatic scaling, heterogeneous cloud, q-learning

Identifiers

Local EPrints ID: 427271
URI: http://eprints.soton.ac.uk/id/eprint/427271
PURE UUID: 1532c8db-dcd7-414a-b39d-b37f105ca6ec
ORCID for Federico Lombardi: ORCID iD orcid.org/0000-0001-6463-8722

Catalogue record

Date deposited: 10 Jan 2019 17:30
Last modified: 25 Nov 2021 21:44

Export record

Altmetrics

Contributors

Author: Federico Lombardi ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×