The University of Southampton
University of Southampton Institutional Repository

Optimal preventive policies for parallel systems using Markov decision process: application to an offshore power plant

Optimal preventive policies for parallel systems using Markov decision process: application to an offshore power plant
Optimal preventive policies for parallel systems using Markov decision process: application to an offshore power plant
This work proposes a Markov Decision Process (MDP) model for identifying windows of opportunities to perform preventive maintenance for multi-unit parallel systems subject to a varying demand. The main contribution lies in proposing: (i) a reward function that does not depend on maintenance costs, which are typically difficult to assess and classify; and (ii) a new metric for prevention.

By optimizing the capacity utilization rate and the decision flexibility, which is denoted in terms of standby units, for a set of typical operational scenarios, the optimal opportunities for preventive interventions are identified within the respective prevention ranges, in relation to an offshore power plant (case study). The sequential decision problem is solved using the Value Iteration algorithm to obtain the optimal long-term policies.

As a result, a backlog management decision-support solution is developed, using a low-cost computational model, which provides scenario-dependent preventive policies and promotes the integration of operations with maintenance, being easy to implement, maintain and communicate with stakeholders.
Maintenance decision-making, Markov decision process, Opportunistic maintenance, Preventive maintenance, Preventive operation
2193-9438
Machado, Mario Marcondes
33f72715-35c9-454f-be30-be4f8e859d15
Silva, Thiago L.
f171ff51-f776-4c83-80c3-535ec6aa935b
Camponogara, Eduardo
90a0ea7c-d909-444e-a735-821c8ee8c0bc
Arruda, Edilson F.
8eb3bd83-e883-4bf3-bfbc-7887c5daa911
Ferreira Filho, Virgílio José Martins
6853ee2e-9675-43be-afcb-77d1677716e9
Machado, Mario Marcondes
33f72715-35c9-454f-be30-be4f8e859d15
Silva, Thiago L.
f171ff51-f776-4c83-80c3-535ec6aa935b
Camponogara, Eduardo
90a0ea7c-d909-444e-a735-821c8ee8c0bc
Arruda, Edilson F.
8eb3bd83-e883-4bf3-bfbc-7887c5daa911
Ferreira Filho, Virgílio José Martins
6853ee2e-9675-43be-afcb-77d1677716e9

Machado, Mario Marcondes, Silva, Thiago L., Camponogara, Eduardo, Arruda, Edilson F. and Ferreira Filho, Virgílio José Martins (2023) Optimal preventive policies for parallel systems using Markov decision process: application to an offshore power plant. EURO Journal on Decision Processes, 11, [100034]. (doi:10.1016/j.ejdp.2023.100034).

Record type: Article

Abstract

This work proposes a Markov Decision Process (MDP) model for identifying windows of opportunities to perform preventive maintenance for multi-unit parallel systems subject to a varying demand. The main contribution lies in proposing: (i) a reward function that does not depend on maintenance costs, which are typically difficult to assess and classify; and (ii) a new metric for prevention.

By optimizing the capacity utilization rate and the decision flexibility, which is denoted in terms of standby units, for a set of typical operational scenarios, the optimal opportunities for preventive interventions are identified within the respective prevention ranges, in relation to an offshore power plant (case study). The sequential decision problem is solved using the Value Iteration algorithm to obtain the optimal long-term policies.

As a result, a backlog management decision-support solution is developed, using a low-cost computational model, which provides scenario-dependent preventive policies and promotes the integration of operations with maintenance, being easy to implement, maintain and communicate with stakeholders.

Text
1-s2.0-S2193943823000079-main - Version of Record
Download (3MB)

More information

Accepted/In Press date: 8 June 2023
e-pub ahead of print date: 19 June 2023
Published date: 30 June 2023
Additional Information: Funding Information: The authors gratefully acknowledge Petróleo Brasileiro S.A. (Petrobras) for supporting this research in collaboration with the Norwegian University of Science and Technology (NTNU) as well as the anonymous reviewers for constructive suggestions to improve the quality and readability of this paper. Publisher Copyright: © 2023 The Author(s)
Keywords: Maintenance decision-making, Markov decision process, Opportunistic maintenance, Preventive maintenance, Preventive operation

Identifiers

Local EPrints ID: 478554
URI: http://eprints.soton.ac.uk/id/eprint/478554
ISSN: 2193-9438
PURE UUID: 4c4a648d-9555-4f63-9c72-9331363feba4
ORCID for Edilson F. Arruda: ORCID iD orcid.org/0000-0002-9835-352X

Catalogue record

Date deposited: 04 Jul 2023 17:55
Last modified: 06 Jun 2024 02:09

Export record

Altmetrics

Contributors

Author: Mario Marcondes Machado
Author: Thiago L. Silva
Author: Eduardo Camponogara
Author: Edilson F. Arruda ORCID iD
Author: Virgílio José Martins Ferreira Filho

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×