The University of Southampton
University of Southampton Institutional Repository

A linear algebra perspective on the random multi-block ADMM: the QP case

A linear algebra perspective on the random multi-block ADMM: the QP case
A linear algebra perspective on the random multi-block ADMM: the QP case

Embedding randomization procedures in the Alternating Direction Method of Multipliers (ADMM) has recently attracted an increasing amount of interest as a remedy to the fact that the direct multi-block generalization of ADMM is not necessarily convergent. Even if, in practice, the introduction of such techniques could mitigate the diverging behaviour of the multi-block extension of ADMM, from the theoretical point of view, it can ensure just the convergence in expectation, which may not be a good indicator of its robustness and efficiency. In this work, analysing the strongly convex quadratic programming case from a linear algebra perspective, we interpret the block Gauss–Seidel sweep performed by the multi-block ADMM in the context of the inexact Augmented Lagrangian Method. Using the proposed analysis, we are able to outline an alternative technique to those present in the literature which, supported from stronger theoretical guarantees, is able to ensure the convergence of the multi-block generalization of the ADMM method.

Alternating direction method of multipliers, Inexact augmented Lagrangian method, Randomly shuffled Gauss–Seidel
0008-0624
Cipolla, Stefano
373fdd4b-520f-485c-b36d-f75ce33d4e05
Gondzio, Jacek
83e55b47-99a9-4f07-bbd0-79258ce12830
Cipolla, Stefano
373fdd4b-520f-485c-b36d-f75ce33d4e05
Gondzio, Jacek
83e55b47-99a9-4f07-bbd0-79258ce12830

Cipolla, Stefano and Gondzio, Jacek (2023) A linear algebra perspective on the random multi-block ADMM: the QP case. Calcolo, 60, [54]. (doi:10.1007/s10092-023-00546-0).

Record type: Article

Abstract

Embedding randomization procedures in the Alternating Direction Method of Multipliers (ADMM) has recently attracted an increasing amount of interest as a remedy to the fact that the direct multi-block generalization of ADMM is not necessarily convergent. Even if, in practice, the introduction of such techniques could mitigate the diverging behaviour of the multi-block extension of ADMM, from the theoretical point of view, it can ensure just the convergence in expectation, which may not be a good indicator of its robustness and efficiency. In this work, analysing the strongly convex quadratic programming case from a linear algebra perspective, we interpret the block Gauss–Seidel sweep performed by the multi-block ADMM in the context of the inexact Augmented Lagrangian Method. Using the proposed analysis, we are able to outline an alternative technique to those present in the literature which, supported from stronger theoretical guarantees, is able to ensure the convergence of the multi-block generalization of the ADMM method.

Text
s10092-023-00546-0 - Version of Record
Available under License Creative Commons Attribution.
Download (1MB)

More information

Accepted/In Press date: 13 October 2023
e-pub ahead of print date: 15 November 2023
Additional Information: Funding Information: the authors are in debt with M. Rossi (University of Milano-Bicocca) for the fruitful discussions on some technical details about the probabilistic case.
Keywords: Alternating direction method of multipliers, Inexact augmented Lagrangian method, Randomly shuffled Gauss–Seidel

Identifiers

Local EPrints ID: 485127
URI: http://eprints.soton.ac.uk/id/eprint/485127
ISSN: 0008-0624
PURE UUID: 810710b5-cd69-48ab-95eb-89db8c832707
ORCID for Stefano Cipolla: ORCID iD orcid.org/0000-0002-8000-4719

Catalogue record

Date deposited: 29 Nov 2023 18:17
Last modified: 18 Mar 2024 04:17

Export record

Altmetrics

Contributors

Author: Stefano Cipolla ORCID iD
Author: Jacek Gondzio

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×