A linear algebra perspective on the random multi-block ADMM: the QP case
A linear algebra perspective on the random multi-block ADMM: the QP case
Embedding randomization procedures in the Alternating Direction Method of Multipliers (ADMM) has recently attracted an increasing amount of interest as a remedy to the fact that the direct multi-block generalization of ADMM is not necessarily convergent. Even if, in practice, the introduction of such techniques could mitigate the diverging behaviour of the multi-block extension of ADMM, from the theoretical point of view, it can ensure just the convergence in expectation, which may not be a good indicator of its robustness and efficiency. In this work, analysing the strongly convex quadratic programming case from a linear algebra perspective, we interpret the block Gauss–Seidel sweep performed by the multi-block ADMM in the context of the inexact Augmented Lagrangian Method. Using the proposed analysis, we are able to outline an alternative technique to those present in the literature which, supported from stronger theoretical guarantees, is able to ensure the convergence of the multi-block generalization of the ADMM method.
Alternating direction method of multipliers, Inexact augmented Lagrangian method, Randomly shuffled Gauss–Seidel
Cipolla, Stefano
373fdd4b-520f-485c-b36d-f75ce33d4e05
Gondzio, Jacek
83e55b47-99a9-4f07-bbd0-79258ce12830
Cipolla, Stefano
373fdd4b-520f-485c-b36d-f75ce33d4e05
Gondzio, Jacek
83e55b47-99a9-4f07-bbd0-79258ce12830
Cipolla, Stefano and Gondzio, Jacek
(2023)
A linear algebra perspective on the random multi-block ADMM: the QP case.
Calcolo, 60, [54].
(doi:10.1007/s10092-023-00546-0).
Abstract
Embedding randomization procedures in the Alternating Direction Method of Multipliers (ADMM) has recently attracted an increasing amount of interest as a remedy to the fact that the direct multi-block generalization of ADMM is not necessarily convergent. Even if, in practice, the introduction of such techniques could mitigate the diverging behaviour of the multi-block extension of ADMM, from the theoretical point of view, it can ensure just the convergence in expectation, which may not be a good indicator of its robustness and efficiency. In this work, analysing the strongly convex quadratic programming case from a linear algebra perspective, we interpret the block Gauss–Seidel sweep performed by the multi-block ADMM in the context of the inexact Augmented Lagrangian Method. Using the proposed analysis, we are able to outline an alternative technique to those present in the literature which, supported from stronger theoretical guarantees, is able to ensure the convergence of the multi-block generalization of the ADMM method.
Text
s10092-023-00546-0
- Version of Record
More information
Accepted/In Press date: 13 October 2023
e-pub ahead of print date: 15 November 2023
Additional Information:
Funding Information: the authors are in debt with M. Rossi (University of Milano-Bicocca) for the fruitful discussions on some technical details about the probabilistic case.
Keywords:
Alternating direction method of multipliers, Inexact augmented Lagrangian method, Randomly shuffled Gauss–Seidel
Identifiers
Local EPrints ID: 485127
URI: http://eprints.soton.ac.uk/id/eprint/485127
ISSN: 0008-0624
PURE UUID: 810710b5-cd69-48ab-95eb-89db8c832707
Catalogue record
Date deposited: 29 Nov 2023 18:17
Last modified: 18 Mar 2024 04:17
Export record
Altmetrics
Contributors
Author:
Stefano Cipolla
Author:
Jacek Gondzio
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics