The University of Southampton
University of Southampton Institutional Repository

Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem

Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem
Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem
The O(1/t2) convergence rate of second-order dynamical systems with asymptotic vanishing viscous damping is faster than the O(1/t) rate of systems with fixed viscous damping in unconstrained and linear equality constrained optimization problems. We explore whether the performance of systems with vanishing viscous damping remains superior when both use time scaling. We compare the best polynomial convergence rates of vanishing damping systems with the best exponential convergence rates of a fixed damping system with time scaling for linear equality constrained problems. We prove that the primal-dual trajectory weakly converges to an optimal solution. Additionally, we present an inertial algorithm derived from the implicit discretization of the dynamical system, establishing exponential convergence rates for the primal-dual gap, feasibility measure, and objective value without assuming strong convexity. The sequence of iterates generated by the inertial algorithm weakly con-verges to an optimal solution when the objective function is proper, convex, and lower semicontinuous. These results align with those in the continuous setting.
Linear equality constrained optimization problem, convergence rates, damped inertial dynamics, iterates convergence, numerical algorithm, proximal method
1055-6788
977-1013
Ding, Ke-wei
08722053-bbf0-4c1a-ae43-42c8a59888d2
Liu, Lingling
ce1c9309-f05d-4a9f-9482-d3c253188890
Vuong, Phan Tu
52577e5d-ebe9-4a43-b5e7-68aa06cfdcaf
Ding, Ke-wei
08722053-bbf0-4c1a-ae43-42c8a59888d2
Liu, Lingling
ce1c9309-f05d-4a9f-9482-d3c253188890
Vuong, Phan Tu
52577e5d-ebe9-4a43-b5e7-68aa06cfdcaf

Ding, Ke-wei, Liu, Lingling and Vuong, Phan Tu (2025) Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem. Optimization Methods and Software, 40 (4), 977-1013. (doi:10.1080/10556788.2025.2517174).

Record type: Article

Abstract

The O(1/t2) convergence rate of second-order dynamical systems with asymptotic vanishing viscous damping is faster than the O(1/t) rate of systems with fixed viscous damping in unconstrained and linear equality constrained optimization problems. We explore whether the performance of systems with vanishing viscous damping remains superior when both use time scaling. We compare the best polynomial convergence rates of vanishing damping systems with the best exponential convergence rates of a fixed damping system with time scaling for linear equality constrained problems. We prove that the primal-dual trajectory weakly converges to an optimal solution. Additionally, we present an inertial algorithm derived from the implicit discretization of the dynamical system, establishing exponential convergence rates for the primal-dual gap, feasibility measure, and objective value without assuming strong convexity. The sequence of iterates generated by the inertial algorithm weakly con-verges to an optimal solution when the objective function is proper, convex, and lower semicontinuous. These results align with those in the continuous setting.

Text
Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem - Version of Record
Available under License Creative Commons Attribution.
Download (3MB)

More information

Accepted/In Press date: 2 June 2025
e-pub ahead of print date: 20 June 2025
Published date: 20 June 2025
Keywords: Linear equality constrained optimization problem, convergence rates, damped inertial dynamics, iterates convergence, numerical algorithm, proximal method

Identifiers

Local EPrints ID: 504450
URI: http://eprints.soton.ac.uk/id/eprint/504450
ISSN: 1055-6788
PURE UUID: 40f71a81-dd70-4054-a5ba-29c3f2f57386
ORCID for Phan Tu Vuong: ORCID iD orcid.org/0000-0002-1474-994X

Catalogue record

Date deposited: 09 Sep 2025 18:45
Last modified: 16 Sep 2025 02:15

Export record

Altmetrics

Contributors

Author: Ke-wei Ding
Author: Lingling Liu
Author: Phan Tu Vuong ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×