Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem
Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem
The O(1/t2) convergence rate of second-order dynamical systems with asymptotic vanishing viscous damping is faster than the O(1/t) rate of systems with fixed viscous damping in unconstrained and linear equality constrained optimization problems. We explore whether the performance of systems with vanishing viscous damping remains superior when both use time scaling. We compare the best polynomial convergence rates of vanishing damping systems with the best exponential convergence rates of a fixed damping system with time scaling for linear equality constrained problems. We prove that the primal-dual trajectory weakly converges to an optimal solution. Additionally, we present an inertial algorithm derived from the implicit discretization of the dynamical system, establishing exponential convergence rates for the primal-dual gap, feasibility measure, and objective value without assuming strong convexity. The sequence of iterates generated by the inertial algorithm weakly con-verges to an optimal solution when the objective function is proper, convex, and lower semicontinuous. These results align with those in the continuous setting.
Linear equality constrained optimization problem, convergence rates, damped inertial dynamics, iterates convergence, numerical algorithm, proximal method
977-1013
Ding, Ke-wei
08722053-bbf0-4c1a-ae43-42c8a59888d2
Liu, Lingling
ce1c9309-f05d-4a9f-9482-d3c253188890
Vuong, Phan Tu
52577e5d-ebe9-4a43-b5e7-68aa06cfdcaf
20 June 2025
Ding, Ke-wei
08722053-bbf0-4c1a-ae43-42c8a59888d2
Liu, Lingling
ce1c9309-f05d-4a9f-9482-d3c253188890
Vuong, Phan Tu
52577e5d-ebe9-4a43-b5e7-68aa06cfdcaf
Ding, Ke-wei, Liu, Lingling and Vuong, Phan Tu
(2025)
Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem.
Optimization Methods and Software, 40 (4), .
(doi:10.1080/10556788.2025.2517174).
Abstract
The O(1/t2) convergence rate of second-order dynamical systems with asymptotic vanishing viscous damping is faster than the O(1/t) rate of systems with fixed viscous damping in unconstrained and linear equality constrained optimization problems. We explore whether the performance of systems with vanishing viscous damping remains superior when both use time scaling. We compare the best polynomial convergence rates of vanishing damping systems with the best exponential convergence rates of a fixed damping system with time scaling for linear equality constrained problems. We prove that the primal-dual trajectory weakly converges to an optimal solution. Additionally, we present an inertial algorithm derived from the implicit discretization of the dynamical system, establishing exponential convergence rates for the primal-dual gap, feasibility measure, and objective value without assuming strong convexity. The sequence of iterates generated by the inertial algorithm weakly con-verges to an optimal solution when the objective function is proper, convex, and lower semicontinuous. These results align with those in the continuous setting.
Text
Exponential convergence rates of a second-order dynamic system and algorithm for a linear equality constrained optimization problem
- Version of Record
More information
Accepted/In Press date: 2 June 2025
e-pub ahead of print date: 20 June 2025
Published date: 20 June 2025
Keywords:
Linear equality constrained optimization problem, convergence rates, damped inertial dynamics, iterates convergence, numerical algorithm, proximal method
Identifiers
Local EPrints ID: 504450
URI: http://eprints.soton.ac.uk/id/eprint/504450
ISSN: 1055-6788
PURE UUID: 40f71a81-dd70-4054-a5ba-29c3f2f57386
Catalogue record
Date deposited: 09 Sep 2025 18:45
Last modified: 16 Sep 2025 02:15
Export record
Altmetrics
Contributors
Author:
Ke-wei Ding
Author:
Lingling Liu
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics