The University of Southampton
University of Southampton Institutional Repository

A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization

A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization
A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization

In this paper, we revisit the classical problem of solving over-determined systems of nonsmooth equations numerically. We suggest a nonsmooth Levenberg–Marquardt method for its solution which, in contrast to the existing literature, does not require local Lipschitzness of the data functions. This is possible when using Newton-differentiability instead of semismoothness as the underlying tool of generalized differentiation. Conditions for local fast convergence of the method are given. Afterwards, in the context of over-determined mixed nonlinear complementarity systems, our findings are applied, and globalized solution methods, based on a residual induced by the maximum and the Fischer–Burmeister function, respectively, are constructed. The assumptions for local fast convergence are worked out and compared. Finally, these methods are applied for the numerical solution of bilevel optimization problems. We recall the derivation of a stationarity condition taking the shape of an over-determined mixed nonlinear complementarity system involving a penalty parameter, formulate assumptions for local fast convergence of our solution methods explicitly, and present results of numerical experiments. Particularly, we investigate whether the treatment of the appearing penalty parameter as an additional variable is beneficial or not.

Bilevel optimization, mixed nonlinear complementarity problems, Newton-differentiability, nonsmooth Levenberg–Marquardt methods
0233-1934
Jolaoso, Lateef O.
102467df-eae0-4692-8668-7f73e8e02546
Mehlitz, Patrick
eecbbf4c-dc3f-44d5-b448-3053f23874f4
Zemkoho, Alain B.
30c79e30-9879-48bd-8d0b-e2fbbc01269e
Jolaoso, Lateef O.
102467df-eae0-4692-8668-7f73e8e02546
Mehlitz, Patrick
eecbbf4c-dc3f-44d5-b448-3053f23874f4
Zemkoho, Alain B.
30c79e30-9879-48bd-8d0b-e2fbbc01269e

Jolaoso, Lateef O., Mehlitz, Patrick and Zemkoho, Alain B. (2024) A fresh look at nonsmooth Levenberg–Marquardt methods with applications to bilevel optimization. Optimization. (doi:10.1080/02331934.2024.2313688).

Record type: Article

Abstract

In this paper, we revisit the classical problem of solving over-determined systems of nonsmooth equations numerically. We suggest a nonsmooth Levenberg–Marquardt method for its solution which, in contrast to the existing literature, does not require local Lipschitzness of the data functions. This is possible when using Newton-differentiability instead of semismoothness as the underlying tool of generalized differentiation. Conditions for local fast convergence of the method are given. Afterwards, in the context of over-determined mixed nonlinear complementarity systems, our findings are applied, and globalized solution methods, based on a residual induced by the maximum and the Fischer–Burmeister function, respectively, are constructed. The assumptions for local fast convergence are worked out and compared. Finally, these methods are applied for the numerical solution of bilevel optimization problems. We recall the derivation of a stationarity condition taking the shape of an over-determined mixed nonlinear complementarity system involving a penalty parameter, formulate assumptions for local fast convergence of our solution methods explicitly, and present results of numerical experiments. Particularly, we investigate whether the treatment of the appearing penalty parameter as an additional variable is beneficial or not.

Text
A fresh look at nonsmooth Levenberg Marquardt methods with applications to bilevel optimization - Version of Record
Download (4MB)

More information

Accepted/In Press date: 29 January 2024
e-pub ahead of print date: 12 March 2024
Keywords: Bilevel optimization, mixed nonlinear complementarity problems, Newton-differentiability, nonsmooth Levenberg–Marquardt methods

Identifiers

Local EPrints ID: 488935
URI: http://eprints.soton.ac.uk/id/eprint/488935
ISSN: 0233-1934
PURE UUID: 23045554-e224-4480-973f-20485c33030a
ORCID for Lateef O. Jolaoso: ORCID iD orcid.org/0000-0002-4838-7465
ORCID for Alain B. Zemkoho: ORCID iD orcid.org/0000-0003-1265-4178

Catalogue record

Date deposited: 09 Apr 2024 17:04
Last modified: 10 Apr 2024 02:07

Export record

Altmetrics

Contributors

Author: Patrick Mehlitz

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×