Stability analysis of gradient-based neural networks for optimization problems
Han, Qiaoming, Liao, Li-Zhi, Qi, Houduo and Qi, Liqun (2001) Stability analysis of gradient-based neural networks for optimization problems. Journal of Global Optimization, 19, (4), 363-381. (doi:10.1023/A:1011245911067).
Download
Full text not available from this repository.
Description/Abstract
The paper introduces a new approach to analyze the stability of neural network models without using any Lyapunov function. With the new approach, we investigate the stability properties of the general gradient-based neural network model for optimization problems. Our discussion includes both isolated equilibrium points and connected equilibrium sets which could be unbounded. For a general optimization problem, if the objective function is bounded below and its gradient is Lipschitz continuous, we prove that (a) any trajectory of the gradient-based neural network converges to an equilibrium point, and (b) the Lyapunov stability is equivalent to the asymptotical stability in the gradient-based neural networks. For a convex optimization problem, under the same assumptions, we show that any trajectory of gradient-based neural networks will converge to an asymptotically stable equilibrium point of the neural networks. For a general nonlinear objective function, we propose a refined gradient-based neural network, whose trajectory with any arbitrary initial point will converge to an equilibrium point, which satisfies the second order necessary optimality conditions for optimization problems. Promising simulation results of a refined gradient-based neural network on some problems are also reported.
| Item Type: | Article |
|---|---|
| ISSNs: | 0925-5001 (print) |
| Related URLs: | |
| Keywords: | gradient-based neural network, equilibrium point, equilibrium set, asymptotic stability, exponential stability |
| Subjects: | Q Science > QA Mathematics |
| Divisions: | University Structure - Pre August 2011 > School of Mathematics > Operational Research |
| Item ID: | 29636 |
| Date Deposited: | 11 May 2006 |
| Last Modified: | 01 Jun 2011 06:35 |
| Contributors: | Han, Qiaoming (Author) Liao, Li-Zhi (Author) Qi, Houduo (Author) Qi, Liqun (Author) |
| Date: | 2001 |
| Status: | Published |
| Contact Email Address: | liliao@hkbu.edu.hk |
| URI: | http://eprints.soton.ac.uk/id/eprint/29636 |
Actions (login required)
 |
View Item |
