Lurie networks with k-contracting dynamics
Lurie networks with k-contracting dynamics
This paper proposes an approach to enable the weights and biases of a novel neural ODE, the Lurie network, to be trained in such a manner that a generalised concept of stability is guaranteed. This generalised stability measure is derived through the use of k-contraction analysis, which guarantees global convergence to a point, line or plane in the neural state-space. An unconstrained parametrisation of this condition is derived, allowing models to be trained using standard optimisation algorithms, whilst limiting the search space to solutions satisfying the k-contraction constraint. The novel stability result and parametrisation provide a toolset for training over the space of Lurie network's which exhibit the convergent behaviours observed during neural computation in the brain. For example, global convergence to one of multiple equilibrium points or limit cycles are properties observed in associative and working memory.
Richardson, Carl R.
3406b6af-f00d-410b-8051-a0ecc27baba5
Turner, Matthew C.
6befa01e-0045-4806-9c91-a107c53acba0
Gunn, Steve R.
306af9b3-a7fa-4381-baf9-5d6a6ec89868
5 March 2025
Richardson, Carl R.
3406b6af-f00d-410b-8051-a0ecc27baba5
Turner, Matthew C.
6befa01e-0045-4806-9c91-a107c53acba0
Gunn, Steve R.
306af9b3-a7fa-4381-baf9-5d6a6ec89868
Richardson, Carl R., Turner, Matthew C. and Gunn, Steve R.
(2025)
Lurie networks with k-contracting dynamics.
The Thirteenth International Conference on Learning Representations, , Singapore, Singapore.
24 - 28 Apr 2025.
5 pp
.
Record type:
Conference or Workshop Item
(Paper)
Abstract
This paper proposes an approach to enable the weights and biases of a novel neural ODE, the Lurie network, to be trained in such a manner that a generalised concept of stability is guaranteed. This generalised stability measure is derived through the use of k-contraction analysis, which guarantees global convergence to a point, line or plane in the neural state-space. An unconstrained parametrisation of this condition is derived, allowing models to be trained using standard optimisation algorithms, whilst limiting the search space to solutions satisfying the k-contraction constraint. The novel stability result and parametrisation provide a toolset for training over the space of Lurie network's which exhibit the convergent behaviours observed during neural computation in the brain. For example, global convergence to one of multiple equilibrium points or limit cycles are properties observed in associative and working memory.
Text
16_Lurie_networks_with_k_contr
- Version of Record
More information
Published date: 5 March 2025
Venue - Dates:
The Thirteenth International Conference on Learning Representations, , Singapore, Singapore, 2025-04-24 - 2025-04-28
Identifiers
Local EPrints ID: 502871
URI: http://eprints.soton.ac.uk/id/eprint/502871
PURE UUID: 439b9a5b-a2b0-490b-b0d3-faaeae3ad5a8
Catalogue record
Date deposited: 10 Jul 2025 17:18
Last modified: 22 Aug 2025 02:33
Export record
Contributors
Author:
Carl R. Richardson
Author:
Matthew C. Turner
Author:
Steve R. Gunn
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics