The University of Southampton
University of Southampton Institutional Repository

The Effect of Hebbian Learning on Optimisation in Hopfield Networks

Watson, Richard A., Buckley, C. L. and Mills, Rob (2009) The Effect of Hebbian Learning on Optimisation in Hopfield Networks s.n.

Record type: Monograph (Project Report)

Abstract

In neural networks, two specific dynamical behaviours are well known: 1) Networks naturally find patterns of activation that locally minimise constraints among interactions. This can be understood as the local minimisation of an energy or potential function, or the optimisation of an objective function. 2) In distinct scenarios, Hebbian learning can create new interactions that form associative memories of activation patterns. In this paper we show that these two behaviours have a surprising interaction – that learning of this type significantly improves the ability of a neural network to find configurations that satisfy constraints/perform effective optimisation. Specifically, the network develops a memory of the attractors that it has visited, but importantly, is able to generalise over previously visited attractors to increase the basin of attraction of superior attractors before they are visited. The network is ultimately transformed into a different network that has only one basin of attraction, but this attractor corresponds to a configuration that is very low energy in the original network. The new network thus finds optimised configurations that were unattainable (had exponentially small basins of attraction) in the original network dynamics.

PDF TR_watson-buckley-mills-2009.pdf - Other
Download (364kB)
PDF TR_watson-buckley-mills-2009b.pdf - Other
Download (365kB)

More information

Accepted/In Press date: 10 June 2009
Organisations: Agents, Interactions & Complexity, EEE

Identifiers

Local EPrints ID: 267543
URI: http://eprints.soton.ac.uk/id/eprint/267543
PURE UUID: e9da08f8-0fe4-4dbb-95b7-6cd613df9fd3

Catalogue record

Date deposited: 09 Jun 2009 22:19
Last modified: 18 Jul 2017 07:02

Export record

Contributors

Author: C. L. Buckley
Author: Rob Mills

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×