The University of Southampton
University of Southampton Institutional Repository

High Order Instantaneous Learning Algorithms for On-line Training

High Order Instantaneous Learning Algorithms for On-line Training
High Order Instantaneous Learning Algorithms for On-line Training
This paper examines several instantaneous learning rules that have been widely applied in the signal processing, adaptive control, and neurocontrol fields. These instantaneous least mean square adaptive algorithms are derived and their performance is assessed from a variety of viewpoints: instantaneous data storage, rate of parameter convergence, filtering modelling error and the computational cost of implementing the respective schemes. This work is focused on the requirement for on-line learning where the data is generally highly correlated and noisy, and the network must be able to generalise sensibly. It is shown that conventional instantaneous learning rules do not perform well under these conditions as more than one piece of information is required to update the parameter vector. Hence a set of higher order learning rules are proposed to overcome the deficiencies of the standard adaptive rules, and their performance is compared and assessed using two simple, informative examples.
525-529
An, P.E.
5dc94657-d009-4d13-9a0f-6645a9d296d9
Brown, M.
52cf4f52-6839-4658-8cc5-ec51da626049
Mills, D.
74b63f08-96b2-4265-985c-f6073da45fb3
Harris, C.J.
c4fd3763-7b3f-4db1-9ca3-5501080f797a
An, P.E.
5dc94657-d009-4d13-9a0f-6645a9d296d9
Brown, M.
52cf4f52-6839-4658-8cc5-ec51da626049
Mills, D.
74b63f08-96b2-4265-985c-f6073da45fb3
Harris, C.J.
c4fd3763-7b3f-4db1-9ca3-5501080f797a

An, P.E., Brown, M., Mills, D. and Harris, C.J. (1994) High Order Instantaneous Learning Algorithms for On-line Training. Int. Symp. on Signal Processing, Robotics And Neural Networks. pp. 525-529 .

Record type: Conference or Workshop Item (Other)

Abstract

This paper examines several instantaneous learning rules that have been widely applied in the signal processing, adaptive control, and neurocontrol fields. These instantaneous least mean square adaptive algorithms are derived and their performance is assessed from a variety of viewpoints: instantaneous data storage, rate of parameter convergence, filtering modelling error and the computational cost of implementing the respective schemes. This work is focused on the requirement for on-line learning where the data is generally highly correlated and noisy, and the network must be able to generalise sensibly. It is shown that conventional instantaneous learning rules do not perform well under these conditions as more than one piece of information is required to update the parameter vector. Hence a set of higher order learning rules are proposed to overcome the deficiencies of the standard adaptive rules, and their performance is compared and assessed using two simple, informative examples.

This record has no associated files available for download.

More information

Published date: 1994
Additional Information: Organisation: IMACS Address: Lille, France
Venue - Dates: Int. Symp. on Signal Processing, Robotics And Neural Networks, 1994-01-01
Organisations: Southampton Wireless Group

Identifiers

Local EPrints ID: 250211
URI: http://eprints.soton.ac.uk/id/eprint/250211
PURE UUID: 71cb043d-b990-4409-8e91-0f148b980c87

Catalogue record

Date deposited: 04 May 1999
Last modified: 10 Dec 2021 20:07

Export record

Contributors

Author: P.E. An
Author: M. Brown
Author: D. Mills
Author: C.J. Harris

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×