The University of Southampton
University of Southampton Institutional Repository

Comparative aspects of neural network algorithms for on-line modelling of dynamic processes

Comparative aspects of neural network algorithms for on-line modelling of dynamic processes
Comparative aspects of neural network algorithms for on-line modelling of dynamic processes
This paper reviews the model structures and learning rules of four commonly used artificial neural networks: the Cerebellar Model Articulation Controller, B-Splines, Radial Basis Functions and Multilayered Perceptron networks. Their dynamic modeling abilities are compared using a two-dimensional nonlinear noisy time series. The network performances are evaluated based on their network surface plots, phase/time history plots, learning curves, prediction error autocorrelation functions, and finally their short-range prediction error variances. The modeling results suggest that all four networks were able to capture the underlying dynamics of the time series. Also, specific prior knowledge about the time series was incorporated into the B-Splines model, and is used to highlight an important trade-off between the model flexibility and high-dimensional modeling ability in the B-Splines and CMAC networks. In general, when the network model is well-conditioned and linear with respect to its adaptable parameters, simpler on-line learning rules often provide adequate convergence properties. Alternatively, when the model is highly nonlinear, complicated learning rules which utilize high-order gradient information are generally required at the expense of increased computational complexity.
223-241
An, P.E.
5dc94657-d009-4d13-9a0f-6645a9d296d9
Brown, M.
52cf4f52-6839-4658-8cc5-ec51da626049
Harris, C.J.
c4fd3763-7b3f-4db1-9ca3-5501080f797a
Chen, S.
9310a111-f79a-48b8-98c7-383ca93cbb80
An, P.E.
5dc94657-d009-4d13-9a0f-6645a9d296d9
Brown, M.
52cf4f52-6839-4658-8cc5-ec51da626049
Harris, C.J.
c4fd3763-7b3f-4db1-9ca3-5501080f797a
Chen, S.
9310a111-f79a-48b8-98c7-383ca93cbb80

An, P.E., Brown, M., Harris, C.J. and Chen, S. (1993) Comparative aspects of neural network algorithms for on-line modelling of dynamic processes. Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, 207 (4), 223-241. (doi:10.1243/PIME_PROC_1993_207_345_02).

Record type: Article

Abstract

This paper reviews the model structures and learning rules of four commonly used artificial neural networks: the Cerebellar Model Articulation Controller, B-Splines, Radial Basis Functions and Multilayered Perceptron networks. Their dynamic modeling abilities are compared using a two-dimensional nonlinear noisy time series. The network performances are evaluated based on their network surface plots, phase/time history plots, learning curves, prediction error autocorrelation functions, and finally their short-range prediction error variances. The modeling results suggest that all four networks were able to capture the underlying dynamics of the time series. Also, specific prior knowledge about the time series was incorporated into the B-Splines model, and is used to highlight an important trade-off between the model flexibility and high-dimensional modeling ability in the B-Splines and CMAC networks. In general, when the network model is well-conditioned and linear with respect to its adaptable parameters, simpler on-line learning rules often provide adequate convergence properties. Alternatively, when the model is highly nonlinear, complicated learning rules which utilize high-order gradient information are generally required at the expense of increased computational complexity.

Text
j-procime1993 - Author's Original
Download (1MB)

More information

Published date: 1993
Organisations: Southampton Wireless Group

Identifiers

Local EPrints ID: 250206
URI: http://eprints.soton.ac.uk/id/eprint/250206
PURE UUID: 62bf216e-8408-49df-a295-d0bafce03192

Catalogue record

Date deposited: 04 May 1999
Last modified: 14 Mar 2024 04:51

Export record

Altmetrics

Contributors

Author: P.E. An
Author: M. Brown
Author: C.J. Harris
Author: S. Chen

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×