The University of Southampton
University of Southampton Institutional Repository

Orthogonal least squares algorithm for training multi-output radial basis function networks

Orthogonal least squares algorithm for training multi-output radial basis function networks
Orthogonal least squares algorithm for training multi-output radial basis function networks
The radial basis function (RBF) network offers a viable alternative to the two-layer neural network in many signal processing applications. A novel learning algorithm for RBF networks (S. Chen et al., 1990, 1991) has been derived based on the orthogonal least squares (OLS) method operating in a forward regression manner (Chen et al., 1989). This is a rational way to choose RBF centres from data points because each selected centre maximizes the increment to the explained variance of the desired output and the algorithm does not suffer numerical ill-conditioning problems. This learning algorithm was originally derived for RBF networks with a scalar output. The present study extends this previous result to multi-output RBF networks. The basic idea is to use the trace of the desired output covariance as the selection criterion instead of the original variance in the single-output case. Reconstruction of PAM signals and nonlinear system modelling are used as two examples to demonstrate the effectiveness of this learning algorithm.
336-339
Institution of Engineering and Technology
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Grant, P.M.
eedba4d3-5e35-446b-bf5d-34dc76cff3b8
Cowan, C.F.N.
d1dce4b7-a715-4ada-beb5-ea9e732f930a
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Grant, P.M.
eedba4d3-5e35-446b-bf5d-34dc76cff3b8
Cowan, C.F.N.
d1dce4b7-a715-4ada-beb5-ea9e732f930a

Chen, Sheng, Grant, P.M. and Cowan, C.F.N. (1991) Orthogonal least squares algorithm for training multi-output radial basis function networks. In IEE Second International Conference on Artificial Neural Networks. Institution of Engineering and Technology. pp. 336-339 .

Record type: Conference or Workshop Item (Paper)

Abstract

The radial basis function (RBF) network offers a viable alternative to the two-layer neural network in many signal processing applications. A novel learning algorithm for RBF networks (S. Chen et al., 1990, 1991) has been derived based on the orthogonal least squares (OLS) method operating in a forward regression manner (Chen et al., 1989). This is a rational way to choose RBF centres from data points because each selected centre maximizes the increment to the explained variance of the desired output and the algorithm does not suffer numerical ill-conditioning problems. This learning algorithm was originally derived for RBF networks with a scalar output. The present study extends this previous result to multi-output RBF networks. The basic idea is to use the trace of the desired output covariance as the selection criterion instead of the original variance in the single-output case. Reconstruction of PAM signals and nonlinear system modelling are used as two examples to demonstrate the effectiveness of this learning algorithm.

Text
c-icann1991 - Author's Original
Download (240kB)

More information

Published date: 18 November 1991

Identifiers

Local EPrints ID: 454881
URI: http://eprints.soton.ac.uk/id/eprint/454881
PURE UUID: e623475a-bfa8-45a0-b3c1-edf107e4a26c

Catalogue record

Date deposited: 01 Mar 2022 17:32
Last modified: 09 Jun 2022 17:32

Export record

Contributors

Author: Sheng Chen
Author: P.M. Grant
Author: C.F.N. Cowan

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×