The University of Southampton
University of Southampton Institutional Repository

Regularisation theory applied to neurofuzzy modelling

Regularisation theory applied to neurofuzzy modelling
Regularisation theory applied to neurofuzzy modelling
A desirable property for any empirical model is the ability to generalise well throughout the models input space. Recent work has seen the development of neurofuzzy model construction algorithms which identify neurofuzzy models from available empirical data and expert knowledge. By matching the models structure to the underlying process represented by the data, parsimonious models are produced. Consequent parsimonious models do generalise better but due to the structural symmetry required in these models enforced by the need for model transparency, and the often sparse distribution of real data these models are still prone to poor generalisation. This report reviews and develops regularisation techniques that can be applied to identified neurofuzzy models to aid their ability to generalise. Essentially regularisation places a prior probability distribution on the weight values which consequently constrains the model output. One of the major overheads encountered when performing regularisation is deciding how much regularisation to perform. In this report great attention is given to this problem and techniques such as cross-validation and Bayesian methods are considered. The results of this work favour the Bayesian method, producing models that generalise well for both noisy and sparse training sets. Regularisation produces models that appear to perform sensibly throughout their input space. To give extra information about whether, given an input, the output is inferred from the data or the regulariser, error bars are derived for these models. The described methods are applied to conventional lattice based neurofuzzy models, and also the more parsimonious additive and multiplicative models, giving rise to local regularisation.
Bossley, K.M.
de1a2979-b9e9-481e-af09-0b4887f0f360
Bossley, K.M.
de1a2979-b9e9-481e-af09-0b4887f0f360

Bossley, K.M. (1996) Regularisation theory applied to neurofuzzy modelling

Record type: Monograph (Project Report)

Abstract

A desirable property for any empirical model is the ability to generalise well throughout the models input space. Recent work has seen the development of neurofuzzy model construction algorithms which identify neurofuzzy models from available empirical data and expert knowledge. By matching the models structure to the underlying process represented by the data, parsimonious models are produced. Consequent parsimonious models do generalise better but due to the structural symmetry required in these models enforced by the need for model transparency, and the often sparse distribution of real data these models are still prone to poor generalisation. This report reviews and develops regularisation techniques that can be applied to identified neurofuzzy models to aid their ability to generalise. Essentially regularisation places a prior probability distribution on the weight values which consequently constrains the model output. One of the major overheads encountered when performing regularisation is deciding how much regularisation to perform. In this report great attention is given to this problem and techniques such as cross-validation and Bayesian methods are considered. The results of this work favour the Bayesian method, producing models that generalise well for both noisy and sparse training sets. Regularisation produces models that appear to perform sensibly throughout their input space. To give extra information about whether, given an input, the output is inferred from the data or the regulariser, error bars are derived for these models. The described methods are applied to conventional lattice based neurofuzzy models, and also the more parsimonious additive and multiplicative models, giving rise to local regularisation.

This record has no associated files available for download.

More information

Published date: February 1996
Additional Information: Address: Department of Electronics and Computer Science
Organisations: Electronics & Computer Science

Identifiers

Local EPrints ID: 250121
URI: http://eprints.soton.ac.uk/id/eprint/250121
PURE UUID: e00584ed-425d-47bc-a57b-abfd222a1026

Catalogue record

Date deposited: 04 May 1999
Last modified: 20 Feb 2024 17:51

Export record

Contributors

Author: K.M. Bossley

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×