The University of Southampton
University of Southampton Institutional Repository

Model selection approaches for nonlinear system identification: a review

Model selection approaches for nonlinear system identification: a review
Model selection approaches for nonlinear system identification: a review
The identification of non-linear systems using only observed finite datasets has become a mature research area over the last two decades. A class of linear-in-the-parameter models with universal approximation capabilities have been intensively studied and widely used due to the availability of many linear-learning algorithms and their inherent convergence conditions. This article presents a systematic overview of basic research on model selection approaches for linear-in-the-parameter models. One of the fundamental problems in non-linear system identification is to find the minimal model with the best model generalisation performance from observational data only. The important concepts in achieving good model generalisation used in various non-linear system-identification algorithms are first reviewed, including Bayesian parameter regularisation and models selective criteria based on the cross validation and experimental design. A significant advance in machine learning has been the development of the support vector machine as a means for identifying kernel models based on the structural risk minimisation principle. The developments on the convex optimisation-based model construction algorithms including the support vector regression algorithms are outlined. Input selection algorithms and on-line system identification algorithms are also included in this review. Finally, some industrial applications of non-linear models are discussed.
0020-7721
925-946
Hong, Xia
e6551bb3-fbc0-4990-935e-43b706d8c679
Mitchell, R.J.
855bd87b-731d-4c93-8540-75b2bc011dde
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Harris, Chris J.
c4fd3763-7b3f-4db1-9ca3-5501080f797a
Li, K.
4809288e-d156-4c91-868a-b47d11787b74
Irwin, G.W.
069f851d-a979-409e-8eb7-b8735fe9e91d
Hong, Xia
e6551bb3-fbc0-4990-935e-43b706d8c679
Mitchell, R.J.
855bd87b-731d-4c93-8540-75b2bc011dde
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Harris, Chris J.
c4fd3763-7b3f-4db1-9ca3-5501080f797a
Li, K.
4809288e-d156-4c91-868a-b47d11787b74
Irwin, G.W.
069f851d-a979-409e-8eb7-b8735fe9e91d

Hong, Xia, Mitchell, R.J., Chen, Sheng, Harris, Chris J., Li, K. and Irwin, G.W. (2008) Model selection approaches for nonlinear system identification: a review. International Journal of Systems Science, 39 (10), 925-946.

Record type: Article

Abstract

The identification of non-linear systems using only observed finite datasets has become a mature research area over the last two decades. A class of linear-in-the-parameter models with universal approximation capabilities have been intensively studied and widely used due to the availability of many linear-learning algorithms and their inherent convergence conditions. This article presents a systematic overview of basic research on model selection approaches for linear-in-the-parameter models. One of the fundamental problems in non-linear system identification is to find the minimal model with the best model generalisation performance from observational data only. The important concepts in achieving good model generalisation used in various non-linear system-identification algorithms are first reviewed, including Bayesian parameter regularisation and models selective criteria based on the cross validation and experimental design. A significant advance in machine learning has been the development of the support vector machine as a means for identifying kernel models based on the structural risk minimisation principle. The developments on the convex optimisation-based model construction algorithms including the support vector regression algorithms are outlined. Input selection algorithms and on-line system identification algorithms are also included in this review. Finally, some industrial applications of non-linear models are discussed.

Text
xh08-IJSS.pdf - Version of Record
Download (281kB)
Text
SKMBT_C35310071309050.pdf - Other
Download (593kB)

More information

Published date: October 2008
Organisations: Southampton Wireless Group

Identifiers

Local EPrints ID: 266152
URI: http://eprints.soton.ac.uk/id/eprint/266152
ISSN: 0020-7721
PURE UUID: c93b06dd-679c-48ce-8c9d-4f15ef8e3829

Catalogue record

Date deposited: 17 Jul 2008 16:51
Last modified: 14 Mar 2024 08:21

Export record

Contributors

Author: Xia Hong
Author: R.J. Mitchell
Author: Sheng Chen
Author: Chris J. Harris
Author: K. Li
Author: G.W. Irwin

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×