The University of Southampton
University of Southampton Institutional Repository

Fast adaptive gradient RBF networks for online learning of nonstationary time series

Fast adaptive gradient RBF networks for online learning of nonstationary time series
Fast adaptive gradient RBF networks for online learning of nonstationary time series
For a learning model to be effective in online modeling of nonstationary data, it must not only be equipped with high adaptability to track the changing data dynamics but also maintain low complexity to meet online computational restrictions. Based on these two important principles, in this paper, we propose a fast adaptive gradient radial basis function (GRBF) network for nonlinear and nonstationary time series prediction. Specifically, an initial compact GRBF model is constructed on the training data using the orthogonal least squares algorithm, which is capable of modeling variations of local mean and trend in the signal well. During the online operation, when the current model does not perform well, the worst performing GRBF node is replaced by a new node, whose structure is optimized to fit the current data. Owing to the local one-step predictor property of GRBF node, this adaptive node replacement can be done very efficiently. Experiments involving two chaotic time series and two real-world signals are used to demonstrate the superior online prediction performance of the proposed fast adaptive GRBF algorithm over a range of benchmark schemes, in terms of prediction accuracy and real-time computational complexity.
Nonlinear and nonstationary signals, adaptive algorithm, gradient RBF network, prediction, radial basis function (RBF) network, tunable nodes
1053-587X
2015-2030
Liu, Tong
f344313b-ab83-4a11-ae90-13c2b2f47564
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Liang, Shan
d3ff1c77-4e78-452b-911f-2ef7af733354
Gan, Shaojun
458954ae-151d-4355-a677-3470632569f7
Harris, Chris J.
b9a8ebd4-82a7-421f-9a68-4abf18938a62
Liu, Tong
f344313b-ab83-4a11-ae90-13c2b2f47564
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Liang, Shan
d3ff1c77-4e78-452b-911f-2ef7af733354
Gan, Shaojun
458954ae-151d-4355-a677-3470632569f7
Harris, Chris J.
b9a8ebd4-82a7-421f-9a68-4abf18938a62

Liu, Tong, Chen, Sheng, Liang, Shan, Gan, Shaojun and Harris, Chris J. (2020) Fast adaptive gradient RBF networks for online learning of nonstationary time series. IEEE Transactions on Signal Processing, 68 (1), 2015-2030, [9040439]. (doi:10.1109/TSP.2020.2981197).

Record type: Article

Abstract

For a learning model to be effective in online modeling of nonstationary data, it must not only be equipped with high adaptability to track the changing data dynamics but also maintain low complexity to meet online computational restrictions. Based on these two important principles, in this paper, we propose a fast adaptive gradient radial basis function (GRBF) network for nonlinear and nonstationary time series prediction. Specifically, an initial compact GRBF model is constructed on the training data using the orthogonal least squares algorithm, which is capable of modeling variations of local mean and trend in the signal well. During the online operation, when the current model does not perform well, the worst performing GRBF node is replaced by a new node, whose structure is optimized to fit the current data. Owing to the local one-step predictor property of GRBF node, this adaptive node replacement can be done very efficiently. Experiments involving two chaotic time series and two real-world signals are used to demonstrate the superior online prediction performance of the proposed fast adaptive GRBF algorithm over a range of benchmark schemes, in terms of prediction accuracy and real-time computational complexity.

Text
TRBF_TSP1 - Accepted Manuscript
Download (4MB)
Text
TVT2020-Apr
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 11 March 2020
e-pub ahead of print date: 18 March 2020
Published date: 10 April 2020
Additional Information: Funding Information: Manuscript received August 15, 2019; revised February 4, 2020; accepted March 11, 2020. Date of publication March 18, 2020; date of current version April 10, 2020. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Mark A. Davenport. This work was supported in part by the National Natural Science Foundation of China under Grant 61771077, and in part by the Key Research Program of Chongqing Science & Technology Commission under Grant CSTC2017jcyjBX0025. The work of T. Liu was supported by the Chinese Scholarship Council and School of Electronics and Computer Science, University of Southampton, UK. (Corresponding author: Sheng Chen.) Tong Liu and Shan Liang are with the Key Laboratory of Dependable Service Computing in Cyber Physical Society, Ministry of Education, Chongqing University, School of Automation, Chongqing University, Chongqing 400044, China (e-mail: tl3n18@soton.ac.uk; lightsun@cqu.edu.cn). Publisher Copyright: © 2020 IEEE.
Keywords: Nonlinear and nonstationary signals, adaptive algorithm, gradient RBF network, prediction, radial basis function (RBF) network, tunable nodes

Identifiers

Local EPrints ID: 438826
URI: http://eprints.soton.ac.uk/id/eprint/438826
ISSN: 1053-587X
PURE UUID: 6f9d8efd-757d-4968-87d3-808d907b83fe

Catalogue record

Date deposited: 25 Mar 2020 17:30
Last modified: 16 Mar 2024 07:06

Export record

Altmetrics

Contributors

Author: Tong Liu
Author: Sheng Chen
Author: Shan Liang
Author: Shaojun Gan
Author: Chris J. Harris

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×