Construction of tunable radial basis function networks using orthogonal forward selection

Download

PDF (manuscript) - Published Version Download (334Kb)

Description/Abstract

An orthogonal forward selection (OFS) algorithm based on leave-one-out (LOO) criteria is proposed for the construction of radial basis function (RBF) networks with tunable nodes. Each stage of the construction process determines a RBF node, namely its centre vector and diagonal covariance matrix, by minimising the LOO statistics. For regression application, the LOO criterion is chosen to be the LOO mean square error, while the LOO misclassification rate is adopted in two-class classification application. This OFS-LOO algorithm is computationally efficient and it is capable of constructing parsimonious RBF networks that generalise well. Moreover, the proposed algorithm is fully automatic and the user does not need to specify a termination criterion for the construction process. The effectiveness of the proposed RBF network construction procedure is demonstrated using examples taken from both regression and classification applications.