A forward-constrained regression algorithm for sparse kernel density estimation

Hong, Xia, Chen, Sheng and Harris, Chris J. (2008) A forward-constrained regression algorithm for sparse kernel density estimation. IEEE Transactions on Neural Networks, 19 (1), 193-198. (doi:10.1109/TNN.2007.908645).

Record type: Article

Abstract

Using the classical Parzen window (PW) estimate as the target function, the sparse kernel density estimator is constructed in a forward-constrained regression (FCR) manner. The proposed algorithm selects significant kernels one at a time, while the leave-one-out (LOO) test score is minimized subject to a simple positivity constraint in each forward stage. The model parameter estimation in each forward stage is simply the solution of jackknife parameter estimator for a single parameter, subject to the same positivity constraint check. For each selected kernels, the associated kernel width is updated via the Gauss–Newton method with the model parameter estimate fixed. The proposed approach is simple to implement and the associated computational cost is very low. Numerical examples are employed to demonstrate the efficacy of the proposed approach.

Text

TNN2008-19-1 - Version of Record

Restricted to Repository staff only

Available under License University of Southampton Accepted Manuscript Licence.

Request a copy

Text

04378278.pdf - Other

Restricted to Repository staff only

Request a copy