Sparse Feature Extraction using Generalised Partial Least Squares

Dhanjal, Charanpal, Gunn, Steve R. and Shawe-Taylor, John (2006) Sparse Feature Extraction using Generalised Partial Least Squares. IEEE International Workshop on Machine Learning for Signal Processing, Maynooth, Ireland. pp. 27-32 .

Abstract

We describe a general framework for feature extraction based on the deflation scheme used in Partial Least Squares (PLS). The framework provides many desirable properties, such as conjugacy and efficient computation of the resulting features. When the projection vectors are constrained in a certain way, the resulting features have dual representations. Using the framework, we derive two new sparse feature extraction algorithms, Sparse Maximal Covariance (SMC) and Sparse Maximal Alignment (SMA). These algorithms produce features which are competitive with those extracted by Kernel Boosting, Boosted Latent Features (BLF) and sparse kernel PLS on several UCI datasets. Furthermore, the sparse algorithms are shown to improve the performance of an SVM on a sample of the Reuters Corpus Volume 1 dataset.

This record has no associated files available for download.

Contributors

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

Loading...

View more statistics