The University of Southampton
University of Southampton Institutional Repository

A fast separability-based feature selection method for high-dimensional remotely-sensed image classification

A fast separability-based feature selection method for high-dimensional remotely-sensed image classification
A fast separability-based feature selection method for high-dimensional remotely-sensed image classification
Because of the difficulty of obtaining an analytic expression for Bayes error, a wide variety of separability measures has been proposed for feature selection. In this paper, we show that there is a general framework based on the criterion of mutual information (MI) that can provide a realistic solution to the problem of feature selection for high-dimensional data. We give a theoretical argument showing that the MI of multi-dimensional data can be broken down into several one-dimensional components, which makes numerical evaluation much easier and more accurate. It also reveals that selection based on the simple criterion of only retaining features with high associated MI values may be problematic when the features are highly correlated. Although there is a direct way of selecting features by jointly maximising MI, this suffers from combinatorial explosion. Hence, we propose a fast feature-selection scheme based on a ‘greedy’ optimisation strategy. To confirm the effectiveness of this scheme, simulations are carried out on 16 land-cover classes using the 92AV3C data set collected from the 220-dimensional AVIRIS hyperspectral sensor. We replicate our earlier positive results (which used an essentially heuristic method for MI-based band-selection) but with much reduced computational cost and a much sounder theoretical basis
0031-3203
1670-1679
Guo, B.
6c4581ac-e3e3-4002-992a-3abb7776ec5d
Damper, R. I.
6e0e7fdc-57ec-44d4-bc0f-029d17ba441d
Gunn, S. R.
306af9b3-a7fa-4381-baf9-5d6a6ec89868
Nelson, J. D. B.
3bef57a7-4c0e-4501-bea7-0e528bcd64a2
Guo, B.
6c4581ac-e3e3-4002-992a-3abb7776ec5d
Damper, R. I.
6e0e7fdc-57ec-44d4-bc0f-029d17ba441d
Gunn, S. R.
306af9b3-a7fa-4381-baf9-5d6a6ec89868
Nelson, J. D. B.
3bef57a7-4c0e-4501-bea7-0e528bcd64a2

Guo, B., Damper, R. I., Gunn, S. R. and Nelson, J. D. B. (2008) A fast separability-based feature selection method for high-dimensional remotely-sensed image classification. Pattern Recognition, 41 (5), 1670-1679. (doi:10.1016/j.patcog.2007.11.007).

Record type: Article

Abstract

Because of the difficulty of obtaining an analytic expression for Bayes error, a wide variety of separability measures has been proposed for feature selection. In this paper, we show that there is a general framework based on the criterion of mutual information (MI) that can provide a realistic solution to the problem of feature selection for high-dimensional data. We give a theoretical argument showing that the MI of multi-dimensional data can be broken down into several one-dimensional components, which makes numerical evaluation much easier and more accurate. It also reveals that selection based on the simple criterion of only retaining features with high associated MI values may be problematic when the features are highly correlated. Although there is a direct way of selecting features by jointly maximising MI, this suffers from combinatorial explosion. Hence, we propose a fast feature-selection scheme based on a ‘greedy’ optimisation strategy. To confirm the effectiveness of this scheme, simulations are carried out on 16 land-cover classes using the 92AV3C data set collected from the 220-dimensional AVIRIS hyperspectral sensor. We replicate our earlier positive results (which used an essentially heuristic method for MI-based band-selection) but with much reduced computational cost and a much sounder theoretical basis

Other
paper.ps - Other
Download (3MB)

More information

Published date: May 2008
Organisations: Electronic & Software Systems, Southampton Wireless Group

Identifiers

Local EPrints ID: 264760
URI: http://eprints.soton.ac.uk/id/eprint/264760
ISSN: 0031-3203
PURE UUID: 019280f0-6317-4166-8c27-da8478d138d9

Catalogue record

Date deposited: 30 Oct 2007
Last modified: 14 Mar 2024 07:55

Export record

Altmetrics

Contributors

Author: B. Guo
Author: R. I. Damper
Author: S. R. Gunn
Author: J. D. B. Nelson

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×