The University of Southampton
University of Southampton Institutional Repository

A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification

A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification
A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification
The contextual-based convolutional neural network (CNN) with deep architecture and pixel-based multilayer perceptron (MLP) with shallow structure are well-recognized neural network algorithms, representing the state-of-the-art deep learning method and the classical non-parametric machine learning approach, respectively. The two algorithms, which have very different behaviours, were integrated in a concise and effective way using a rule-based decision fusion approach for the classification of very fine spatial resolution (VFSR) remotely sensed imagery. The decision fusion rules, designed primarily based on the classification confidence of the CNN, reflect the generally complementary patterns of the individual classifiers. In consequence, the proposed ensemble classifier MLP-CNN harvests the complementary results acquired from the CNN based on deep spatial feature representation and from the MLP based on spectral discrimination. Meanwhile, limitations of the CNN due to the adoption of convolutional filters such as the uncertainty in object boundary partition and loss of useful fine spatial resolution detail were compensated. The effectiveness of the ensemble MLP-CNN classifier was tested in both urban and rural areas using aerial photography together with an additional satellite sensor dataset. The MLP-CNN classifier achieved promising performance, consistently outperforming the pixel-based MLP, spectral and textural-based MLP, and the contextual-based CNN in terms of classification accuracy. This research paves the way to effectively address the complicated problem of VFSR image classification.
0924-2716
133-144
Zhang, Ce
72e137e7-06c5-483e-bdc7-21629e03bb5b
Pan, Xin
387a1d0d-63a4-432a-a443-0654cfcc9321
Li, Huapeng
9e72ecd5-9964-4038-ab71-9bc7a2fb0510
Gardiner, Andy
7dc7b072-ffa4-47d0-a97f-7586fbaae5ee
Sargent, Isabel
c0ae2d59-039b-45f2-a906-069fe46c6633
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Atkinson, Peter M.
985bc8d3-e826-4e02-8060-8388183eb697
Zhang, Ce
72e137e7-06c5-483e-bdc7-21629e03bb5b
Pan, Xin
387a1d0d-63a4-432a-a443-0654cfcc9321
Li, Huapeng
9e72ecd5-9964-4038-ab71-9bc7a2fb0510
Gardiner, Andy
7dc7b072-ffa4-47d0-a97f-7586fbaae5ee
Sargent, Isabel
c0ae2d59-039b-45f2-a906-069fe46c6633
Hare, Jonathon
65ba2cda-eaaf-4767-a325-cd845504e5a9
Atkinson, Peter M.
985bc8d3-e826-4e02-8060-8388183eb697

Zhang, Ce, Pan, Xin, Li, Huapeng, Gardiner, Andy, Sargent, Isabel, Hare, Jonathon and Atkinson, Peter M. (2018) A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification. ISPRS Journal of Photogrammetry and Remote Sensing, 140, 133-144. (doi:10.1016/j.isprsjprs.2017.07.014).

Record type: Article

Abstract

The contextual-based convolutional neural network (CNN) with deep architecture and pixel-based multilayer perceptron (MLP) with shallow structure are well-recognized neural network algorithms, representing the state-of-the-art deep learning method and the classical non-parametric machine learning approach, respectively. The two algorithms, which have very different behaviours, were integrated in a concise and effective way using a rule-based decision fusion approach for the classification of very fine spatial resolution (VFSR) remotely sensed imagery. The decision fusion rules, designed primarily based on the classification confidence of the CNN, reflect the generally complementary patterns of the individual classifiers. In consequence, the proposed ensemble classifier MLP-CNN harvests the complementary results acquired from the CNN based on deep spatial feature representation and from the MLP based on spectral discrimination. Meanwhile, limitations of the CNN due to the adoption of convolutional filters such as the uncertainty in object boundary partition and loss of useful fine spatial resolution detail were compensated. The effectiveness of the ensemble MLP-CNN classifier was tested in both urban and rural areas using aerial photography together with an additional satellite sensor dataset. The MLP-CNN classifier achieved promising performance, consistently outperforming the pixel-based MLP, spectral and textural-based MLP, and the contextual-based CNN in terms of classification accuracy. This research paves the way to effectively address the complicated problem of VFSR image classification.

Text
Ce_manuscript_accepted_final - Accepted Manuscript
Download (1MB)

More information

Accepted/In Press date: 30 July 2017
e-pub ahead of print date: 2 August 2017
Published date: June 2018

Identifiers

Local EPrints ID: 413316
URI: http://eprints.soton.ac.uk/id/eprint/413316
ISSN: 0924-2716
PURE UUID: fb57d860-b414-4610-b17e-18fb5cb4d6bc
ORCID for Jonathon Hare: ORCID iD orcid.org/0000-0003-2921-4283

Catalogue record

Date deposited: 21 Aug 2017 16:31
Last modified: 16 Mar 2024 05:39

Export record

Altmetrics

Contributors

Author: Ce Zhang
Author: Xin Pan
Author: Huapeng Li
Author: Andy Gardiner
Author: Isabel Sargent
Author: Jonathon Hare ORCID iD
Author: Peter M. Atkinson

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×