A `no panacea theorem' for classifier combination


Hu, R. and Damper, R. I. (2008) A `no panacea theorem' for classifier combination. Pattern Recognition, 41, (8), 2665-2673. (doi:10.1016/j.patcog.2008.01.022).

Download

[img] PDF
Download (2101Kb)

Description/Abstract

We introduce the ‘No Panacea Theorem’ (NPT) for multiple classifier combination, previously proved only in the case of two classifiers and two classes. In this paper, we extend the NPT to cases of multiple classifiers and multiple classes. We prove that if the combination function is continuous and diverse, there exists a situation in which the combination algorithm will give very bad performance. The proof relies on constructing ‘pathological’ probability density distributions that have high densities in particular areas such that the combination functions give incorrect classification. Thus, there is no optimal combination algorithm that is suitable in all situations. It can be seen from this theorem that the probability density functions (pdfs) play an important role in the performance of combination algorithms, so studying the pdfs becomes the first step of finding a good combination algorithm. Although devised for classifier combination, the NPT is also relevant to all supervised classification problems

Item Type: Article
ISSNs: 0031-3203 (print)
Subjects: Q Science > QA Mathematics > QA76 Computer software
Divisions: Faculty of Physical Sciences and Engineering > Electronics and Computer Science > Comms, Signal Processing & Control
ePrint ID: 265147
Date Deposited: 05 Feb 2008 16:15
Last Modified: 27 Mar 2014 20:09
Further Information:Google Scholar
ISI Citation Count:5
URI: http://eprints.soton.ac.uk/id/eprint/265147

Actions (login required)

View Item View Item

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics