Ensemble construction via designed output distortion

Christensen, Stefan W. (2003) Ensemble construction via designed output distortion. Lecture Notes in Computer Science, 2709, 286-295.

Download

Full text not available from this repository.

Official URL: http://www.springerlink.com/(0kvytmqubzujrm3om40xf...

Description/Abstract

A new technique for generating regression ensembles is introduced in the present paper. The technique is based on earlier work on promoting model diversity through injection of noise into the outputs; it differs from the earlier methods in its rigorous requirement that the mean displacements applied to any data points output value be exactly zero.

It is illustrated how even the introduction of extremely large displacements may lead to prediction accuracy superior to that achieved by bagging.

It is demonstrated how ensembles of models with very high bias may have much better prediction accuracy than single models of the same bias-defying the conventional belief that ensembling high bias models is not purposeful. Finally is outlined how the technique may be applied to classification.

Item Type:Article
ISSN:0302-9743 (print)
Uncontrolled Keywords:computer science
Related URLs:http://www.springerlink.com/(0...1:105633,1
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QD Chemistry
Divisions:University Structure - Pre August 2011 > School of Chemistry
ePrint ID:19928
URI:http://eprints.soton.ac.uk/id/eprint/19928
Deposited On:24 Feb 2006
Last Modified:01 Jun 2011 14:38

Associated Staff Only: edit my ePrint