The University of Southampton
University of Southampton Institutional Repository

Ensemble construction via designed output distortion

Ensemble construction via designed output distortion
Ensemble construction via designed output distortion
A new technique for generating regression ensembles is introduced in the present paper. The technique is based on earlier work on promoting model diversity through injection of noise into the outputs; it differs from the earlier methods in its rigorous requirement that the mean displacements applied to any data points output value be exactly zero.
It is illustrated how even the introduction of extremely large displacements may lead to prediction accuracy superior to that achieved by bagging.
It is demonstrated how ensembles of models with very high bias may have much better prediction accuracy than single models of the same bias-defying the conventional belief that ensembling high bias models is not purposeful. Finally is outlined how the technique may be applied to classification.
computer science
0302-9743
286-295
Christensen, Stefan W.
eec9c1f7-07c8-4a94-a06b-49c29a315c7a
Christensen, Stefan W.
eec9c1f7-07c8-4a94-a06b-49c29a315c7a

Christensen, Stefan W. (2003) Ensemble construction via designed output distortion. Lecture Notes in Computer Science, 2709, 286-295.

Record type: Article

Abstract

A new technique for generating regression ensembles is introduced in the present paper. The technique is based on earlier work on promoting model diversity through injection of noise into the outputs; it differs from the earlier methods in its rigorous requirement that the mean displacements applied to any data points output value be exactly zero.
It is illustrated how even the introduction of extremely large displacements may lead to prediction accuracy superior to that achieved by bagging.
It is demonstrated how ensembles of models with very high bias may have much better prediction accuracy than single models of the same bias-defying the conventional belief that ensembling high bias models is not purposeful. Finally is outlined how the technique may be applied to classification.

This record has no associated files available for download.

More information

Published date: 2003
Keywords: computer science

Identifiers

Local EPrints ID: 19928
URI: http://eprints.soton.ac.uk/id/eprint/19928
ISSN: 0302-9743
PURE UUID: d16f99b2-269a-4fb3-ad59-10f2e0fcdf20

Catalogue record

Date deposited: 24 Feb 2006
Last modified: 08 Jan 2022 01:00

Export record

Contributors

Author: Stefan W. Christensen

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×