Robust Automatic Methods for Outlier and Error Detection

Chambers, Ray, Hentges, Adão and Zhao, Xinqiang (2003) Robust Automatic Methods for Outlier and Error Detection. Southampton, UK, Southampton Statistical Sciences Research Institute, 29pp. (S3RI Methodology Working Papers, M03/17).


[img] PDF
Download (3331Kb)


Editing in surveys of economic populations is often complicated by the fact that
outliers due to errors in the data are mixed in with correct, but extreme, data values. In
this paper we describe and evaluate two automatic techniques for error identification
in such long tailed data distributions. The first is a forward search procedure based on
finding a sequence of error-free subsets of the error contaminated data and then using
regression modelling within these subsets to identify errors. The second uses a robust
regression tree modelling procedure to identify errors. Both approaches can be
implemented on a univariate basis or on a multivariate basis. An application to a
business survey data set that contains a mix of extreme errors and true outliers is

Item Type: Monograph (UNSPECIFIED)
Related URLs:
Subjects: H Social Sciences > HA Statistics
Divisions : University Structure - Pre August 2011 > Southampton Statistical Sciences Research Institute
ePrint ID: 8167
Accepted Date and Publication Date:
Date Deposited: 11 Jul 2004
Last Modified: 31 Mar 2016 11:11

Actions (login required)

View Item View Item

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics