The University of Southampton
University of Southampton Institutional Repository

A comparison of state-of-the-art classification techniques for expert automobile insurance fraud detection

Viaene, Stijn, Derrig, Richard A., Baesens, Bart and Dedene, Guido (2002) A comparison of state-of-the-art classification techniques for expert automobile insurance fraud detection Journal of Risk and Insurance, 69, (3), pp. 373-421.

Record type: Article


Several state–of–the–art binary classification techniques are experimentally evaluated in the context of expert automobile insurance claim fraud detection. The predictive power of logistic regression, C4.5 decision tree, k–nearest neighbor, Bayesian learning multilayer perceptron neural network, least–squares support vector machine, naive Bayes, and tree–augmented naive Bayes classification is contrasted. For most of these algorithm types, we report on several operationalizations using alternative hyperparameter or design choices. We compare these in terms of mean percentage correctly classified (PCC) and mean area under the receiver operating characteristic (AUROC) curve using a stratified, blocked, ten–fold cross–validation experiment.
We also contrast algorithm type performance visually by means of the convex hull of the receiver operating characteristic (ROC) curves associated with the alternative operationalizations per algorithm type. The study is based on a data set of 1,399 personal injury protection claims from 1993 accidents collected by the Automobile Insurers Bureau of Massachusetts. To stay as close to real–life operating conditions as possible, we consider only predictors that are known relatively early in the life of a claim. Furthermore, based on the qualification of each available claim by both a verbal expert assessment of suspicion of fraud and a ten–point–scale expert suspicion score, we can compare classification for different target/class encoding schemes.
Finally, we also investigate the added value of systematically collecting nonflag predictors for suspicion of fraud modeling purposes. From the observed results, we may state that: (1) independent of the target encoding scheme and the algorithm type, the inclusion of nonflag predictors allows us to significantly boost predictive performance; (2) for all the evaluated scenarios, the performance difference in terms of mean PCC and mean AUROC between many algorithm type operationalizations turns out to be rather small; visual comparison of the algorithm type ROC curve convex hulls also shows limited difference in performance over the range of operating conditions; (3) relatively simple and efficient techniques such as linear logistic regression and linear kernel least–squares support vector machine classification show excellent overall predictive capabilities, and (smoothed) naive Bayes also performs well; and (4) the C4.5 decision tree operationalization results are rather disappointing; none of the tree operationalizations are capable of attaining mean AUROC performance in line with the best. Visual inspection of the evaluated scenarios reveals that the C4.5 algorithm type ROC curve convex hull is often dominated in large part by most of the other algorithm type hulls.

Full text not available from this repository.

More information

Published date: 2002
Organisations: Management


Local EPrints ID: 36738
ISSN: 0022-4367
PURE UUID: e5c15776-8ef5-4fe8-b6e8-c03ddb98b0f9

Catalogue record

Date deposited: 25 May 2006
Last modified: 17 Jul 2017 15:43

Export record


Author: Stijn Viaene
Author: Richard A. Derrig
Author: Bart Baesens
Author: Guido Dedene

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.