An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive models


Huysmans, Johan, Dejaeger, Karel, Mues, Christophe, Vanthienen, Jan and Baesens, Bart (2011) An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive models. Decision Support Systems, 51, (1), 141-154. (doi:10.1016/j.dss.2010.12.003).

Download

Full text not available from this repository.

Description/Abstract

An important objective of data mining is the development of predictive models. Based on a number of observations, a model is constructed that allows the analysts to provide classifications or predictions for new observations. Currently, most research focuses on improving the accuracy or precision of these models and comparatively little research has been undertaken to increase their comprehensibility to the analyst or end-user. This is mainly due to the subjective nature of ‘comprehensibility’, which depends on many factors outside the model, such as the user's experience and his/her prior knowledge. Despite this influence of the observer, some representation formats are generally considered to be more easily interpretable than others. In this paper, an empirical study is presented which investigates the suitability of a number of alternative representation formats for classification when interpretability is a key requirement. The formats under consideration are decision tables, (binary) decision trees, propositional rules, and oblique rules. An end-user experiment was designed to test the accuracy, response time, and answer confidence for a set of problem-solving tasks involving the former representations. Analysis of the results reveals that decision tables perform significantly better on all three criteria, while post-test voting also reveals a clear preference of users for decision tables in terms of ease of use.

Item Type: Article
ISSNs: 0167-9236 (print)
1873-5797 (electronic)
Subjects: H Social Sciences > HA Statistics
H Social Sciences > HD Industries. Land use. Labor > HD28 Management. Industrial Management
Divisions: University Structure - Pre August 2011 > School of Management
ePrint ID: 169001
Date Deposited: 16 Dec 2010 15:07
Last Modified: 27 Mar 2014 19:19
URI: http://eprints.soton.ac.uk/id/eprint/169001

Actions (login required)

View Item View Item