The University of Southampton
University of Southampton Institutional Repository

The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise

The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise
The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise
Despite an increased interest in knowledge elicitation, there is still very little formal evidence evaluating the relative efficiency of the techniques available. In this paper we compare four KE techniques: structured interview, protocol analysis, card sort and laddered grid. Studies are reported across two classification domains, using eight experts in each. Despite its common usage, protocol analysis is shown to be the least efficient technique. The implications of this finding are reviewed. Finally, a study is reported in which non-experts are subjected to “knowledge elicitation”. Subjects entirely ignorant of a domain are able to construct plausible knowledge bases from common sense alone. The ramifications of these findings for knowledge engineers is discussed.
167-178
Burton, A.M.
cb52add0-d543-47e9-99ab-9613aee04de7
Shadbolt, N.R.
5c5acdf4-ad42-49b6-81fe-e9db58c2caf7
Rugg, G.
2c7da190-fe70-4363-a32b-858e9d9f2b62
Hedgecock, A.P.
aaef1cd6-6412-4384-a794-ec5233d84992
Burton, A.M.
cb52add0-d543-47e9-99ab-9613aee04de7
Shadbolt, N.R.
5c5acdf4-ad42-49b6-81fe-e9db58c2caf7
Rugg, G.
2c7da190-fe70-4363-a32b-858e9d9f2b62
Hedgecock, A.P.
aaef1cd6-6412-4384-a794-ec5233d84992

Burton, A.M., Shadbolt, N.R., Rugg, G. and Hedgecock, A.P. (1990) The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise. Journal of Knowledge Acquisition, 2 (2), 167-178.

Record type: Article

Abstract

Despite an increased interest in knowledge elicitation, there is still very little formal evidence evaluating the relative efficiency of the techniques available. In this paper we compare four KE techniques: structured interview, protocol analysis, card sort and laddered grid. Studies are reported across two classification domains, using eight experts in each. Despite its common usage, protocol analysis is shown to be the least efficient technique. The implications of this finding are reviewed. Finally, a study is reported in which non-experts are subjected to “knowledge elicitation”. Subjects entirely ignorant of a domain are able to construct plausible knowledge bases from common sense alone. The ramifications of these findings for knowledge engineers is discussed.

Text
Efficacy of KE Techniques JKA 1990.pdf - Other
Download (513kB)

More information

Published date: 1990
Organisations: Web & Internet Science

Identifiers

Local EPrints ID: 252310
URI: https://eprints.soton.ac.uk/id/eprint/252310
PURE UUID: d7abacce-20d2-4df4-966a-c10b0cce0075

Catalogue record

Date deposited: 19 Jan 2000
Last modified: 14 Dec 2018 17:31

Export record

Contributors

Author: A.M. Burton
Author: N.R. Shadbolt
Author: G. Rugg
Author: A.P. Hedgecock

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of https://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×