The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise
The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise
Despite an increased interest in knowledge elicitation, there is still very little formal evidence evaluating the relative efficiency of the techniques available. In this paper we compare four KE techniques: structured interview, protocol analysis, card sort and laddered grid. Studies are reported across two classification domains, using eight experts in each. Despite its common usage, protocol analysis is shown to be the least efficient technique. The implications of this finding are reviewed. Finally, a study is reported in which non-experts are subjected to “knowledge elicitation”. Subjects entirely ignorant of a domain are able to construct plausible knowledge bases from common sense alone. The ramifications of these findings for knowledge engineers is discussed.
167-178
Burton, A.M.
cb52add0-d543-47e9-99ab-9613aee04de7
Shadbolt, N.R.
5c5acdf4-ad42-49b6-81fe-e9db58c2caf7
Rugg, G.
2c7da190-fe70-4363-a32b-858e9d9f2b62
Hedgecock, A.P.
aaef1cd6-6412-4384-a794-ec5233d84992
1990
Burton, A.M.
cb52add0-d543-47e9-99ab-9613aee04de7
Shadbolt, N.R.
5c5acdf4-ad42-49b6-81fe-e9db58c2caf7
Rugg, G.
2c7da190-fe70-4363-a32b-858e9d9f2b62
Hedgecock, A.P.
aaef1cd6-6412-4384-a794-ec5233d84992
Burton, A.M., Shadbolt, N.R., Rugg, G. and Hedgecock, A.P.
(1990)
The efficacy of knowledge elicitation techniques: a comparison across domains and levels of expertise.
Journal of Knowledge Acquisition, 2 (2), .
Abstract
Despite an increased interest in knowledge elicitation, there is still very little formal evidence evaluating the relative efficiency of the techniques available. In this paper we compare four KE techniques: structured interview, protocol analysis, card sort and laddered grid. Studies are reported across two classification domains, using eight experts in each. Despite its common usage, protocol analysis is shown to be the least efficient technique. The implications of this finding are reviewed. Finally, a study is reported in which non-experts are subjected to “knowledge elicitation”. Subjects entirely ignorant of a domain are able to construct plausible knowledge bases from common sense alone. The ramifications of these findings for knowledge engineers is discussed.
Text
Efficacy of KE Techniques JKA 1990.pdf
- Other
More information
Published date: 1990
Organisations:
Web & Internet Science
Identifiers
Local EPrints ID: 252310
URI: http://eprints.soton.ac.uk/id/eprint/252310
PURE UUID: d7abacce-20d2-4df4-966a-c10b0cce0075
Catalogue record
Date deposited: 19 Jan 2000
Last modified: 14 Mar 2024 05:18
Export record
Contributors
Author:
A.M. Burton
Author:
N.R. Shadbolt
Author:
G. Rugg
Author:
A.P. Hedgecock
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics