A Validated Framework for Measuring Interface Support for Interactive Information Seeking
A Validated Framework for Measuring Interface Support for Interactive Information Seeking
In this paper we present the validation of an evaluation framework that models the support provided by search systems for different types of user and their expected types of seeking behavior. Factors determining the types of users include previous knowledge and goals. After an overview is presented, the framework is validated in two ways. First, the novel integration of the two existing information-seeking models used in the framework is validated by the correlation of multiple expert and novice analysis. Second, the framework is validated against the results produced by two separated user studies. Further, the refinements made by the first validation technique are shown to increase the accuracy of the framework through the second technique. The successful validation process has shown that the framework can identify both strong and weak areas of search interface design in only a few hours. The results produced can be used to either revise and strengthen designs or inform the structure of a user study.
Wilson, Max L.
b34ab988-f78f-47bd-bf34-1a36be06b488
schraefel, m.c.
ac304659-1692-47f6-b892-15113b8c929f
Wilson, Max L.
b34ab988-f78f-47bd-bf34-1a36be06b488
schraefel, m.c.
ac304659-1692-47f6-b892-15113b8c929f
Wilson, Max L. and schraefel, m.c.
(2008)
A Validated Framework for Measuring Interface Support for Interactive Information Seeking
(Submitted)
Record type:
Monograph
(Project Report)
Abstract
In this paper we present the validation of an evaluation framework that models the support provided by search systems for different types of user and their expected types of seeking behavior. Factors determining the types of users include previous knowledge and goals. After an overview is presented, the framework is validated in two ways. First, the novel integration of the two existing information-seeking models used in the framework is validated by the correlation of multiple expert and novice analysis. Second, the framework is validated against the results produced by two separated user studies. Further, the refinements made by the first validation technique are shown to increase the accuracy of the framework through the second technique. The successful validation process has shown that the framework can identify both strong and weak areas of search interface design in only a few hours. The results produced can be used to either revise and strengthen designs or inform the structure of a user study.
Text
sigir08finalTR.pdf
- Other
More information
Submitted date: 2008
Organisations:
Agents, Interactions & Complexity
Identifiers
Local EPrints ID: 265135
URI: http://eprints.soton.ac.uk/id/eprint/265135
PURE UUID: a3ede3f0-52d1-4be3-aa20-dc883554ca77
Catalogue record
Date deposited: 04 Feb 2008 12:22
Last modified: 15 Mar 2024 03:16
Export record
Contributors
Author:
Max L. Wilson
Author:
m.c. schraefel
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics