The University of Southampton
University of Southampton Institutional Repository

Evaluating advanced search interfaces using established information-seeking model

Evaluating advanced search interfaces using established information-seeking model
Evaluating advanced search interfaces using established information-seeking model
When users have poorly defined or complex goals search interfaces offering only keyword searching facilities provide inadequate support to help them reach their information-seeking objectives. The emergence of interfaces with more advanced capabilities such as faceted browsing and result clustering can go some way to some way toward addressing such problems. The evaluation of these interfaces, however, is challenging since they generally offer diverse and versatile search environments that introduce overwhelming amounts of independent variables to user studies; choosing the interface object as the only independent variable in a study would reveal very little about why one design out-performs another. Nonetheless if we could effectively compare these interfaces we would have a way to determine which was best for a given scenario and begin to learn why. In this article we present a formative framework for the evaluation of advanced search interfaces through the quantification of the strengths and weaknesses of the interfaces in supporting user tactics and varying user conditions. This framework combines established models of users, user needs, and user behaviours to achieve this. The framework is applied to evaluate three search interfaces and demonstrates the potential value of this approach to interactive IR evaluation.
ir, evaluation, exploratory, search, browse, interactivity
1532-2882
1407-1422
Wilson, Max L.
b34ab988-f78f-47bd-bf34-1a36be06b488
schraefel, m.c.
ac304659-1692-47f6-b892-15113b8c929f
White, Ryen W.
7b0885bd-ceb1-4d33-a730-be35cd722bae
Wilson, Max L.
b34ab988-f78f-47bd-bf34-1a36be06b488
schraefel, m.c.
ac304659-1692-47f6-b892-15113b8c929f
White, Ryen W.
7b0885bd-ceb1-4d33-a730-be35cd722bae

Wilson, Max L., schraefel, m.c. and White, Ryen W. (2009) Evaluating advanced search interfaces using established information-seeking model. Journal of the American Society for Information Science and Technology, 60 (7), 1407-1422. (doi:10.1002/asi.21080).

Record type: Article

Abstract

When users have poorly defined or complex goals search interfaces offering only keyword searching facilities provide inadequate support to help them reach their information-seeking objectives. The emergence of interfaces with more advanced capabilities such as faceted browsing and result clustering can go some way to some way toward addressing such problems. The evaluation of these interfaces, however, is challenging since they generally offer diverse and versatile search environments that introduce overwhelming amounts of independent variables to user studies; choosing the interface object as the only independent variable in a study would reveal very little about why one design out-performs another. Nonetheless if we could effectively compare these interfaces we would have a way to determine which was best for a given scenario and begin to learn why. In this article we present a formative framework for the evaluation of advanced search interfaces through the quantification of the strengths and weaknesses of the interfaces in supporting user tactics and varying user conditions. This framework combines established models of users, user needs, and user behaviours to achieve this. The framework is applied to evaluate three search interfaces and demonstrates the potential value of this approach to interactive IR evaluation.

PDF JASIST_Preprint.pdf - Accepted Manuscript
Download (2MB)

More information

e-pub ahead of print date: 16 April 2009
Published date: July 2009
Keywords: ir, evaluation, exploratory, search, browse, interactivity
Organisations: Agents, Interactions & Complexity

Identifiers

Local EPrints ID: 264301
URI: https://eprints.soton.ac.uk/id/eprint/264301
ISSN: 1532-2882
PURE UUID: ff4de410-60fe-4cc6-8794-b2ba79a904e7

Catalogue record

Date deposited: 12 Jul 2007
Last modified: 18 Jul 2017 07:37

Export record

Altmetrics

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of https://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×