The University of Southampton
University of Southampton Institutional Repository

Protocol analysis in the validation of language tests: potential of the method, state of the evidence

Protocol analysis in the validation of language tests: potential of the method, state of the evidence
Protocol analysis in the validation of language tests: potential of the method, state of the evidence
This paper is primarily a methodological consideration, which critically reviews the literature on using protocol analysis to understand cognitive processes that students engage in while writing language tests. For the purpose of synthesizing the applicability and significance of protocol analysis in validating language tests, the author first discusses the potential of the concepts including validity, language test validation, and protocol analysis.

Terminological classifications of different approaches of test validation are elaborated. The author then critically examines the state of evidence by interpreting studies that employed protocol analysis in language tests.

This paper is intended to stimulate discussion on the merits and inadequacies of protocol analysis in different ESL/EFL tests, especially when the tests are designed for test-takers with culturally different backgrounds. Possible future research trends are suggested.
protocol analysis, test validation, concurrent protocol, retrospective protocol
1833-4105
124-137
Zheng, Ying
abc38a5e-a4ba-460e-92e2-b766d11d2b29
Zheng, Ying
abc38a5e-a4ba-460e-92e2-b766d11d2b29

Zheng, Ying (2009) Protocol analysis in the validation of language tests: potential of the method, state of the evidence. International Journal of Pedagogies and Learning, 5 (1), 124-137.

Record type: Article

Abstract

This paper is primarily a methodological consideration, which critically reviews the literature on using protocol analysis to understand cognitive processes that students engage in while writing language tests. For the purpose of synthesizing the applicability and significance of protocol analysis in validating language tests, the author first discusses the potential of the concepts including validity, language test validation, and protocol analysis.

Terminological classifications of different approaches of test validation are elaborated. The author then critically examines the state of evidence by interpreting studies that employed protocol analysis in language tests.

This paper is intended to stimulate discussion on the merits and inadequacies of protocol analysis in different ESL/EFL tests, especially when the tests are designed for test-takers with culturally different backgrounds. Possible future research trends are suggested.

This record has no associated files available for download.

More information

Published date: 2009
Keywords: protocol analysis, test validation, concurrent protocol, retrospective protocol
Organisations: Modern Languages

Identifiers

Local EPrints ID: 357300
URI: http://eprints.soton.ac.uk/id/eprint/357300
ISSN: 1833-4105
PURE UUID: 95f0a35e-8d84-45d1-b471-f6460aed2957
ORCID for Ying Zheng: ORCID iD orcid.org/0000-0003-2574-0358

Catalogue record

Date deposited: 24 Sep 2013 09:17
Last modified: 11 Dec 2021 04:45

Export record

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×