Protocol analysis in the validation of language tests: potential of the method, state of the evidence
Protocol analysis in the validation of language tests: potential of the method, state of the evidence
This paper is primarily a methodological consideration, which critically reviews the literature on using protocol analysis to understand cognitive processes that students engage in while writing language tests. For the purpose of synthesizing the applicability and significance of protocol analysis in validating language tests, the author first discusses the potential of the concepts including validity, language test validation, and protocol analysis.
Terminological classifications of different approaches of test validation are elaborated. The author then critically examines the state of evidence by interpreting studies that employed protocol analysis in language tests.
This paper is intended to stimulate discussion on the merits and inadequacies of protocol analysis in different ESL/EFL tests, especially when the tests are designed for test-takers with culturally different backgrounds. Possible future research trends are suggested.
protocol analysis, test validation, concurrent protocol, retrospective protocol
124-137
Zheng, Ying
abc38a5e-a4ba-460e-92e2-b766d11d2b29
2009
Zheng, Ying
abc38a5e-a4ba-460e-92e2-b766d11d2b29
Zheng, Ying
(2009)
Protocol analysis in the validation of language tests: potential of the method, state of the evidence.
International Journal of Pedagogies and Learning, 5 (1), .
Abstract
This paper is primarily a methodological consideration, which critically reviews the literature on using protocol analysis to understand cognitive processes that students engage in while writing language tests. For the purpose of synthesizing the applicability and significance of protocol analysis in validating language tests, the author first discusses the potential of the concepts including validity, language test validation, and protocol analysis.
Terminological classifications of different approaches of test validation are elaborated. The author then critically examines the state of evidence by interpreting studies that employed protocol analysis in language tests.
This paper is intended to stimulate discussion on the merits and inadequacies of protocol analysis in different ESL/EFL tests, especially when the tests are designed for test-takers with culturally different backgrounds. Possible future research trends are suggested.
This record has no associated files available for download.
More information
Published date: 2009
Keywords:
protocol analysis, test validation, concurrent protocol, retrospective protocol
Organisations:
Modern Languages
Identifiers
Local EPrints ID: 357300
URI: http://eprints.soton.ac.uk/id/eprint/357300
ISSN: 1833-4105
PURE UUID: 95f0a35e-8d84-45d1-b471-f6460aed2957
Catalogue record
Date deposited: 24 Sep 2013 09:17
Last modified: 11 Dec 2021 04:45
Export record
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics