Calculating the random guess score of multiple-response and matching test items

Draaijer, Silvester, Jordan, Sally and Ogden, Helen (2018) Calculating the random guess score of multiple-response and matching test items. In Technology Enhanced Assessment - 20th International Conference, TEA 2017, Revised Selected Papers. vol. 829, Springer. pp. 210-222 . (doi:10.1007/978-3-319-97807-9_16).

Record type: Conference or Workshop Item (Paper)

Abstract

For achievement tests, the guess score is often used as a baseline for the lowest possible grade for score to grade transformations and setting the cut scores. For test item types such as multiple-response, matching and drag-and-drop, determining the guess score requires more elaborate calculations than the more straightforward calculation of the guess score for True-False and multiple-choice test item formats. For various variants of multiple-response and matching types with respect to dichotomous and polytomous scoring, methods for determining the guess score are presented and illustrated with practical applications. The implications for theory and practice are discussed.

Text

Draaijer2018 - Accepted Manuscript

Download (525kB)

More information

Accepted/In Press date: 4 August 2017

e-pub ahead of print date: 18 August 2018

Venue - Dates: 20th International Conference on Technology Enhanced Assessment, TEA 2017, , Barcelona, Spain, 2017-10-05 - 2017-10-06

Keywords: Cut score, Item-writing, MCQs, Multiple-choice questions, Question development, Selected response questions, Selected response test items, Standard setting, Test development