The University of Southampton
University of Southampton Institutional Repository

Calculating the random guess score of multiple-response and matching test items

Calculating the random guess score of multiple-response and matching test items
Calculating the random guess score of multiple-response and matching test items

For achievement tests, the guess score is often used as a baseline for the lowest possible grade for score to grade transformations and setting the cut scores. For test item types such as multiple-response, matching and drag-and-drop, determining the guess score requires more elaborate calculations than the more straightforward calculation of the guess score for True-False and multiple-choice test item formats. For various variants of multiple-response and matching types with respect to dichotomous and polytomous scoring, methods for determining the guess score are presented and illustrated with practical applications. The implications for theory and practice are discussed.

Cut score, Item-writing, MCQs, Multiple-choice questions, Question development, Selected response questions, Selected response test items, Standard setting, Test development
1865-0929
210-222
Springer Verlag
Draaijer, Silvester
31e9920a-d3de-4bfd-a4fb-6a78f1640fdb
Jordan, Sally
6b977be1-713a-4902-b56a-9969a947151d
Ogden, Helen
78b03322-3836-4d3b-8b84-faf12895854e
Draaijer, Silvester
31e9920a-d3de-4bfd-a4fb-6a78f1640fdb
Jordan, Sally
6b977be1-713a-4902-b56a-9969a947151d
Ogden, Helen
78b03322-3836-4d3b-8b84-faf12895854e

Draaijer, Silvester, Jordan, Sally and Ogden, Helen (2018) Calculating the random guess score of multiple-response and matching test items. In Technology Enhanced Assessment - 20th International Conference, TEA 2017, Revised Selected Papers. vol. 829, Springer Verlag. pp. 210-222 . (doi:10.1007/978-3-319-97807-9_16).

Record type: Conference or Workshop Item (Paper)

Abstract

For achievement tests, the guess score is often used as a baseline for the lowest possible grade for score to grade transformations and setting the cut scores. For test item types such as multiple-response, matching and drag-and-drop, determining the guess score requires more elaborate calculations than the more straightforward calculation of the guess score for True-False and multiple-choice test item formats. For various variants of multiple-response and matching types with respect to dichotomous and polytomous scoring, methods for determining the guess score are presented and illustrated with practical applications. The implications for theory and practice are discussed.

Text
Draaijer2018 - Accepted Manuscript
Download (525kB)

More information

Accepted/In Press date: 4 August 2017
e-pub ahead of print date: 18 August 2018
Venue - Dates: 20th International Conference on Technology Enhanced Assessment, TEA 2017, , Barcelona, Spain, 2017-10-04 - 2017-10-05
Keywords: Cut score, Item-writing, MCQs, Multiple-choice questions, Question development, Selected response questions, Selected response test items, Standard setting, Test development

Identifiers

Local EPrints ID: 425109
URI: http://eprints.soton.ac.uk/id/eprint/425109
ISSN: 1865-0929
PURE UUID: 4f5dda1c-b166-408d-a3da-4d7b9d6ac15e
ORCID for Helen Ogden: ORCID iD orcid.org/0000-0001-7204-9776

Catalogue record

Date deposited: 10 Oct 2018 16:30
Last modified: 26 Feb 2022 05:04

Export record

Altmetrics

Contributors

Author: Silvester Draaijer
Author: Sally Jordan
Author: Helen Ogden ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×