Comparative judgement in education research
Comparative judgement in education research
Educational researchers often need to construct precise and reliable measurement scales of complex and varied representations such as participants’ written work, videoed lesson segments and policy documents. Developing such scales using can be resource-intensive and time-consuming, and the outcomes are not always reliable. Here we present alternative methods based on comparative judgement (CJ) that have been growing in popularity over recent years. We consider the contexts in which CJ-based methods are appropriate before describing in detail what they are and how they can be applied to construct measurement scales in a range of educational research contexts. We also provide an overview to evaluating the reliability and validity of the resultant measurement scales.
Comparative judgement; measurement; reliability; validity
Jones, Ian
3ddac6b6-fb98-4ad5-ba2c-c21d14bae0e4
Davies, Ben
aa12efcd-c8a4-4abc-9f2a-469afaff2770
11 August 2023
Jones, Ian
3ddac6b6-fb98-4ad5-ba2c-c21d14bae0e4
Davies, Ben
aa12efcd-c8a4-4abc-9f2a-469afaff2770
Jones, Ian and Davies, Ben
(2023)
Comparative judgement in education research.
International Journal of Research and Method in Education.
(doi:10.1080/1743727X.2023.2242273).
Abstract
Educational researchers often need to construct precise and reliable measurement scales of complex and varied representations such as participants’ written work, videoed lesson segments and policy documents. Developing such scales using can be resource-intensive and time-consuming, and the outcomes are not always reliable. Here we present alternative methods based on comparative judgement (CJ) that have been growing in popularity over recent years. We consider the contexts in which CJ-based methods are appropriate before describing in detail what they are and how they can be applied to construct measurement scales in a range of educational research contexts. We also provide an overview to evaluating the reliability and validity of the resultant measurement scales.
Text
Final preprint
- Author's Original
Restricted to Repository staff only
Request a copy
Text
Comparative judgement in education research
- Version of Record
More information
Accepted/In Press date: 18 May 2023
Published date: 11 August 2023
Additional Information:
Publisher Copyright:
© 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.
Keywords:
Comparative judgement; measurement; reliability; validity
Identifiers
Local EPrints ID: 485421
URI: http://eprints.soton.ac.uk/id/eprint/485421
ISSN: 1743-727X
PURE UUID: ccbafa32-8dbf-4d86-9c8c-ebd5efc43354
Catalogue record
Date deposited: 06 Dec 2023 17:38
Last modified: 18 Mar 2024 04:07
Export record
Altmetrics
Contributors
Author:
Ian Jones
Author:
Ben Davies
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics