The University of Southampton
University of Southampton Institutional Repository

Questionnaire discrimination: (re)-introducing coefficient ?

Questionnaire discrimination: (re)-introducing coefficient ?
Questionnaire discrimination: (re)-introducing coefficient ?
Background: questionnaires are used routinely in clinical research to measure health status and quality of life. Questionnaire measurements are traditionally formally assessed by indices of reliability (the degree of measurement error) and validity (the extent to which the questionnaire measures what it is supposed to measure). Neither of these indices assesses the degree to which the questionnaire is able to discriminate between individuals, an important aspect of measurement. This paper introduces and extends an existing index of a questionnaire's ability to distinguish between individuals, that is, the questionnaire's discrimination.

Methods: Ferguson (1949) [1] derived an index of test discrimination, coefficient ?, for psychometric tests with dichotomous (correct/incorrect) items. In this paper a general form of the formula, ?G, is derived for the more general class of questionnaires allowing for several response choices. The calculation and characteristics of ?G are then demonstrated using questionnaire data (GHQ-12) from 2003–2004 British Household Panel Survey (N = 14761). Coefficients for reliability (?) and discrimination (?G) are computed for two commonly-used GHQ-12 coding methods: dichotomous coding and four-point Likert-type coding.

Results: both scoring methods were reliable (? > 0.88). However, ?G was substantially lower (0.73) for the dichotomous coding of the GHQ-12 than for the Likert-type method (?G = 0.96), indicating that the dichotomous coding, although reliable, failed to discriminate between individuals.

Conclusion: coefficient ?G was shown to have decisive utility in distinguishing between the cross-sectional discrimination of two equally reliable scoring methods. Ferguson's ? has been neglected in discussions of questionnaire design and performance, perhaps because it has not been implemented in software and was restricted to questionnaires with dichotomous items, which are rare in health care research. It is suggested that the more general formula introduced here is reported as ?G, to avoid the implication that items are dichotomously coded
1471-2288
19
Hankins, Matthew
ce4b7d68-3320-4af4-9dd7-3537a4b07219
Hankins, Matthew
ce4b7d68-3320-4af4-9dd7-3537a4b07219

Hankins, Matthew (2007) Questionnaire discrimination: (re)-introducing coefficient ? BMC Medical Research Methodology, 7 (1), 19. (doi:10.1186/1471-2288-7-19).

Record type: Article

Abstract

Background: questionnaires are used routinely in clinical research to measure health status and quality of life. Questionnaire measurements are traditionally formally assessed by indices of reliability (the degree of measurement error) and validity (the extent to which the questionnaire measures what it is supposed to measure). Neither of these indices assesses the degree to which the questionnaire is able to discriminate between individuals, an important aspect of measurement. This paper introduces and extends an existing index of a questionnaire's ability to distinguish between individuals, that is, the questionnaire's discrimination.

Methods: Ferguson (1949) [1] derived an index of test discrimination, coefficient ?, for psychometric tests with dichotomous (correct/incorrect) items. In this paper a general form of the formula, ?G, is derived for the more general class of questionnaires allowing for several response choices. The calculation and characteristics of ?G are then demonstrated using questionnaire data (GHQ-12) from 2003–2004 British Household Panel Survey (N = 14761). Coefficients for reliability (?) and discrimination (?G) are computed for two commonly-used GHQ-12 coding methods: dichotomous coding and four-point Likert-type coding.

Results: both scoring methods were reliable (? > 0.88). However, ?G was substantially lower (0.73) for the dichotomous coding of the GHQ-12 than for the Likert-type method (?G = 0.96), indicating that the dichotomous coding, although reliable, failed to discriminate between individuals.

Conclusion: coefficient ?G was shown to have decisive utility in distinguishing between the cross-sectional discrimination of two equally reliable scoring methods. Ferguson's ? has been neglected in discussions of questionnaire design and performance, perhaps because it has not been implemented in software and was restricted to questionnaires with dichotomous items, which are rare in health care research. It is suggested that the more general formula introduced here is reported as ?G, to avoid the implication that items are dichotomously coded

This record has no associated files available for download.

More information

Published date: 2007
Organisations: Faculty of Health Sciences

Identifiers

Local EPrints ID: 343931
URI: http://eprints.soton.ac.uk/id/eprint/343931
ISSN: 1471-2288
PURE UUID: 20c0f7b9-0dcf-44b1-b84f-b3b47123851d

Catalogue record

Date deposited: 16 Nov 2012 11:08
Last modified: 14 Mar 2024 12:08

Export record

Altmetrics

Contributors

Author: Matthew Hankins

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×