The University of Southampton
University of Southampton Institutional Repository

Individualised rating-scale procedure: a means of reducing response style contamination in survey data?

Chami-Castaldi, Elisa, Reynolds, Nina and Wallace, James (2008) Individualised rating-scale procedure: a means of reducing response style contamination in survey data? Electronic Journal of Business Research Methods, 6, (1), pp. 9-20.

Record type: Article

Abstract

Response style bias has been shown to seriously contaminate the substantive results drawn from survey data; particularly those conducted using cross-cultural samples. As a consequence, identification of response formats that suffer least from response style bias has been called for. Previous studies show that respondents’ personal characteristics, such as age, education level and culture, are connected with response style manifestation.

Differences in the way respondents interpret and utilise researcher-defined fixed rating-scales (e.g. Likert formats), poses a problem for survey researchers. Techniques that are currently used to remove response bias from survey data are inadequate as they cannot accurately determine the level of contamination present and frequently blur true score variance. Inappropriate rating-scales can impact on the level of response style bias manifested, insofar as they may not represent respondents’ cognitions. Rating-scale lengths that are too long present respondents with some response categories that are not ‘meaningful’, whereas rating-scales that are too short force respondents into compressing their cognitive rating-scales into the number of response categories provided (this can cause ERS contamination – extreme responding). We are therefore not able to guard against two respondents, who share the same cognitive position on a continuum, reporting their stance using different numbers on the rating-scale provided. This is especially problematic where a standard fixed rating-scale is used in cross-cultural surveys.

This paper details the development of the Individualised Rating-Scale Procedure (IRSP), a means of extracting a respondent’s ‘ideal’ rating-scale length, and as such ‘designing out’ response bias, for use as the measurement instrument in a survey. Whilst the fundamental ideas for self-anchoring rating-scales have been posited in the literature, the IRSP was developed using a series of qualitative interviews with participants. Finally, we discuss how the IRSP’s reliability and validity can be quantitatively assessed and compared to typical fixed researcher-defined rating-scales, such as the Likert format.

Full text not available from this repository.

More information

Published date: 2008
Keywords: scale length, response styles, response bias, survey research, cross-cultural surveys, individualised rating-scale procedure

Identifiers

Local EPrints ID: 179961
URI: http://eprints.soton.ac.uk/id/eprint/179961
ISSN: 1477-7029
PURE UUID: f33e5606-b75b-4f51-8bea-2fc9d214e3d4

Catalogue record

Date deposited: 05 Apr 2011 07:43
Last modified: 18 Jul 2017 12:02

Export record

Contributors

Author: Elisa Chami-Castaldi
Author: Nina Reynolds
Author: James Wallace

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×