The University of Southampton
University of Southampton Institutional Repository

Detecting and understanding interviewer effects on survey data using a cross-classified mixed-effects location scale model

Detecting and understanding interviewer effects on survey data using a cross-classified mixed-effects location scale model
Detecting and understanding interviewer effects on survey data using a cross-classified mixed-effects location scale model
We propose a cross-classified mixed-effects location scale model for the analysis of interviewer effects in survey data. The model extends the standard two-way cross-classified random-intercept model (respondents nested in interviewers crossed with areas) by specifying the residual variance to be a function of covariates and an additional interviewer random effect. This extension provides a way to study interviewers’ effects on not just the ‘location’ (mean) of respondents’ responses, but additionally on their ‘scale’ (variability). It therefore allows researchers to address new questions such as: Do interviewers influence the variability of their respondents’ responses in addition to their average, and if so why? In doing so, the model facilitates a more complete and flexible assessment of the factors associated with interviewer error. We illustrate this model using data from wave 3 of the UK Household Longitudinal Survey (UKHLS), which we link to a range of interviewer characteristics measured in an independent survey of interviewers. By identifying both interviewer characteristics in general, but also specific interviewers who are associated with unusually high or low or homogeneous or heterogeneous responses, the model provides a way to inform improvements to survey quality.
0964-1998
1-39
Brunton-Smith, Ian
fdb27626-ba05-4d54-b00a-12a8c0a82db3
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c
Leckie, George
f43160a2-f379-4c38-b6b3-db5235181b33
Brunton-Smith, Ian
fdb27626-ba05-4d54-b00a-12a8c0a82db3
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c
Leckie, George
f43160a2-f379-4c38-b6b3-db5235181b33

Brunton-Smith, Ian, Sturgis, Patrick and Leckie, George (2016) Detecting and understanding interviewer effects on survey data using a cross-classified mixed-effects location scale model. Journal of the Royal Statistical Society: Series A (Statistics in Society), 1-39.

Record type: Article

Abstract

We propose a cross-classified mixed-effects location scale model for the analysis of interviewer effects in survey data. The model extends the standard two-way cross-classified random-intercept model (respondents nested in interviewers crossed with areas) by specifying the residual variance to be a function of covariates and an additional interviewer random effect. This extension provides a way to study interviewers’ effects on not just the ‘location’ (mean) of respondents’ responses, but additionally on their ‘scale’ (variability). It therefore allows researchers to address new questions such as: Do interviewers influence the variability of their respondents’ responses in addition to their average, and if so why? In doing so, the model facilitates a more complete and flexible assessment of the factors associated with interviewer error. We illustrate this model using data from wave 3 of the UK Household Longitudinal Survey (UKHLS), which we link to a range of interviewer characteristics measured in an independent survey of interviewers. By identifying both interviewer characteristics in general, but also specific interviewers who are associated with unusually high or low or homogeneous or heterogeneous responses, the model provides a way to inform improvements to survey quality.

Text
JRSS(A)_Revised_final (March 2016).pdf - Accepted Manuscript
Download (796kB)

More information

Accepted/In Press date: 17 March 2016
Published date: 13 May 2016
Organisations: Social Statistics & Demography

Identifiers

Local EPrints ID: 390921
URI: http://eprints.soton.ac.uk/id/eprint/390921
ISSN: 0964-1998
PURE UUID: 4e43ce7e-d453-4096-ad25-2cba91a91b15
ORCID for Patrick Sturgis: ORCID iD orcid.org/0000-0003-1180-3493

Catalogue record

Date deposited: 07 Apr 2016 14:26
Last modified: 15 Mar 2024 05:28

Export record

Contributors

Author: Ian Brunton-Smith
Author: Patrick Sturgis ORCID iD
Author: George Leckie

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×