The interviewer contribution to variability in response times in face-to-face interview surveys
The interviewer contribution to variability in response times in face-to-face interview surveys
Survey researchers have consistently found that interviewers make a small but systematic contribution to variability in response times. However, we know little about what the characteristics of interviewers are that lead to this effect. In this paper we address this gap in understanding by linking item level response times from wave three of the UK Household Longitudinal Survey (UKHLS) to data from an independently conducted survey of interviewers. The linked data file has a complex, hierarchical structure with response latencies nested within respondents and questions, which are themselves nested within interviewers and areas. We propose the use of a cross-classified mixed-effects location scale model to allow for the decomposition of the joint effects on response times of interviewers, areas, questions, and respondents. We present a new method for producing interviewer specific intra-class correlations (ICCs) of response times and evaluate how interviewer demographic characteristics, personality, and attitudes to surveys and to interviewing affect the length of response latencies and the interviewer-specific ICCs. Hence, the paper makes both methodological and substantive contributions to the investigation of response times.
Interviewers, Multilevel model, Personality, Response latency
701-721
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c
Maslovskaya, Olga
9c979052-e9d7-4400-a657-38f1f9cd74d0
Durrant, Gabriele
14fcc787-2666-46f2-a097-e4b98a210610
Brunton-Smith, Ian
336a9a84-7f27-4897-a045-18b200f3d115
1 September 2021
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c
Maslovskaya, Olga
9c979052-e9d7-4400-a657-38f1f9cd74d0
Durrant, Gabriele
14fcc787-2666-46f2-a097-e4b98a210610
Brunton-Smith, Ian
336a9a84-7f27-4897-a045-18b200f3d115
Sturgis, Patrick, Maslovskaya, Olga, Durrant, Gabriele and Brunton-Smith, Ian
(2021)
The interviewer contribution to variability in response times in face-to-face interview surveys.
Journal of Survey Statistics and Methodology, 9 (4), .
(doi:10.1093/jssam/smaa009).
Abstract
Survey researchers have consistently found that interviewers make a small but systematic contribution to variability in response times. However, we know little about what the characteristics of interviewers are that lead to this effect. In this paper we address this gap in understanding by linking item level response times from wave three of the UK Household Longitudinal Survey (UKHLS) to data from an independently conducted survey of interviewers. The linked data file has a complex, hierarchical structure with response latencies nested within respondents and questions, which are themselves nested within interviewers and areas. We propose the use of a cross-classified mixed-effects location scale model to allow for the decomposition of the joint effects on response times of interviewers, areas, questions, and respondents. We present a new method for producing interviewer specific intra-class correlations (ICCs) of response times and evaluate how interviewer demographic characteristics, personality, and attitudes to surveys and to interviewing affect the length of response latencies and the interviewer-specific ICCs. Hence, the paper makes both methodological and substantive contributions to the investigation of response times.
Text
Paper_Revised_V2_Dec19
- Accepted Manuscript
More information
Accepted/In Press date: 24 March 2020
e-pub ahead of print date: 17 June 2020
Published date: 1 September 2021
Keywords:
Interviewers, Multilevel model, Personality, Response latency
Identifiers
Local EPrints ID: 438953
URI: http://eprints.soton.ac.uk/id/eprint/438953
ISSN: 2325-0984
PURE UUID: 16a86f81-5701-4f35-854e-a36751705547
Catalogue record
Date deposited: 30 Mar 2020 16:30
Last modified: 18 May 2024 04:01
Export record
Altmetrics
Contributors
Author:
Patrick Sturgis
Author:
Ian Brunton-Smith
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics