The University of Southampton
University of Southampton Institutional Repository

The interviewer contribution to variability in response times in face-to-face interview surveys

The interviewer contribution to variability in response times in face-to-face interview surveys
The interviewer contribution to variability in response times in face-to-face interview surveys
Survey researchers have consistently found that interviewers make a small but systematic contribution to variability in response times. However, we know little about what the characteristics of interviewers are that lead to this effect. In this paper we address this gap in understanding by linking item level response times from wave three of the UK Household Longitudinal Survey (UKHLS) to data from an independently conducted survey of interviewers. The linked data file has a complex, hierarchical structure with response latencies nested within respondents and questions, which are themselves nested within interviewers and areas. We propose the use of a cross-classified mixed-effects location scale model to allow for the decomposition of the joint effects on response times of interviewers, areas, questions, and respondents. We present a new method for producing interviewer specific intra-class correlations (ICCs) of response times and evaluate how interviewer demographic characteristics, personality, and attitudes to surveys and to interviewing affect the length of response latencies and the interviewer-specific ICCs. Hence, the paper makes both methodological and substantive contributions to the investigation of response times.
Interviewers, Multilevel model, Personality, Response latency
2325-0984
701-721
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c
Maslovskaya, Olga
9c979052-e9d7-4400-a657-38f1f9cd74d0
Durrant, Gabriele
14fcc787-2666-46f2-a097-e4b98a210610
Brunton-Smith, Ian
336a9a84-7f27-4897-a045-18b200f3d115
Sturgis, Patrick
b9f6b40c-50d2-4117-805a-577b501d0b3c
Maslovskaya, Olga
9c979052-e9d7-4400-a657-38f1f9cd74d0
Durrant, Gabriele
14fcc787-2666-46f2-a097-e4b98a210610
Brunton-Smith, Ian
336a9a84-7f27-4897-a045-18b200f3d115

Sturgis, Patrick, Maslovskaya, Olga, Durrant, Gabriele and Brunton-Smith, Ian (2021) The interviewer contribution to variability in response times in face-to-face interview surveys. Journal of Survey Statistics and Methodology, 9 (4), 701-721. (doi:10.1093/jssam/smaa009).

Record type: Article

Abstract

Survey researchers have consistently found that interviewers make a small but systematic contribution to variability in response times. However, we know little about what the characteristics of interviewers are that lead to this effect. In this paper we address this gap in understanding by linking item level response times from wave three of the UK Household Longitudinal Survey (UKHLS) to data from an independently conducted survey of interviewers. The linked data file has a complex, hierarchical structure with response latencies nested within respondents and questions, which are themselves nested within interviewers and areas. We propose the use of a cross-classified mixed-effects location scale model to allow for the decomposition of the joint effects on response times of interviewers, areas, questions, and respondents. We present a new method for producing interviewer specific intra-class correlations (ICCs) of response times and evaluate how interviewer demographic characteristics, personality, and attitudes to surveys and to interviewing affect the length of response latencies and the interviewer-specific ICCs. Hence, the paper makes both methodological and substantive contributions to the investigation of response times.

Text
Paper_Revised_V2_Dec19 - Accepted Manuscript
Download (406kB)

More information

Accepted/In Press date: 24 March 2020
e-pub ahead of print date: 17 June 2020
Published date: 1 September 2021
Keywords: Interviewers, Multilevel model, Personality, Response latency

Identifiers

Local EPrints ID: 438953
URI: http://eprints.soton.ac.uk/id/eprint/438953
ISSN: 2325-0984
PURE UUID: 16a86f81-5701-4f35-854e-a36751705547
ORCID for Patrick Sturgis: ORCID iD orcid.org/0000-0003-1180-3493
ORCID for Olga Maslovskaya: ORCID iD orcid.org/0000-0003-3814-810X
ORCID for Gabriele Durrant: ORCID iD orcid.org/0009-0001-3436-1512

Catalogue record

Date deposited: 30 Mar 2020 16:30
Last modified: 18 May 2024 04:01

Export record

Altmetrics

Contributors

Author: Patrick Sturgis ORCID iD
Author: Ian Brunton-Smith

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×