The University of Southampton
University of Southampton Institutional Repository

Large-scale high-quality surveys without field interviewers in the UK: an evidence review

Large-scale high-quality surveys without field interviewers in the UK: an evidence review
Large-scale high-quality surveys without field interviewers in the UK: an evidence review
Relevance & research question: data collection organisations are shifting toward new approaches, with social surveys undergoing significant design and implementation changes. Since the COVID-19 pandemic, agencies have increasingly moved to online data collection due to dwindling response rates and rising fieldwork costs. A key challenge for self-completion general population surveys is the absence of field interviewers to facilitate recruitment and participant retention. This research examines the UK survey landscape, aiming to identify recruitment methods for self-administered surveys, that can produce more representative samples of the general population.

Methods & data: we present findings from an information request sent to the UK’s nine most important survey agencies. We collected information on surveys without field interviewers conducted between 2018 and early 2024, including publicly available technical and methodological reports and other survey materials, along with internal reports provided by the agencies. We processed and codified this information, building a spreadsheet containing 144 instances of 59 longitudinal and cross-sectional surveys, along with 227 communication materials.

Results: the responses for the surveys in our dataset use 57% online, 38% paper, and 5% telephone modes. Most surveys (84%) offer incentives to participants, with 92% being monetary and only 33% given unconditionally. Response rates vary widely – household-based cross-sectional surveys tend to have lower response rates (81% at 30% response or lower) than individual-based ones (47% at 30% or lower). Longitudinal surveys generally have the highest response rates. While only 35% of reports assess sample representativeness, the general trend confirms that mixed-mode surveys yield more representative samples than single-mode surveys.

Added value: to our knowledge, this review is the first coordinated effort to collate and summarise recruitment strategies for surveys without field interviewers in the UK. It covers sampling design, communication strategies and materials, incentivisation, fieldwork procedures, response rates, and report quality assessments. Our dataset provides insights into the current state of survey practice and helps identifying practices that might contribute towards higher response rates and sample representativeness.
online surveys, self-completion surveys, response rates, survey recruitment, survey incentives
Domarchi, Cristian
12770dd9-ec99-4d57-acfc-4ca745b63f07
Maslovskaya, Olga
b385d46a-7b0f-40f2-866c-5fe70959c19e
Lynn, Peter
bd2d1d02-1a66-4454-bc04-175aec4886a0
Ndebele, Nhlanhla
648c518e-d253-4a6c-91e4-9751ce485999
Fitzgerald, Roy
b099b728-fc27-4c8e-bc34-99d6d40c829d
Comanaru, Ruxandra
0871c83b-46e9-4786-9e09-cdaa75aeb0dc
Domarchi, Cristian
12770dd9-ec99-4d57-acfc-4ca745b63f07
Maslovskaya, Olga
b385d46a-7b0f-40f2-866c-5fe70959c19e
Lynn, Peter
bd2d1d02-1a66-4454-bc04-175aec4886a0
Ndebele, Nhlanhla
648c518e-d253-4a6c-91e4-9751ce485999
Fitzgerald, Roy
b099b728-fc27-4c8e-bc34-99d6d40c829d
Comanaru, Ruxandra
0871c83b-46e9-4786-9e09-cdaa75aeb0dc

Domarchi, Cristian, Maslovskaya, Olga, Lynn, Peter, Ndebele, Nhlanhla, Fitzgerald, Roy and Comanaru, Ruxandra (2025) Large-scale high-quality surveys without field interviewers in the UK: an evidence review. The 27th General Online Research Conference, Freie Universität Berlin, Berlin, Germany. 31 Mar - 02 Apr 2025.

Record type: Conference or Workshop Item (Paper)

Abstract

Relevance & research question: data collection organisations are shifting toward new approaches, with social surveys undergoing significant design and implementation changes. Since the COVID-19 pandemic, agencies have increasingly moved to online data collection due to dwindling response rates and rising fieldwork costs. A key challenge for self-completion general population surveys is the absence of field interviewers to facilitate recruitment and participant retention. This research examines the UK survey landscape, aiming to identify recruitment methods for self-administered surveys, that can produce more representative samples of the general population.

Methods & data: we present findings from an information request sent to the UK’s nine most important survey agencies. We collected information on surveys without field interviewers conducted between 2018 and early 2024, including publicly available technical and methodological reports and other survey materials, along with internal reports provided by the agencies. We processed and codified this information, building a spreadsheet containing 144 instances of 59 longitudinal and cross-sectional surveys, along with 227 communication materials.

Results: the responses for the surveys in our dataset use 57% online, 38% paper, and 5% telephone modes. Most surveys (84%) offer incentives to participants, with 92% being monetary and only 33% given unconditionally. Response rates vary widely – household-based cross-sectional surveys tend to have lower response rates (81% at 30% response or lower) than individual-based ones (47% at 30% or lower). Longitudinal surveys generally have the highest response rates. While only 35% of reports assess sample representativeness, the general trend confirms that mixed-mode surveys yield more representative samples than single-mode surveys.

Added value: to our knowledge, this review is the first coordinated effort to collate and summarise recruitment strategies for surveys without field interviewers in the UK. It covers sampling design, communication strategies and materials, incentivisation, fieldwork procedures, response rates, and report quality assessments. Our dataset provides insights into the current state of survey practice and helps identifying practices that might contribute towards higher response rates and sample representativeness.

This record has no associated files available for download.

More information

Published date: 1 April 2025
Venue - Dates: The 27th General Online Research Conference, Freie Universität Berlin, Berlin, Germany, 2025-03-31 - 2025-04-02
Keywords: online surveys, self-completion surveys, response rates, survey recruitment, survey incentives

Identifiers

Local EPrints ID: 500611
URI: http://eprints.soton.ac.uk/id/eprint/500611
PURE UUID: 86d68d8f-e5be-46ac-82b9-44ccb1b0a4b1
ORCID for Cristian Domarchi: ORCID iD orcid.org/0000-0002-9068-704X

Catalogue record

Date deposited: 07 May 2025 16:35
Last modified: 08 May 2025 02:13

Export record

Contributors

Author: Cristian Domarchi ORCID iD
Author: Olga Maslovskaya
Author: Peter Lynn
Author: Nhlanhla Ndebele
Author: Roy Fitzgerald
Author: Ruxandra Comanaru

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×