Large-scale high-quality surveys without field interviewers in the UK: an evidence review
Large-scale high-quality surveys without field interviewers in the UK: an evidence review
Relevance & research question: data collection organisations are shifting toward new approaches, with social surveys undergoing significant design and implementation changes. Since the COVID-19 pandemic, agencies have increasingly moved to online data collection due to dwindling response rates and rising fieldwork costs. A key challenge for self-completion general population surveys is the absence of field interviewers to facilitate recruitment and participant retention. This research examines the UK survey landscape, aiming to identify recruitment methods for self-administered surveys, that can produce more representative samples of the general population.
Methods & data: we present findings from an information request sent to the UK’s nine most important survey agencies. We collected information on surveys without field interviewers conducted between 2018 and early 2024, including publicly available technical and methodological reports and other survey materials, along with internal reports provided by the agencies. We processed and codified this information, building a spreadsheet containing 144 instances of 59 longitudinal and cross-sectional surveys, along with 227 communication materials.
Results: the responses for the surveys in our dataset use 57% online, 38% paper, and 5% telephone modes. Most surveys (84%) offer incentives to participants, with 92% being monetary and only 33% given unconditionally. Response rates vary widely – household-based cross-sectional surveys tend to have lower response rates (81% at 30% response or lower) than individual-based ones (47% at 30% or lower). Longitudinal surveys generally have the highest response rates. While only 35% of reports assess sample representativeness, the general trend confirms that mixed-mode surveys yield more representative samples than single-mode surveys.
Added value: to our knowledge, this review is the first coordinated effort to collate and summarise recruitment strategies for surveys without field interviewers in the UK. It covers sampling design, communication strategies and materials, incentivisation, fieldwork procedures, response rates, and report quality assessments. Our dataset provides insights into the current state of survey practice and helps identifying practices that might contribute towards higher response rates and sample representativeness.
online surveys, self-completion surveys, response rates, survey recruitment, survey incentives
Domarchi, Cristian
12770dd9-ec99-4d57-acfc-4ca745b63f07
Maslovskaya, Olga
b385d46a-7b0f-40f2-866c-5fe70959c19e
Lynn, Peter
bd2d1d02-1a66-4454-bc04-175aec4886a0
Ndebele, Nhlanhla
648c518e-d253-4a6c-91e4-9751ce485999
Fitzgerald, Roy
b099b728-fc27-4c8e-bc34-99d6d40c829d
Comanaru, Ruxandra
0871c83b-46e9-4786-9e09-cdaa75aeb0dc
1 April 2025
Domarchi, Cristian
12770dd9-ec99-4d57-acfc-4ca745b63f07
Maslovskaya, Olga
b385d46a-7b0f-40f2-866c-5fe70959c19e
Lynn, Peter
bd2d1d02-1a66-4454-bc04-175aec4886a0
Ndebele, Nhlanhla
648c518e-d253-4a6c-91e4-9751ce485999
Fitzgerald, Roy
b099b728-fc27-4c8e-bc34-99d6d40c829d
Comanaru, Ruxandra
0871c83b-46e9-4786-9e09-cdaa75aeb0dc
Domarchi, Cristian, Maslovskaya, Olga, Lynn, Peter, Ndebele, Nhlanhla, Fitzgerald, Roy and Comanaru, Ruxandra
(2025)
Large-scale high-quality surveys without field interviewers in the UK: an evidence review.
The 27th General Online Research Conference, Freie Universität Berlin, Berlin, Germany.
31 Mar - 02 Apr 2025.
Record type:
Conference or Workshop Item
(Paper)
Abstract
Relevance & research question: data collection organisations are shifting toward new approaches, with social surveys undergoing significant design and implementation changes. Since the COVID-19 pandemic, agencies have increasingly moved to online data collection due to dwindling response rates and rising fieldwork costs. A key challenge for self-completion general population surveys is the absence of field interviewers to facilitate recruitment and participant retention. This research examines the UK survey landscape, aiming to identify recruitment methods for self-administered surveys, that can produce more representative samples of the general population.
Methods & data: we present findings from an information request sent to the UK’s nine most important survey agencies. We collected information on surveys without field interviewers conducted between 2018 and early 2024, including publicly available technical and methodological reports and other survey materials, along with internal reports provided by the agencies. We processed and codified this information, building a spreadsheet containing 144 instances of 59 longitudinal and cross-sectional surveys, along with 227 communication materials.
Results: the responses for the surveys in our dataset use 57% online, 38% paper, and 5% telephone modes. Most surveys (84%) offer incentives to participants, with 92% being monetary and only 33% given unconditionally. Response rates vary widely – household-based cross-sectional surveys tend to have lower response rates (81% at 30% response or lower) than individual-based ones (47% at 30% or lower). Longitudinal surveys generally have the highest response rates. While only 35% of reports assess sample representativeness, the general trend confirms that mixed-mode surveys yield more representative samples than single-mode surveys.
Added value: to our knowledge, this review is the first coordinated effort to collate and summarise recruitment strategies for surveys without field interviewers in the UK. It covers sampling design, communication strategies and materials, incentivisation, fieldwork procedures, response rates, and report quality assessments. Our dataset provides insights into the current state of survey practice and helps identifying practices that might contribute towards higher response rates and sample representativeness.
This record has no associated files available for download.
More information
Published date: 1 April 2025
Venue - Dates:
The 27th General Online Research Conference, Freie Universität Berlin, Berlin, Germany, 2025-03-31 - 2025-04-02
Keywords:
online surveys, self-completion surveys, response rates, survey recruitment, survey incentives
Identifiers
Local EPrints ID: 500611
URI: http://eprints.soton.ac.uk/id/eprint/500611
PURE UUID: 86d68d8f-e5be-46ac-82b9-44ccb1b0a4b1
Catalogue record
Date deposited: 07 May 2025 16:35
Last modified: 08 May 2025 02:13
Export record
Contributors
Author:
Cristian Domarchi
Author:
Olga Maslovskaya
Author:
Peter Lynn
Author:
Nhlanhla Ndebele
Author:
Roy Fitzgerald
Author:
Ruxandra Comanaru
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics