Blinding of study statisticians in clinical trials: a qualitative study in UK clinical trials units
Blinding of study statisticians in clinical trials: a qualitative study in UK clinical trials units
Background: Blinding is an established approach in clinical trials which aims to minimise the risk of performance and detection bias. There is little empirical evidence to guide UK clinical trials units (CTUs) about the practice of blinding statisticians. Guidelines recommend that statisticians remain blinded to allocation prior to the final analysis. As these guidelines are not based on empirical evidence, this study undertook a qualitative investigation relating to when and how statisticians should be blinded in clinical trials.
Methods: Data were collected through online focus groups with various stakeholders who work in the delivery and oversight of clinical trials. Recordings of the focus groups were transcribed verbatim and thematic analysis was used to analyse the transcripts.
Results: Thirty-seven participants from 19 CTUs participated in one of six focus groups. Four main themes were identified, namely statistical models of work, factors affecting the decision to blind statisticians, benefits of blinding/not blinding statisticians and practicalities. Factors influencing the decision to blind the statistician included available resources, study design and types of intervention and outcomes and analysis. Although blinding of the statistician is perceived as a desirable mitigation against bias, there was uncertainty about the extent to which an unblinded statistician might impart bias. Instead, in most cases, the insight that the statistician offers was deemed more important to delivery of a trial than the risk of bias they may introduce if unblinded. Blinding of statisticians was only considered achievable with the appropriate resource and staffing, which were not always available. In many cases, a standard approach to blinding was therefore considered unrealistic and impractical; hence the need for a proportionate risk assessment approach identifying possible mitigations.
Conclusions: There was wide variation in practice between UK CTUs regarding the blinding of trial statisticians. A risk assessment approach would enable CTUs to identify risks associated with unblinded statisticians conducting the final analysis and alternative mitigation strategies. The findings of this study will be used to design guidance and a tool to support this risk assessment process.
Blinding, Clinical trials, Clinical trials unit, Focus groups, Qualitative, Statisticians
Iflaifel, Mais
fd3696c4-894f-4c86-86b8-e1f0cd8a9450
Partlett, Christopher
ff1ea90b-5254-4a96-809a-14d05b13a0d7
Bell, Jennifer
73c6580c-6ba7-4e7c-8356-07e35e919a6d
Cook, Andrew
ab9c7bb3-974a-4db9-b3c2-9942988005d5
Gamble, Carrol
6d685bb2-1ec5-4e38-a8d4-3cf6f6e625ac
Julious, Steven
f43c38eb-8aaa-4f4c-a770-a68bc2321360
Juszczak, Edmund
9267758e-8ab8-44c7-ab14-48ef82fa6b6e
Linsell, Louise
bf220517-49cd-4fbb-8666-19d2a1de1257
Montgomery, Alan
4c3f57b5-cda7-45f9-a4ff-1c8075b61855
Sprange, Kirsty
2cb158fb-b2c5-45c9-9de6-423b8f64b888
27 June 2022
Iflaifel, Mais
fd3696c4-894f-4c86-86b8-e1f0cd8a9450
Partlett, Christopher
ff1ea90b-5254-4a96-809a-14d05b13a0d7
Bell, Jennifer
73c6580c-6ba7-4e7c-8356-07e35e919a6d
Cook, Andrew
ab9c7bb3-974a-4db9-b3c2-9942988005d5
Gamble, Carrol
6d685bb2-1ec5-4e38-a8d4-3cf6f6e625ac
Julious, Steven
f43c38eb-8aaa-4f4c-a770-a68bc2321360
Juszczak, Edmund
9267758e-8ab8-44c7-ab14-48ef82fa6b6e
Linsell, Louise
bf220517-49cd-4fbb-8666-19d2a1de1257
Montgomery, Alan
4c3f57b5-cda7-45f9-a4ff-1c8075b61855
Sprange, Kirsty
2cb158fb-b2c5-45c9-9de6-423b8f64b888
Iflaifel, Mais, Partlett, Christopher, Bell, Jennifer, Cook, Andrew, Gamble, Carrol, Julious, Steven, Juszczak, Edmund, Linsell, Louise, Montgomery, Alan and Sprange, Kirsty
(2022)
Blinding of study statisticians in clinical trials: a qualitative study in UK clinical trials units.
Trials, 23 (1), [535].
(doi:10.1186/s13063-022-06481-9).
Abstract
Background: Blinding is an established approach in clinical trials which aims to minimise the risk of performance and detection bias. There is little empirical evidence to guide UK clinical trials units (CTUs) about the practice of blinding statisticians. Guidelines recommend that statisticians remain blinded to allocation prior to the final analysis. As these guidelines are not based on empirical evidence, this study undertook a qualitative investigation relating to when and how statisticians should be blinded in clinical trials.
Methods: Data were collected through online focus groups with various stakeholders who work in the delivery and oversight of clinical trials. Recordings of the focus groups were transcribed verbatim and thematic analysis was used to analyse the transcripts.
Results: Thirty-seven participants from 19 CTUs participated in one of six focus groups. Four main themes were identified, namely statistical models of work, factors affecting the decision to blind statisticians, benefits of blinding/not blinding statisticians and practicalities. Factors influencing the decision to blind the statistician included available resources, study design and types of intervention and outcomes and analysis. Although blinding of the statistician is perceived as a desirable mitigation against bias, there was uncertainty about the extent to which an unblinded statistician might impart bias. Instead, in most cases, the insight that the statistician offers was deemed more important to delivery of a trial than the risk of bias they may introduce if unblinded. Blinding of statisticians was only considered achievable with the appropriate resource and staffing, which were not always available. In many cases, a standard approach to blinding was therefore considered unrealistic and impractical; hence the need for a proportionate risk assessment approach identifying possible mitigations.
Conclusions: There was wide variation in practice between UK CTUs regarding the blinding of trial statisticians. A risk assessment approach would enable CTUs to identify risks associated with unblinded statisticians conducting the final analysis and alternative mitigation strategies. The findings of this study will be used to design guidance and a tool to support this risk assessment process.
This record has no associated files available for download.
More information
Published date: 27 June 2022
Additional Information:
Funding Information:
This project is funded by the National Institute for Health Research (NIHR) CTU Support Funding scheme. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
Publisher Copyright:
© 2022, The Author(s).
Keywords:
Blinding, Clinical trials, Clinical trials unit, Focus groups, Qualitative, Statisticians
Identifiers
Local EPrints ID: 468453
URI: http://eprints.soton.ac.uk/id/eprint/468453
ISSN: 1745-6215
PURE UUID: e12d4c45-d800-4247-9ba9-cd3f869ebf7a
Catalogue record
Date deposited: 15 Aug 2022 17:03
Last modified: 18 Mar 2024 03:03
Export record
Altmetrics
Contributors
Author:
Mais Iflaifel
Author:
Christopher Partlett
Author:
Jennifer Bell
Author:
Carrol Gamble
Author:
Steven Julious
Author:
Edmund Juszczak
Author:
Louise Linsell
Author:
Alan Montgomery
Author:
Kirsty Sprange
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics