The University of Southampton
University of Southampton Institutional Repository

Principles and framework for assessing the risk of bias for studies included in comparative quantitative environmental systematic reviews

Principles and framework for assessing the risk of bias for studies included in comparative quantitative environmental systematic reviews
Principles and framework for assessing the risk of bias for studies included in comparative quantitative environmental systematic reviews
Abstract The internal validity of conclusions about effectiveness or impact in systematic reviews, and of decisions based on them, depends on risk of bias assessments being conducted appropriately. However, a random sample of 50 recently-published articles claiming to be quantitative environmental systematic reviews found 64% did not include any risk of bias assessment, whilst nearly all that did omitted key sources of bias. Other limitations included lack of transparency, conflation of quality constructs, and incomplete application of risk of bias assessments to the data synthesis. This paper addresses deficiencies in risk of bias assessments by highlighting core principles that are required for risk of bias assessments to be fit-for-purpose, and presenting a framework based on these principles to guide review teams on conducting risk of bias assessments appropriately and consistently. The core principles require that risk of bias assessments be Focused, Extensive, Applied and Transparent (FEAT). These principles support risk of bias assessments, appraisal of risk of bias tools, and the development of new tools. The framework follows a Plan-Conduct-Apply-Report approach covering all stages of risk of bias assessment. The scope of this paper is comparative quantitative environmental systematic reviews which address PICO or PECO-type questions including, but not limited to, topic areas such as environmental management, conservation, ecosystem restoration, and analyses of environmental interventions, exposures, impacts and risks.
figshare
Frampton, Geoff
26c6163c-3428-45b8-b8b9-92091ff6c69f
Whaley, Paul
bb86f1e0-912a-4bd1-8812-b0f099dfb3c3
Bennett, Micah
9016c8ae-2f81-46a4-8078-d4fb3e0dc47e
Bilotta, Gary
2a2af185-e8e4-4f65-b741-2ebe616d95e7
Dorne, Jean-Lou C. M.
65f58a66-c265-4bb3-81b2-21aae46afcdb
Eales, Jacqualyn
73f0cc40-3f76-4400-a0d6-ae4cf8e2045f
James, Katy
4f7ce27a-9165-42da-8e9b-137ed6ae9dda
Kohl, Christian
6da41716-b2a9-4d24-bd1a-c7997996bf1d
Land, Magnus
c160e05a-c34e-4b9f-8158-e58c03a76b80
Livoreil, Barbara
e6b03480-8c39-4e71-ab81-167b7f416957
Makowski, David
a9a9dea8-81df-445b-9131-4bf1125dc8d8
Muchiri, Evans
a574aadf-2d31-41f5-8bd9-ce87371110e2
Petrokofsky, Gillian
10c2caf2-52dc-4e96-83e9-4094210e7d99
Randall, Nicola
3dbeaa24-1e0e-402a-b8f0-1739e50191c0
Schofield, Kate
cef9f0af-a4c5-454b-929a-11b36bdafcf3
Frampton, Geoff
26c6163c-3428-45b8-b8b9-92091ff6c69f
Whaley, Paul
bb86f1e0-912a-4bd1-8812-b0f099dfb3c3
Bennett, Micah
9016c8ae-2f81-46a4-8078-d4fb3e0dc47e
Bilotta, Gary
2a2af185-e8e4-4f65-b741-2ebe616d95e7
Dorne, Jean-Lou C. M.
65f58a66-c265-4bb3-81b2-21aae46afcdb
Eales, Jacqualyn
73f0cc40-3f76-4400-a0d6-ae4cf8e2045f
James, Katy
4f7ce27a-9165-42da-8e9b-137ed6ae9dda
Kohl, Christian
6da41716-b2a9-4d24-bd1a-c7997996bf1d
Land, Magnus
c160e05a-c34e-4b9f-8158-e58c03a76b80
Livoreil, Barbara
e6b03480-8c39-4e71-ab81-167b7f416957
Makowski, David
a9a9dea8-81df-445b-9131-4bf1125dc8d8
Muchiri, Evans
a574aadf-2d31-41f5-8bd9-ce87371110e2
Petrokofsky, Gillian
10c2caf2-52dc-4e96-83e9-4094210e7d99
Randall, Nicola
3dbeaa24-1e0e-402a-b8f0-1739e50191c0
Schofield, Kate
cef9f0af-a4c5-454b-929a-11b36bdafcf3

(2022) Principles and framework for assessing the risk of bias for studies included in comparative quantitative environmental systematic reviews. figshare doi:10.6084/m9.figshare.c.5921277.v1 [Dataset]

Record type: Dataset

Abstract

Abstract The internal validity of conclusions about effectiveness or impact in systematic reviews, and of decisions based on them, depends on risk of bias assessments being conducted appropriately. However, a random sample of 50 recently-published articles claiming to be quantitative environmental systematic reviews found 64% did not include any risk of bias assessment, whilst nearly all that did omitted key sources of bias. Other limitations included lack of transparency, conflation of quality constructs, and incomplete application of risk of bias assessments to the data synthesis. This paper addresses deficiencies in risk of bias assessments by highlighting core principles that are required for risk of bias assessments to be fit-for-purpose, and presenting a framework based on these principles to guide review teams on conducting risk of bias assessments appropriately and consistently. The core principles require that risk of bias assessments be Focused, Extensive, Applied and Transparent (FEAT). These principles support risk of bias assessments, appraisal of risk of bias tools, and the development of new tools. The framework follows a Plan-Conduct-Apply-Report approach covering all stages of risk of bias assessment. The scope of this paper is comparative quantitative environmental systematic reviews which address PICO or PECO-type questions including, but not limited to, topic areas such as environmental management, conservation, ecosystem restoration, and analyses of environmental interventions, exposures, impacts and risks.

This record has no associated files available for download.

More information

Published date: 20 March 2022

Identifiers

Local EPrints ID: 457240
URI: http://eprints.soton.ac.uk/id/eprint/457240
PURE UUID: c7aa1c53-7f02-41d7-b7dd-04006aee8b55
ORCID for Geoff Frampton: ORCID iD orcid.org/0000-0003-2005-0497

Catalogue record

Date deposited: 27 May 2022 16:32
Last modified: 24 Jan 2024 02:33

Export record

Altmetrics

Contributors

Contributor: Geoff Frampton ORCID iD
Contributor: Paul Whaley
Contributor: Micah Bennett
Contributor: Gary Bilotta
Contributor: Jean-Lou C. M. Dorne
Contributor: Jacqualyn Eales
Contributor: Katy James
Contributor: Christian Kohl
Contributor: Magnus Land
Contributor: Barbara Livoreil
Contributor: David Makowski
Contributor: Evans Muchiri
Contributor: Gillian Petrokofsky
Contributor: Nicola Randall
Contributor: Kate Schofield

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×