Synthesising conceptual frameworks for patient and public involvement in research - a critical appraisal of a meta-narrative review
Synthesising conceptual frameworks for patient and public involvement in research - a critical appraisal of a meta-narrative review
Background: a number of conceptual frameworks for patient and public involvement (PPI) in research have been published in recent years. Although some are based on empirical research and/or existing theory, in many cases the basis of the conceptual frameworks is not evident. In 2015 a systematic review was published by a collaborative review group reporting a meta-narrative approach to synthesise a conceptual framework for PPI in research (hereafter 'the synthesis'). As the first such synthesis it is important to critically scrutinise this meta-narrative review. The 'RAMESES publication standards for meta-narrative reviews' provide a framework for critically appraising published meta-narrative reviews such as this synthesis, although we recognise that these were published concurrently. Thus the primary objective of this research was to appraise this synthesis of conceptual frameworks for PPI in research in order to inform future conceptualisation.
Methods: four researchers critically appraised the synthesis using the RAMESES publication standards as a framework for assessment. Data were extracted independently using a data extraction form closely based on the RAMESES publication standards. Each item from the standards was assessed on a four point scale (0 = unmet, 1 = minimally met, 2 = partly met, 3 = fully met). The four critical appraisals were then compared and any differences resolved through discussion.
Results: a good degree of inter-rater reliability was found. A consensus assessment of the synthesis as a meta-narrative review of PPI conceptual frameworks was achieved with an average of '1' (minimally met) across all 20 items. Two key items ('evidence of adherence to guiding principles of meta-narrative review' and 'analysis and synthesis processes') were both wholly unmet. Therefore the paper did not meet our minimum requirements for a meta-narrative review. We found the RAMESES publication standards were a useful tool for carrying out a critical appraisal although some minor improvements are suggested.
Conclusions: although the aims of the authors' synthesis were commendable, and the conceptual framework presented was coherent and attractive, the paper did not demonstrate a transparent and replicable meta-narrative review approach. There is a continuing need for a more rigorous synthesis of conceptual frameworks for PPI.
Humans, Meta-Analysis as Topic, Patient Participation/statistics & numerical data, Periodicals as Topic/standards, Publications/standards, Research Design/standards, Research Personnel/standards, Research Report/standards, Review Literature as Topic, Systematic Reviews as Topic
Evans, David
30179541-a36b-4fd5-8988-38d59a7a97cd
Hopewell-Kelly, Noreen
a21b7fde-e834-4a1c-8b12-45f61d0e6b8e
Kok, Michele
77531373-1d1d-48fa-b9ea-6f9a8f434804
White, Jo
7d21cc85-9696-4ae3-a076-c8a3313e7e10
25 October 2018
Evans, David
30179541-a36b-4fd5-8988-38d59a7a97cd
Hopewell-Kelly, Noreen
a21b7fde-e834-4a1c-8b12-45f61d0e6b8e
Kok, Michele
77531373-1d1d-48fa-b9ea-6f9a8f434804
White, Jo
7d21cc85-9696-4ae3-a076-c8a3313e7e10
Evans, David, Hopewell-Kelly, Noreen, Kok, Michele and White, Jo
(2018)
Synthesising conceptual frameworks for patient and public involvement in research - a critical appraisal of a meta-narrative review.
BMC Medical Research Methodology, 18 (1), [116].
(doi:10.1186/s12874-018-0572-0).
Abstract
Background: a number of conceptual frameworks for patient and public involvement (PPI) in research have been published in recent years. Although some are based on empirical research and/or existing theory, in many cases the basis of the conceptual frameworks is not evident. In 2015 a systematic review was published by a collaborative review group reporting a meta-narrative approach to synthesise a conceptual framework for PPI in research (hereafter 'the synthesis'). As the first such synthesis it is important to critically scrutinise this meta-narrative review. The 'RAMESES publication standards for meta-narrative reviews' provide a framework for critically appraising published meta-narrative reviews such as this synthesis, although we recognise that these were published concurrently. Thus the primary objective of this research was to appraise this synthesis of conceptual frameworks for PPI in research in order to inform future conceptualisation.
Methods: four researchers critically appraised the synthesis using the RAMESES publication standards as a framework for assessment. Data were extracted independently using a data extraction form closely based on the RAMESES publication standards. Each item from the standards was assessed on a four point scale (0 = unmet, 1 = minimally met, 2 = partly met, 3 = fully met). The four critical appraisals were then compared and any differences resolved through discussion.
Results: a good degree of inter-rater reliability was found. A consensus assessment of the synthesis as a meta-narrative review of PPI conceptual frameworks was achieved with an average of '1' (minimally met) across all 20 items. Two key items ('evidence of adherence to guiding principles of meta-narrative review' and 'analysis and synthesis processes') were both wholly unmet. Therefore the paper did not meet our minimum requirements for a meta-narrative review. We found the RAMESES publication standards were a useful tool for carrying out a critical appraisal although some minor improvements are suggested.
Conclusions: although the aims of the authors' synthesis were commendable, and the conceptual framework presented was coherent and attractive, the paper did not demonstrate a transparent and replicable meta-narrative review approach. There is a continuing need for a more rigorous synthesis of conceptual frameworks for PPI.
Text
s12874-018-0572-0
- Version of Record
More information
Published date: 25 October 2018
Keywords:
Humans, Meta-Analysis as Topic, Patient Participation/statistics & numerical data, Periodicals as Topic/standards, Publications/standards, Research Design/standards, Research Personnel/standards, Research Report/standards, Review Literature as Topic, Systematic Reviews as Topic
Identifiers
Local EPrints ID: 475921
URI: http://eprints.soton.ac.uk/id/eprint/475921
ISSN: 1471-2288
PURE UUID: 135dfb40-7840-4ad3-a343-b806179759fb
Catalogue record
Date deposited: 31 Mar 2023 16:31
Last modified: 17 Mar 2024 01:27
Export record
Altmetrics
Contributors
Author:
David Evans
Author:
Noreen Hopewell-Kelly
Author:
Michele Kok
Author:
Jo White
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics