Can you repeat that?: Exploring the definition of a successful model replication in health economics
Can you repeat that?: Exploring the definition of a successful model replication in health economics
The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) modelling taskforce suggests decision models should be thoroughly reported and transparent. However, the level of transparency and indeed how transparency should be assessed are yet to be defined. One way may be to attempt to replicate the model and its outputs. The ability to replicate a decision model could demonstrate adequate reporting transparency. This review aims to explore published definitions of replication success across all scientific disciplines and to consider how such a definition should be tailored for use in health economic models. A literature review was conducted to identify published definitions of a 'successful replication'. Using these as a foundation, several definitions of replication success were constructed, to be applicable to replications of economic decision models, with the associated strengths and weaknesses of such definitions discussed. A substantial body of literature discussing replicability was found; however, relatively few studies, ten, explicitly defined a successful replication. These definitions varied from subjective assessments to expecting exactly the same results to be reproduced. Whilst the definitions that have been found may help to construct a definition specific to health economics, no definition was found that completely encompassed the unique requirements for decision models. Replication is widely discussed in other scientific disciplines; however, as of yet, there is no consensus on how replicable models should be within health economics or what constitutes a successful replication. Replication studies can demonstrate how transparently a model is reported, identify potential calculation errors and inform future reporting practices. It may therefore be a useful adjunct to other transparency or quality measures.
Decision Support Techniques, Economics, Medical, Economics, Pharmaceutical, Humans, Models, Economic, Outcome Assessment, Health Care, Reproducibility of Results
1371-1381
McManus, Emma
f04f4622-5b27-41f6-ae69-c4a24b9b87f5
Turner, David
407ea6bc-44cc-4afd-927d-ea953190e60a
Sach, Tracey
5c09256f-ebed-4d14-853a-181f6c92d6f2
18 September 2019
McManus, Emma
f04f4622-5b27-41f6-ae69-c4a24b9b87f5
Turner, David
407ea6bc-44cc-4afd-927d-ea953190e60a
Sach, Tracey
5c09256f-ebed-4d14-853a-181f6c92d6f2
McManus, Emma, Turner, David and Sach, Tracey
(2019)
Can you repeat that?: Exploring the definition of a successful model replication in health economics.
PharmacoEconomics, 37 (11), .
(doi:10.1007/s40273-019-00836-y).
Abstract
The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) modelling taskforce suggests decision models should be thoroughly reported and transparent. However, the level of transparency and indeed how transparency should be assessed are yet to be defined. One way may be to attempt to replicate the model and its outputs. The ability to replicate a decision model could demonstrate adequate reporting transparency. This review aims to explore published definitions of replication success across all scientific disciplines and to consider how such a definition should be tailored for use in health economic models. A literature review was conducted to identify published definitions of a 'successful replication'. Using these as a foundation, several definitions of replication success were constructed, to be applicable to replications of economic decision models, with the associated strengths and weaknesses of such definitions discussed. A substantial body of literature discussing replicability was found; however, relatively few studies, ten, explicitly defined a successful replication. These definitions varied from subjective assessments to expecting exactly the same results to be reproduced. Whilst the definitions that have been found may help to construct a definition specific to health economics, no definition was found that completely encompassed the unique requirements for decision models. Replication is widely discussed in other scientific disciplines; however, as of yet, there is no consensus on how replicable models should be within health economics or what constitutes a successful replication. Replication studies can demonstrate how transparently a model is reported, identify potential calculation errors and inform future reporting practices. It may therefore be a useful adjunct to other transparency or quality measures.
This record has no associated files available for download.
More information
Published date: 18 September 2019
Keywords:
Decision Support Techniques, Economics, Medical, Economics, Pharmaceutical, Humans, Models, Economic, Outcome Assessment, Health Care, Reproducibility of Results
Identifiers
Local EPrints ID: 480883
URI: http://eprints.soton.ac.uk/id/eprint/480883
ISSN: 1170-7690
PURE UUID: acfc2486-a736-4f9d-ad31-97b25058a8e9
Catalogue record
Date deposited: 10 Aug 2023 16:41
Last modified: 17 Mar 2024 04:20
Export record
Altmetrics
Contributors
Author:
Emma McManus
Author:
David Turner
Author:
Tracey Sach
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics