To replicate or not to replicate? Exploring reproducibility in economics through the lens of a model and a pilot study
To replicate or not to replicate? Exploring reproducibility in economics through the lens of a model and a pilot study
The sciences are in an era of an alleged ‘credibility crisis.’ In this study, we discuss the reproducibility of received empirical results, focusing on economics research. By combining theory and empirical evidence, we discuss the import of replication studies, and whether they improve our confidence in novel findings. The theory sheds light on the importance of replications, even when replications themselves are subject to research biases. We then report data from a pilot meta-study of replication in the subfield of experimental economics, which serves as a positive benchmark for investigating the credibility of economics. Our meta-study highlights certain difficulties when applying meta-research and systematizing the economics literature.
F209-F235
Maniadis, Zacharias
70ffa309-94c9-487c-982f-778294ea2a13
Tufano, Fabio
d6d913fd-25eb-4195-a832-f1ec5b6fc6c9
List, John
64b929c2-04dd-46df-bd9e-738c6fd325a4
October 2017
Maniadis, Zacharias
70ffa309-94c9-487c-982f-778294ea2a13
Tufano, Fabio
d6d913fd-25eb-4195-a832-f1ec5b6fc6c9
List, John
64b929c2-04dd-46df-bd9e-738c6fd325a4
Maniadis, Zacharias, Tufano, Fabio and List, John
(2017)
To replicate or not to replicate? Exploring reproducibility in economics through the lens of a model and a pilot study.
The Economic Journal, 127 (605), .
(doi:10.1111/ecoj.12527).
Abstract
The sciences are in an era of an alleged ‘credibility crisis.’ In this study, we discuss the reproducibility of received empirical results, focusing on economics research. By combining theory and empirical evidence, we discuss the import of replication studies, and whether they improve our confidence in novel findings. The theory sheds light on the importance of replications, even when replications themselves are subject to research biases. We then report data from a pilot meta-study of replication in the subfield of experimental economics, which serves as a positive benchmark for investigating the credibility of economics. Our meta-study highlights certain difficulties when applying meta-research and systematizing the economics literature.
Text
To Replicate or Not To Replicate
- Accepted Manuscript
More information
Accepted/In Press date: 9 March 2017
e-pub ahead of print date: 24 October 2017
Published date: October 2017
Organisations:
Economics
Identifiers
Local EPrints ID: 410391
URI: http://eprints.soton.ac.uk/id/eprint/410391
ISSN: 0013-0133
PURE UUID: 23702d4d-9529-49f8-b3d1-6b156af55480
Catalogue record
Date deposited: 07 Jun 2017 16:31
Last modified: 16 Mar 2024 05:18
Export record
Altmetrics
Contributors
Author:
Fabio Tufano
Author:
John List
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics
