Crisis, what crisis - Does reproducibility in modeling & simulation really matter?
Crisis, what crisis - Does reproducibility in modeling & simulation really matter?
How important it is to our discipline that we can reproduce the results of Modeling & Simulation (M&S) research? How important is it to be able to (re)use the models, data, and methods described in simulation publications to reproduce published results? Is it really that important or are the lessons and experiences described in a paper enough for us to build on the work of others? At the 2016 Winter Simulation Conference, a panel considered opinions on reproducibility in discrete-event simulation. This article builds on these and asks if there really is a reproducibility crisis in M&S? A diverse range of views on the subject are presented including reflections on the reproducibility in terms of the art and science of simulation, the frustrations of poor reproducibility, perspectives from the industrial production & logistics community, the wider context of open science and artefact sharing, and the role of provenance beyond reproducibility.
749-762
Taylor, Simon J.E.
c021bfb3-41b8-4da5-8fd2-1d10404234dd
Eldabi, Tillal
4a523ddc-f393-4362-a291-268e11c96805
Monks, Thomas
fece343c-106d-461d-a1dd-71c1772627ca
Rabe, Markus
7562c7f4-1bd9-4ce0-ab3b-b6585204d4a1
Uhrmacher, Adelinde M.
4fa04994-ea2b-4a1a-bf1e-5e7897359d28
4 February 2019
Taylor, Simon J.E.
c021bfb3-41b8-4da5-8fd2-1d10404234dd
Eldabi, Tillal
4a523ddc-f393-4362-a291-268e11c96805
Monks, Thomas
fece343c-106d-461d-a1dd-71c1772627ca
Rabe, Markus
7562c7f4-1bd9-4ce0-ab3b-b6585204d4a1
Uhrmacher, Adelinde M.
4fa04994-ea2b-4a1a-bf1e-5e7897359d28
Taylor, Simon J.E., Eldabi, Tillal, Monks, Thomas, Rabe, Markus and Uhrmacher, Adelinde M.
(2019)
Crisis, what crisis - Does reproducibility in modeling & simulation really matter?
In 2018 Winter Simulation Conference (WSC).
vol. 2018-December,
IEEE.
.
(doi:10.1109/WSC.2018.8632232).
Record type:
Conference or Workshop Item
(Paper)
Abstract
How important it is to our discipline that we can reproduce the results of Modeling & Simulation (M&S) research? How important is it to be able to (re)use the models, data, and methods described in simulation publications to reproduce published results? Is it really that important or are the lessons and experiences described in a paper enough for us to build on the work of others? At the 2016 Winter Simulation Conference, a panel considered opinions on reproducibility in discrete-event simulation. This article builds on these and asks if there really is a reproducibility crisis in M&S? A diverse range of views on the subject are presented including reflections on the reproducibility in terms of the art and science of simulation, the frustrations of poor reproducibility, perspectives from the industrial production & logistics community, the wider context of open science and artefact sharing, and the role of provenance beyond reproducibility.
This record has no associated files available for download.
More information
e-pub ahead of print date: December 2018
Published date: 4 February 2019
Venue - Dates:
WSC 2018 Winter Simulation Conference: Simulation for a Noble Cause, , Gothenburg, Sweden, 2018-12-09 - 2018-12-12
Identifiers
Local EPrints ID: 430117
URI: http://eprints.soton.ac.uk/id/eprint/430117
PURE UUID: 1543747d-5c9f-4a3c-88b1-f2969cd980bf
Catalogue record
Date deposited: 12 Apr 2019 16:30
Last modified: 16 Mar 2024 01:25
Export record
Altmetrics
Contributors
Author:
Simon J.E. Taylor
Author:
Tillal Eldabi
Author:
Thomas Monks
Author:
Markus Rabe
Author:
Adelinde M. Uhrmacher
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics