Strengthening the Reporting of Empirical Simulation Studies: introducing the STRESS guidelines
Strengthening the Reporting of Empirical Simulation Studies: introducing the STRESS guidelines
This study develops a standardised checklist approach to improve the reporting of discrete-event simulation, system dynamics and agent-based simulation models within the field of Operational Research and Management Science. Incomplete or ambiguous reporting means that many simulation studies are not reproducible, leaving other modellers with an incomplete picture of what has been done and unable to judge the reliability of the results. Crucially, unclear reporting makes it difficult to reproduce or reuse findings. In this paper, we review the evidence on the quality of model reporting and consolidate previous work. We derive general good practice principles and three 20-item checklists aimed at Strengthening The Reporting of Empirical Simulation Studies (STRESS): STRESS-DES, STRESS-ABS and STRESS-SD for discrete-event simulation, agent-based simulation and system dynamics respectively. Given the variety of simulation projects, we provide usage and trouble-shooting advice to cover a wide range of situations.
Simulation, Reporting, reproducibility, Discrete-event simulation, agent-based simulation, system dynamics
55-67
Monks, Thomas
fece343c-106d-461d-a1dd-71c1772627ca
Currie, Christine
dcfd0972-1b42-4fac-8a67-0258cfdeb55a
Onggo, Bhakti Stephen
8e9a2ea5-140a-44c0-9c17-e9cf93662f80
Robinson, Stewart
f01867a6-8e27-449d-9c72-6122a7d79960
Kunc, Martin
0b254052-f9f5-49f9-ac0b-148c257ba412
Taylor, Simon S.E.
55046082-7be7-43e4-a7d0-7b1edb596091
2 January 2019
Monks, Thomas
fece343c-106d-461d-a1dd-71c1772627ca
Currie, Christine
dcfd0972-1b42-4fac-8a67-0258cfdeb55a
Onggo, Bhakti Stephen
8e9a2ea5-140a-44c0-9c17-e9cf93662f80
Robinson, Stewart
f01867a6-8e27-449d-9c72-6122a7d79960
Kunc, Martin
0b254052-f9f5-49f9-ac0b-148c257ba412
Taylor, Simon S.E.
55046082-7be7-43e4-a7d0-7b1edb596091
Monks, Thomas, Currie, Christine, Onggo, Bhakti Stephen, Robinson, Stewart, Kunc, Martin and Taylor, Simon S.E.
(2019)
Strengthening the Reporting of Empirical Simulation Studies: introducing the STRESS guidelines.
Journal of Simulation, 13 (1), .
(doi:10.1080/17477778.2018.1442155).
Abstract
This study develops a standardised checklist approach to improve the reporting of discrete-event simulation, system dynamics and agent-based simulation models within the field of Operational Research and Management Science. Incomplete or ambiguous reporting means that many simulation studies are not reproducible, leaving other modellers with an incomplete picture of what has been done and unable to judge the reliability of the results. Crucially, unclear reporting makes it difficult to reproduce or reuse findings. In this paper, we review the evidence on the quality of model reporting and consolidate previous work. We derive general good practice principles and three 20-item checklists aimed at Strengthening The Reporting of Empirical Simulation Studies (STRESS): STRESS-DES, STRESS-ABS and STRESS-SD for discrete-event simulation, agent-based simulation and system dynamics respectively. Given the variety of simulation projects, we provide usage and trouble-shooting advice to cover a wide range of situations.
Text
20180214_STRESS_accepted_manuscript
- Accepted Manuscript
More information
Accepted/In Press date: 14 February 2018
e-pub ahead of print date: 6 March 2018
Published date: 2 January 2019
Keywords:
Simulation, Reporting, reproducibility, Discrete-event simulation, agent-based simulation, system dynamics
Identifiers
Local EPrints ID: 418396
URI: http://eprints.soton.ac.uk/id/eprint/418396
ISSN: 1747-7778
PURE UUID: dd951829-7c29-4930-a1b3-d43fc86ba72d
Catalogue record
Date deposited: 06 Mar 2018 17:30
Last modified: 16 Mar 2024 06:16
Export record
Altmetrics
Contributors
Author:
Thomas Monks
Author:
Stewart Robinson
Author:
Simon S.E. Taylor
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics