The University of Southampton
University of Southampton Institutional Repository

Strengthening the Reporting of Empirical Simulation Studies: introducing the STRESS guidelines

Strengthening the Reporting of Empirical Simulation Studies: introducing the STRESS guidelines
Strengthening the Reporting of Empirical Simulation Studies: introducing the STRESS guidelines
This study develops a standardised checklist approach to improve the reporting of discrete-event simulation, system dynamics and agent-based simulation models within the field of Operational Research and Management Science. Incomplete or ambiguous reporting means that many simulation studies are not reproducible, leaving other modellers with an incomplete picture of what has been done and unable to judge the reliability of the results. Crucially, unclear reporting makes it difficult to reproduce or reuse findings. In this paper, we review the evidence on the quality of model reporting and consolidate previous work. We derive general good practice principles and three 20-item checklists aimed at Strengthening The Reporting of Empirical Simulation Studies (STRESS): STRESS-DES, STRESS-ABS and STRESS-SD for discrete-event simulation, agent-based simulation and system dynamics respectively. Given the variety of simulation projects, we provide usage and trouble-shooting advice to cover a wide range of situations.
Simulation, Reporting, reproducibility, Discrete-event simulation, agent-based simulation, system dynamics
1747-7778
55-67
Monks, Thomas
fece343c-106d-461d-a1dd-71c1772627ca
Currie, Christine
dcfd0972-1b42-4fac-8a67-0258cfdeb55a
Onggo, Bhakti Stephen
8e9a2ea5-140a-44c0-9c17-e9cf93662f80
Robinson, Stewart
f01867a6-8e27-449d-9c72-6122a7d79960
Kunc, Martin
0b254052-f9f5-49f9-ac0b-148c257ba412
Taylor, Simon S.E.
55046082-7be7-43e4-a7d0-7b1edb596091
Monks, Thomas
fece343c-106d-461d-a1dd-71c1772627ca
Currie, Christine
dcfd0972-1b42-4fac-8a67-0258cfdeb55a
Onggo, Bhakti Stephen
8e9a2ea5-140a-44c0-9c17-e9cf93662f80
Robinson, Stewart
f01867a6-8e27-449d-9c72-6122a7d79960
Kunc, Martin
0b254052-f9f5-49f9-ac0b-148c257ba412
Taylor, Simon S.E.
55046082-7be7-43e4-a7d0-7b1edb596091

Monks, Thomas, Currie, Christine, Onggo, Bhakti Stephen, Robinson, Stewart, Kunc, Martin and Taylor, Simon S.E. (2019) Strengthening the Reporting of Empirical Simulation Studies: introducing the STRESS guidelines. Journal of Simulation, 13 (1), 55-67. (doi:10.1080/17477778.2018.1442155).

Record type: Article

Abstract

This study develops a standardised checklist approach to improve the reporting of discrete-event simulation, system dynamics and agent-based simulation models within the field of Operational Research and Management Science. Incomplete or ambiguous reporting means that many simulation studies are not reproducible, leaving other modellers with an incomplete picture of what has been done and unable to judge the reliability of the results. Crucially, unclear reporting makes it difficult to reproduce or reuse findings. In this paper, we review the evidence on the quality of model reporting and consolidate previous work. We derive general good practice principles and three 20-item checklists aimed at Strengthening The Reporting of Empirical Simulation Studies (STRESS): STRESS-DES, STRESS-ABS and STRESS-SD for discrete-event simulation, agent-based simulation and system dynamics respectively. Given the variety of simulation projects, we provide usage and trouble-shooting advice to cover a wide range of situations.

Text
20180214_STRESS_accepted_manuscript - Accepted Manuscript
Download (373kB)
Text
STRESS_DES_v1
Restricted to Repository staff only
Request a copy
Text
STRESS_SD_v1
Restricted to Repository staff only
Request a copy
Text
STRESS_ABS_v1
Restricted to Repository staff only
Request a copy

More information

Accepted/In Press date: 14 February 2018
e-pub ahead of print date: 6 March 2018
Published date: 2 January 2019
Keywords: Simulation, Reporting, reproducibility, Discrete-event simulation, agent-based simulation, system dynamics

Identifiers

Local EPrints ID: 418396
URI: http://eprints.soton.ac.uk/id/eprint/418396
ISSN: 1747-7778
PURE UUID: dd951829-7c29-4930-a1b3-d43fc86ba72d
ORCID for Thomas Monks: ORCID iD orcid.org/0000-0003-2631-4481
ORCID for Christine Currie: ORCID iD orcid.org/0000-0002-7016-3652
ORCID for Bhakti Stephen Onggo: ORCID iD orcid.org/0000-0001-5899-304X
ORCID for Martin Kunc: ORCID iD orcid.org/0000-0002-3411-4052

Catalogue record

Date deposited: 06 Mar 2018 17:30
Last modified: 16 Mar 2024 06:16

Export record

Altmetrics

Contributors

Author: Thomas Monks ORCID iD
Author: Stewart Robinson
Author: Martin Kunc ORCID iD
Author: Simon S.E. Taylor

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×