The University of Southampton
University of Southampton Institutional Repository

Calculation of confidence Intervals for simulation output

Calculation of confidence Intervals for simulation output
Calculation of confidence Intervals for simulation output
This article is concerned with the calculation of confidence intervals for simulation output that is dependent on two sources of variability. One, referred to as <i>simulation variability</i>, arises from the use of random numbers in the simulation itself; and the other, referred to as <i>parameter variability</i>, arises when the input parameters are unknown and have to be estimated from observed data.
Three approaches to the calculation of confidence intervals are presented--the traditional asymptotic normality theory approach, a bootstrap approach and a new method which produces a conservative approximation based on performing just two simulation runs at carefully selected parameter settings. It is demonstrated that the traditional and bootstrap approaches provide similar degrees of accuracy and that whilst the new method may sometimes be very conservative, it can be calculated in a small fraction of the computational time of the exact methods.

?-method, parameter variability, simulation variability, two-point method, uncertainty analysis
1049-3301
344-362
Cheng, R.C.H.
a4296b4e-7693-4e5f-b3d5-27b617bb9d67
Holl, W.
324d23ab-8386-4cd2-b65a-187d0fcff7a0
Cheng, R.C.H.
a4296b4e-7693-4e5f-b3d5-27b617bb9d67
Holl, W.
324d23ab-8386-4cd2-b65a-187d0fcff7a0

Cheng, R.C.H. and Holl, W. (2004) Calculation of confidence Intervals for simulation output. ACM Transactions on Modeling and Computer Simulation, 14 (4), 344-362.

Record type: Article

Abstract

This article is concerned with the calculation of confidence intervals for simulation output that is dependent on two sources of variability. One, referred to as <i>simulation variability</i>, arises from the use of random numbers in the simulation itself; and the other, referred to as <i>parameter variability</i>, arises when the input parameters are unknown and have to be estimated from observed data.
Three approaches to the calculation of confidence intervals are presented--the traditional asymptotic normality theory approach, a bootstrap approach and a new method which produces a conservative approximation based on performing just two simulation runs at carefully selected parameter settings. It is demonstrated that the traditional and bootstrap approaches provide similar degrees of accuracy and that whilst the new method may sometimes be very conservative, it can be calculated in a small fraction of the computational time of the exact methods.

This record has no associated files available for download.

More information

Published date: 2004
Keywords: ?-method, parameter variability, simulation variability, two-point method, uncertainty analysis
Organisations: Operational Research

Identifiers

Local EPrints ID: 29729
URI: http://eprints.soton.ac.uk/id/eprint/29729
ISSN: 1049-3301
PURE UUID: 10c271ab-4e76-4b41-84e2-04a5aff41c07

Catalogue record

Date deposited: 12 May 2006
Last modified: 07 Jan 2022 22:23

Export record

Contributors

Author: R.C.H. Cheng
Author: W. Holl

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×