The University of Southampton
University of Southampton Institutional Repository

Convergence rates for a class of estimators based on Stein’s method

Convergence rates for a class of estimators based on Stein’s method
Convergence rates for a class of estimators based on Stein’s method
Gradient information on the sampling distribution can be used to reduce the variance of Monte Carlo estimators via Stein’s method. An important application is that of estimating an expectation of a test function along the sample path of a Markov chain, where gradient information enables convergence rate improvement at the cost of a linear system which must be solved. The contribution of this paper is to establish theoretical bounds on convergence rates for a class of estimators based on Stein’s method. Our analysis accounts for (i) the degree of smoothness of the sampling distribution and test function, (ii) the dimension of the state space, and (iii) the case of non-independent samples arising from a Markov chain. These results provide insight into the rapid convergence of gradient-based estimators observed for low-dimensional problems, as well as clarifying a curse-of-dimension that appears inherent to such methods.
1350-7265
1141-1159
Oates, Chris J.
3af13c56-dc47-4d2c-867f-e4e933e74619
Cockayne, Jonathan
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Briol, Francois-Xavier
9fc3f5c5-ded6-402c-af8f-5ebcfe6bee89
Girolami, Mark
4feb7248-7beb-4edc-8509-139b4049d23b
Oates, Chris J.
3af13c56-dc47-4d2c-867f-e4e933e74619
Cockayne, Jonathan
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Briol, Francois-Xavier
9fc3f5c5-ded6-402c-af8f-5ebcfe6bee89
Girolami, Mark
4feb7248-7beb-4edc-8509-139b4049d23b

Oates, Chris J., Cockayne, Jonathan, Briol, Francois-Xavier and Girolami, Mark (2019) Convergence rates for a class of estimators based on Stein’s method. Bernoulli, 25 (2), 1141-1159. (doi:10.3150/17-bej1016).

Record type: Article

Abstract

Gradient information on the sampling distribution can be used to reduce the variance of Monte Carlo estimators via Stein’s method. An important application is that of estimating an expectation of a test function along the sample path of a Markov chain, where gradient information enables convergence rate improvement at the cost of a linear system which must be solved. The contribution of this paper is to establish theoretical bounds on convergence rates for a class of estimators based on Stein’s method. Our analysis accounts for (i) the degree of smoothness of the sampling distribution and test function, (ii) the dimension of the state space, and (iii) the case of non-independent samples arising from a Markov chain. These results provide insight into the rapid convergence of gradient-based estimators observed for low-dimensional problems, as well as clarifying a curse-of-dimension that appears inherent to such methods.

Text
Bernoulli_1551862846 - Accepted Manuscript
Download (394kB)

More information

Accepted/In Press date: 1 August 2017
Published date: 1 May 2019

Identifiers

Local EPrints ID: 482229
URI: http://eprints.soton.ac.uk/id/eprint/482229
ISSN: 1350-7265
PURE UUID: d764a942-d91a-4c81-95cc-36c2aead36fa
ORCID for Jonathan Cockayne: ORCID iD orcid.org/0000-0002-3287-199X

Catalogue record

Date deposited: 21 Sep 2023 16:53
Last modified: 11 May 2024 02:06

Export record

Altmetrics

Contributors

Author: Chris J. Oates
Author: Francois-Xavier Briol
Author: Mark Girolami

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×