The University of Southampton
University of Southampton Institutional Repository

Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion

Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion
Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion
The major implementational problem for reversible jump Markov chain Monte Carlo methods is that there is commonly no natural way to choose jump proposals since there is no Euclidean structure in the parameter space to guide our choice. We consider mechanisms for guiding the choice of proposal. The first group of methods is based on an analysis of acceptance probabilities for jumps. Essentially, these methods involve a Taylor series expansion of the acceptance probability around certain canonical jumps and turn out to have close connections to Langevin algorithms. The second group of methods generalizes the reversible jump algorithm by using the so–called saturated space approach.
These allow the chain to retain some degree of memory so that, when proposing to move from a smaller to a larger model, information is borrowed from the last time that the reverse move was performed. The main motivation for this paper is that, in complex problems, the probability that the Markov chain moves between such spaces may be prohibitively small, as the probability mass can be very thinly spread across the space. Therefore, finding reasonable jump proposals becomes extremely important. We illustrate the procedure by using several examples of reversible jump Markov chain Monte Carlo applications including the analysis of autoregressive time series, graphical Gaussian modeling and mixture modelling.
autoregressive time series, bayesian model selection, graphical models, langevin algorithms, mixture modelling, optimal scaling
1369-7412
47-48
Forster, Jonathan J.
e3c534ad-fa69-42f5-b67b-11617bc84879
Forster, Jonathan J.
e3c534ad-fa69-42f5-b67b-11617bc84879

Forster, Jonathan J. (2003) Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 65 (1), 47-48.

Record type: Article

Abstract

The major implementational problem for reversible jump Markov chain Monte Carlo methods is that there is commonly no natural way to choose jump proposals since there is no Euclidean structure in the parameter space to guide our choice. We consider mechanisms for guiding the choice of proposal. The first group of methods is based on an analysis of acceptance probabilities for jumps. Essentially, these methods involve a Taylor series expansion of the acceptance probability around certain canonical jumps and turn out to have close connections to Langevin algorithms. The second group of methods generalizes the reversible jump algorithm by using the so–called saturated space approach.
These allow the chain to retain some degree of memory so that, when proposing to move from a smaller to a larger model, information is borrowed from the last time that the reverse move was performed. The main motivation for this paper is that, in complex problems, the probability that the Markov chain moves between such spaces may be prohibitively small, as the probability mass can be very thinly spread across the space. Therefore, finding reasonable jump proposals becomes extremely important. We illustrate the procedure by using several examples of reversible jump Markov chain Monte Carlo applications including the analysis of autoregressive time series, graphical Gaussian modeling and mixture modelling.

This record has no associated files available for download.

More information

Published date: 2003
Keywords: autoregressive time series, bayesian model selection, graphical models, langevin algorithms, mixture modelling, optimal scaling
Organisations: Statistics

Identifiers

Local EPrints ID: 29967
URI: http://eprints.soton.ac.uk/id/eprint/29967
ISSN: 1369-7412
PURE UUID: d594915d-c516-49ec-9289-58dbceaff87b
ORCID for Jonathan J. Forster: ORCID iD orcid.org/0000-0002-7867-3411

Catalogue record

Date deposited: 15 May 2006
Last modified: 12 Dec 2021 02:48

Export record

Contributors

Author: Jonathan J. Forster ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×