Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion
Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion
The major implementational problem for reversible jump Markov chain Monte Carlo methods is that there is commonly no natural way to choose jump proposals since there is no Euclidean structure in the parameter space to guide our choice. We consider mechanisms for guiding the choice of proposal. The first group of methods is based on an analysis of acceptance probabilities for jumps. Essentially, these methods involve a Taylor series expansion of the acceptance probability around certain canonical jumps and turn out to have close connections to Langevin algorithms. The second group of methods generalizes the reversible jump algorithm by using the so–called saturated space approach.
These allow the chain to retain some degree of memory so that, when proposing to move from a smaller to a larger model, information is borrowed from the last time that the reverse move was performed. The main motivation for this paper is that, in complex problems, the probability that the Markov chain moves between such spaces may be prohibitively small, as the probability mass can be very thinly spread across the space. Therefore, finding reasonable jump proposals becomes extremely important. We illustrate the procedure by using several examples of reversible jump Markov chain Monte Carlo applications including the analysis of autoregressive time series, graphical Gaussian modeling and mixture modelling.
autoregressive time series, bayesian model selection, graphical models, langevin algorithms, mixture modelling, optimal scaling
47-48
Forster, Jonathan J.
e3c534ad-fa69-42f5-b67b-11617bc84879
2003
Forster, Jonathan J.
e3c534ad-fa69-42f5-b67b-11617bc84879
Forster, Jonathan J.
(2003)
Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion.
Journal of the Royal Statistical Society: Series B (Statistical Methodology), 65 (1), .
Abstract
The major implementational problem for reversible jump Markov chain Monte Carlo methods is that there is commonly no natural way to choose jump proposals since there is no Euclidean structure in the parameter space to guide our choice. We consider mechanisms for guiding the choice of proposal. The first group of methods is based on an analysis of acceptance probabilities for jumps. Essentially, these methods involve a Taylor series expansion of the acceptance probability around certain canonical jumps and turn out to have close connections to Langevin algorithms. The second group of methods generalizes the reversible jump algorithm by using the so–called saturated space approach.
These allow the chain to retain some degree of memory so that, when proposing to move from a smaller to a larger model, information is borrowed from the last time that the reverse move was performed. The main motivation for this paper is that, in complex problems, the probability that the Markov chain moves between such spaces may be prohibitively small, as the probability mass can be very thinly spread across the space. Therefore, finding reasonable jump proposals becomes extremely important. We illustrate the procedure by using several examples of reversible jump Markov chain Monte Carlo applications including the analysis of autoregressive time series, graphical Gaussian modeling and mixture modelling.
This record has no associated files available for download.
More information
Published date: 2003
Keywords:
autoregressive time series, bayesian model selection, graphical models, langevin algorithms, mixture modelling, optimal scaling
Organisations:
Statistics
Identifiers
Local EPrints ID: 29967
URI: http://eprints.soton.ac.uk/id/eprint/29967
ISSN: 1369-7412
PURE UUID: d594915d-c516-49ec-9289-58dbceaff87b
Catalogue record
Date deposited: 15 May 2006
Last modified: 12 Dec 2021 02:48
Export record
Contributors
Author:
Jonathan J. Forster
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics