The University of Southampton
University of Southampton Institutional Repository

A Bayesian conjugate gradient method (with discussion)

A Bayesian conjugate gradient method (with discussion)
A Bayesian conjugate gradient method (with discussion)
A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is employed. However, for more challenging systems a substantial error can be present even after many iterations have been performed. The estimates obtained in this case are of little value unless further information can be provided about, for example, the magnitude of the error. In this paper we propose a novel statistical model for this error, set in a Bayesian framework. Our approach is a strict generalisation of the conjugate gradient method, which is recovered as the posterior mean for a particular choice of prior. The estimates obtained are analysed with Krylov subspace methods and a contraction result for the posterior is presented. The method is then analysed in a simulation study as well as being applied to a challenging problem in medical imaging.
1931-6690
Cockayne, Jonathan
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Oates, Chris J.
3af13c56-dc47-4d2c-867f-e4e933e74619
Ipsen, Ilse C.F.
83eae4c2-19d4-4f74-9d16-4146a63d2c4c
Girolami, Mark
4feb7248-7beb-4edc-8509-139b4049d23b
Cockayne, Jonathan
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Oates, Chris J.
3af13c56-dc47-4d2c-867f-e4e933e74619
Ipsen, Ilse C.F.
83eae4c2-19d4-4f74-9d16-4146a63d2c4c
Girolami, Mark
4feb7248-7beb-4edc-8509-139b4049d23b

Cockayne, Jonathan, Oates, Chris J., Ipsen, Ilse C.F. and Girolami, Mark (2019) A Bayesian conjugate gradient method (with discussion). Bayesian Analysis, 14 (3). (doi:10.1214/19-ba1145).

Record type: Article

Abstract

A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is employed. However, for more challenging systems a substantial error can be present even after many iterations have been performed. The estimates obtained in this case are of little value unless further information can be provided about, for example, the magnitude of the error. In this paper we propose a novel statistical model for this error, set in a Bayesian framework. Our approach is a strict generalisation of the conjugate gradient method, which is recovered as the posterior mean for a particular choice of prior. The estimates obtained are analysed with Krylov subspace methods and a contraction result for the posterior is presented. The method is then analysed in a simulation study as well as being applied to a challenging problem in medical imaging.

Text
19-BA1145 - Version of Record
Available under License Creative Commons Attribution.
Download (3MB)

More information

Published date: 1 September 2019

Identifiers

Local EPrints ID: 451592
URI: http://eprints.soton.ac.uk/id/eprint/451592
ISSN: 1931-6690
PURE UUID: b27e5acd-d90a-48f7-95b3-22c51b45bd0e
ORCID for Jonathan Cockayne: ORCID iD orcid.org/0000-0002-3287-199X

Catalogue record

Date deposited: 12 Oct 2021 16:34
Last modified: 17 Mar 2024 04:09

Export record

Altmetrics

Contributors

Author: Chris J. Oates
Author: Ilse C.F. Ipsen
Author: Mark Girolami

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×