The University of Southampton
University of Southampton Institutional Repository

Computation-aware Kalman filtering and smoothing

Computation-aware Kalman filtering and smoothing
Computation-aware Kalman filtering and smoothing
Kalman filtering and smoothing are the foundational mechanisms for efficient inference in Gauss-Markov models. However, their time and memory complexities scale prohibitively with the size of the state space. This is particularly problematic in spatiotemporal regression problems, where the state dimension scales with the number of spatial observations. Existing approximate frameworks leverage low-rank approximations of the covariance matrix. Since they do not model the error introduced by the computational approximation, their predictive uncertainty estimates can be overly optimistic. In this work, we propose a probabilistic numerical method for inference in high-dimensional Gauss-Markov models which mitigates these scaling issues. Our matrix-free iterative algorithm leverages GPU acceleration and crucially enables a tunable trade-off between computational cost and predictive uncertainty. Finally, we demonstrate the scalability of our method on a large-scale climate dataset.
cs.LG, cs.NA, math.NA, stat.ML
arXiv
Pförtner, Marvin
02077206-cf63-48d5-8819-cde9d52472ad
Wenger, Jonathan
6dcd8a05-50a5-4929-8736-2a3519384e34
Cockayne, Jon
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Hennig, Philipp
de8f803a-be5c-409e-be48-9b0f3b2309dd
Pförtner, Marvin
02077206-cf63-48d5-8819-cde9d52472ad
Wenger, Jonathan
6dcd8a05-50a5-4929-8736-2a3519384e34
Cockayne, Jon
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Hennig, Philipp
de8f803a-be5c-409e-be48-9b0f3b2309dd

[Unknown type: UNSPECIFIED]

Record type: UNSPECIFIED

Abstract

Kalman filtering and smoothing are the foundational mechanisms for efficient inference in Gauss-Markov models. However, their time and memory complexities scale prohibitively with the size of the state space. This is particularly problematic in spatiotemporal regression problems, where the state dimension scales with the number of spatial observations. Existing approximate frameworks leverage low-rank approximations of the covariance matrix. Since they do not model the error introduced by the computational approximation, their predictive uncertainty estimates can be overly optimistic. In this work, we propose a probabilistic numerical method for inference in high-dimensional Gauss-Markov models which mitigates these scaling issues. Our matrix-free iterative algorithm leverages GPU acceleration and crucially enables a tunable trade-off between computational cost and predictive uncertainty. Finally, we demonstrate the scalability of our method on a large-scale climate dataset.

Text
2405.08971v1 - Author's Original
Available under License Creative Commons Attribution.
Download (6MB)

More information

Published date: 14 May 2024
Keywords: cs.LG, cs.NA, math.NA, stat.ML

Identifiers

Local EPrints ID: 496516
URI: http://eprints.soton.ac.uk/id/eprint/496516
PURE UUID: da77b672-ad92-4b6e-a1cc-1ea25f2bd698
ORCID for Jon Cockayne: ORCID iD orcid.org/0000-0002-3287-199X

Catalogue record

Date deposited: 17 Dec 2024 17:41
Last modified: 18 Dec 2024 03:11

Export record

Altmetrics

Contributors

Author: Marvin Pförtner
Author: Jonathan Wenger
Author: Jon Cockayne ORCID iD
Author: Philipp Hennig

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×