Computation-aware Kalman filtering and smoothing
Computation-aware Kalman filtering and smoothing
Kalman filtering and smoothing are the foundational mechanisms for efficient inference in Gauss-Markov models. However, their time and memory complexities scale prohibitively with the size of the state space. This is particularly problematic in spatiotemporal regression problems, where the state dimension scales with the number of spatial observations. Existing approximate frameworks leverage low-rank approximations of the covariance matrix. Since they do not model the error introduced by the computational approximation, their predictive uncertainty estimates can be overly optimistic. In this work, we propose a probabilistic numerical method for inference in high-dimensional Gauss-Markov models which mitigates these scaling issues. Our matrix-free iterative algorithm leverages GPU acceleration and crucially enables a tunable trade-off between computational cost and predictive uncertainty. Finally, we demonstrate the scalability of our method on a large-scale climate dataset.
cs.LG, cs.NA, math.NA, stat.ML
Pförtner, Marvin
02077206-cf63-48d5-8819-cde9d52472ad
Wenger, Jonathan
6dcd8a05-50a5-4929-8736-2a3519384e34
Cockayne, Jon
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Hennig, Philipp
de8f803a-be5c-409e-be48-9b0f3b2309dd
14 May 2024
Pförtner, Marvin
02077206-cf63-48d5-8819-cde9d52472ad
Wenger, Jonathan
6dcd8a05-50a5-4929-8736-2a3519384e34
Cockayne, Jon
da87c8b2-fafb-4856-938d-50be8f0e4a5b
Hennig, Philipp
de8f803a-be5c-409e-be48-9b0f3b2309dd
[Unknown type: UNSPECIFIED]
Abstract
Kalman filtering and smoothing are the foundational mechanisms for efficient inference in Gauss-Markov models. However, their time and memory complexities scale prohibitively with the size of the state space. This is particularly problematic in spatiotemporal regression problems, where the state dimension scales with the number of spatial observations. Existing approximate frameworks leverage low-rank approximations of the covariance matrix. Since they do not model the error introduced by the computational approximation, their predictive uncertainty estimates can be overly optimistic. In this work, we propose a probabilistic numerical method for inference in high-dimensional Gauss-Markov models which mitigates these scaling issues. Our matrix-free iterative algorithm leverages GPU acceleration and crucially enables a tunable trade-off between computational cost and predictive uncertainty. Finally, we demonstrate the scalability of our method on a large-scale climate dataset.
Text
2405.08971v1
- Author's Original
More information
Published date: 14 May 2024
Keywords:
cs.LG, cs.NA, math.NA, stat.ML
Identifiers
Local EPrints ID: 496516
URI: http://eprints.soton.ac.uk/id/eprint/496516
PURE UUID: da77b672-ad92-4b6e-a1cc-1ea25f2bd698
Catalogue record
Date deposited: 17 Dec 2024 17:41
Last modified: 18 Dec 2024 03:11
Export record
Altmetrics
Contributors
Author:
Marvin Pförtner
Author:
Jonathan Wenger
Author:
Philipp Hennig
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics