The University of Southampton
University of Southampton Institutional Repository

Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding

Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding
Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding
Understanding and quantifying cause and effect is an important problem in many domains. The generally-agreed solution to this problem is to perform a randomised controlled trial. However, even when randomised controlled trials can be performed, they usually have relatively short duration's due to cost considerations. This makes learning long-term causal effects a very challenging task in practice, since the long-term outcome is only observed after a long delay. In this paper, we study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Previous work provided an estimation strategy to determine long-term causal effects from such data regimes. However, this strategy only works if one assumes there are no unobserved confounders in the observational data. In this paper, we specifically address the challenging case where unmeasured confounders are present in the observational data. Our long-term causal effect estimator is obtained by combining regression residuals with short-term experimental outcomes in a specific manner to create an instrumental variable, which is then used to quantify the long-term causal effect through instrumental variable regression. We prove this estimator is unbiased, and analytically study its variance. In the context of the front-door causal structure, this provides a new causal estimator, which may be of independent interest. Finally, we empirically test our approach on synthetic-data, as well as real-data from the International Stroke Trial.
stat.ML, cs.LG
791-813
791-813
PMLR
Goffrier, Graham Van
18877be8-d9be-4c90-a625-8f1c11b9cb84
Maystre, Lucas
515b11e3-3f64-4722-8186-f8a50951113b
Gilligan-Lee, Ciarán
cd920fb9-ebe9-4d60-a49b-27b47eaef218
Goffrier, Graham Van
18877be8-d9be-4c90-a625-8f1c11b9cb84
Maystre, Lucas
515b11e3-3f64-4722-8186-f8a50951113b
Gilligan-Lee, Ciarán
cd920fb9-ebe9-4d60-a49b-27b47eaef218

Goffrier, Graham Van, Maystre, Lucas and Gilligan-Lee, Ciarán (2023) Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding. In, Proceedings of the Second Conference on Causal Learning and Reasoning. (Proceedings of the Second Conference on Causal Learning and Reasoning, 791-813, 213) PMLR, pp. 791-813.

Record type: Book Section

Abstract

Understanding and quantifying cause and effect is an important problem in many domains. The generally-agreed solution to this problem is to perform a randomised controlled trial. However, even when randomised controlled trials can be performed, they usually have relatively short duration's due to cost considerations. This makes learning long-term causal effects a very challenging task in practice, since the long-term outcome is only observed after a long delay. In this paper, we study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Previous work provided an estimation strategy to determine long-term causal effects from such data regimes. However, this strategy only works if one assumes there are no unobserved confounders in the observational data. In this paper, we specifically address the challenging case where unmeasured confounders are present in the observational data. Our long-term causal effect estimator is obtained by combining regression residuals with short-term experimental outcomes in a specific manner to create an instrumental variable, which is then used to quantify the long-term causal effect through instrumental variable regression. We prove this estimator is unbiased, and analytically study its variance. In the context of the front-door causal structure, this provides a new causal estimator, which may be of independent interest. Finally, we empirically test our approach on synthetic-data, as well as real-data from the International Stroke Trial.

Text
2302.10625v1 - Version of Record
Download (494kB)

More information

Published date: 21 February 2023
Additional Information: 23 pages, 8 figures, 2nd Conference on Causal Learning and Reasoning
Keywords: stat.ML, cs.LG

Identifiers

Local EPrints ID: 482368
URI: http://eprints.soton.ac.uk/id/eprint/482368
PURE UUID: 83360557-6bdf-4077-8722-d7c213e8f3bd
ORCID for Graham Van Goffrier: ORCID iD orcid.org/0000-0002-7470-1868

Catalogue record

Date deposited: 28 Sep 2023 16:37
Last modified: 18 Mar 2024 04:16

Export record

Contributors

Author: Graham Van Goffrier ORCID iD
Author: Lucas Maystre
Author: Ciarán Gilligan-Lee

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×