Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding
Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding
Understanding and quantifying cause and effect is an important problem in many domains. The generally-agreed solution to this problem is to perform a randomised controlled trial. However, even when randomised controlled trials can be performed, they usually have relatively short duration's due to cost considerations. This makes learning long-term causal effects a very challenging task in practice, since the long-term outcome is only observed after a long delay. In this paper, we study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Previous work provided an estimation strategy to determine long-term causal effects from such data regimes. However, this strategy only works if one assumes there are no unobserved confounders in the observational data. In this paper, we specifically address the challenging case where unmeasured confounders are present in the observational data. Our long-term causal effect estimator is obtained by combining regression residuals with short-term experimental outcomes in a specific manner to create an instrumental variable, which is then used to quantify the long-term causal effect through instrumental variable regression. We prove this estimator is unbiased, and analytically study its variance. In the context of the front-door causal structure, this provides a new causal estimator, which may be of independent interest. Finally, we empirically test our approach on synthetic-data, as well as real-data from the International Stroke Trial.
stat.ML, cs.LG
791-813
Goffrier, Graham Van
18877be8-d9be-4c90-a625-8f1c11b9cb84
Maystre, Lucas
515b11e3-3f64-4722-8186-f8a50951113b
Gilligan-Lee, Ciarán
cd920fb9-ebe9-4d60-a49b-27b47eaef218
21 February 2023
Goffrier, Graham Van
18877be8-d9be-4c90-a625-8f1c11b9cb84
Maystre, Lucas
515b11e3-3f64-4722-8186-f8a50951113b
Gilligan-Lee, Ciarán
cd920fb9-ebe9-4d60-a49b-27b47eaef218
Goffrier, Graham Van, Maystre, Lucas and Gilligan-Lee, Ciarán
(2023)
Estimating long-term causal effects from short-term experiments and long-term observational data with unobserved confounding.
In,
Proceedings of the Second Conference on Causal Learning and Reasoning.
(Proceedings of the Second Conference on Causal Learning and Reasoning, 791-813, 213)
PMLR, .
Record type:
Book Section
Abstract
Understanding and quantifying cause and effect is an important problem in many domains. The generally-agreed solution to this problem is to perform a randomised controlled trial. However, even when randomised controlled trials can be performed, they usually have relatively short duration's due to cost considerations. This makes learning long-term causal effects a very challenging task in practice, since the long-term outcome is only observed after a long delay. In this paper, we study the identification and estimation of long-term treatment effects when both experimental and observational data are available. Previous work provided an estimation strategy to determine long-term causal effects from such data regimes. However, this strategy only works if one assumes there are no unobserved confounders in the observational data. In this paper, we specifically address the challenging case where unmeasured confounders are present in the observational data. Our long-term causal effect estimator is obtained by combining regression residuals with short-term experimental outcomes in a specific manner to create an instrumental variable, which is then used to quantify the long-term causal effect through instrumental variable regression. We prove this estimator is unbiased, and analytically study its variance. In the context of the front-door causal structure, this provides a new causal estimator, which may be of independent interest. Finally, we empirically test our approach on synthetic-data, as well as real-data from the International Stroke Trial.
Text
2302.10625v1
- Version of Record
More information
Published date: 21 February 2023
Additional Information:
23 pages, 8 figures, 2nd Conference on Causal Learning and Reasoning
Keywords:
stat.ML, cs.LG
Identifiers
Local EPrints ID: 482368
URI: http://eprints.soton.ac.uk/id/eprint/482368
PURE UUID: 83360557-6bdf-4077-8722-d7c213e8f3bd
Catalogue record
Date deposited: 28 Sep 2023 16:37
Last modified: 18 Mar 2024 04:16
Export record
Contributors
Author:
Graham Van Goffrier
Author:
Lucas Maystre
Author:
Ciarán Gilligan-Lee
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics