IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2109.15062.html
   My bibliography  Save this paper

Towards Principled Causal Effect Estimation by Deep Identifiable Models

Author

Listed:
  • Pengzhou Wu
  • Kenji Fukumizu

Abstract

As an important problem in causal inference, we discuss the estimation of treatment effects (TEs). Representing the confounder as a latent variable, we propose Intact-VAE, a new variant of variational autoencoder (VAE), motivated by the prognostic score that is sufficient for identifying TEs. Our VAE also naturally gives representations balanced for treatment groups, using its prior. Experiments on (semi-)synthetic datasets show state-of-the-art performance under diverse settings, including unobserved confounding. Based on the identifiability of our model, we prove identification of TEs under unconfoundedness, and also discuss (possible) extensions to harder settings.

Suggested Citation

  • Pengzhou Wu & Kenji Fukumizu, 2021. "Towards Principled Causal Effect Estimation by Deep Identifiable Models," Papers 2109.15062, arXiv.org, revised Nov 2021.
    • Handle: RePEc:arx:papers:2109.15062
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2109.15062
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    2. Kim, Jae-Young, 2002. "Limited information likelihood and Bayesian analysis," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 175-193, March.
    3. Nishanth Dikkala & Greg Lewis & Lester Mackey & Vasilis Syrgkanis, 2020. "Minimax Estimation of Conditional Moment Models," Papers 2006.07201, arXiv.org.
    4. Yixin Wang & David M. Blei, 2019. "The Blessings of Multiple Causes: Rejoinder," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1616-1619, October.
    5. Jinyong Hahn & Geert Ridder, 2011. "Conditional Moment Restrictions and Triangular Simultaneous Equations," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 683-689, May.
    6. Yixin Wang & David M. Blei, 2019. "The Blessings of Multiple Causes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1574-1596, October.
    7. Ben B. Hansen, 2008. "The prognostic analogue of the propensity score," Biometrika, Biometrika Trust, vol. 95(2), pages 481-488.
    8. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    9. Wang Miao & Zhi Geng & Eric J Tchetgen Tchetgen, 2018. "Identifying causal effects with proxy variables of an unmeasured confounder," Biometrika, Biometrika Trust, vol. 105(4), pages 987-993.
    10. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koch, Bernard & Sainburg, Tim & Geraldo, Pablo & JIANG, SONG & Sun, Yizhou & Foster, Jacob G., 2021. "Deep Learning of Potential Outcomes," SocArXiv aeszf, Center for Open Science.
    2. Bernard Koch & Tim Sainburg & Pablo Geraldo & Song Jiang & Yizhou Sun & Jacob Gates Foster, 2021. "A Primer on Deep Learning for Causal Inference," Papers 2110.04442, arXiv.org, revised Nov 2023.
    3. Rahul Singh & Liyuan Xu & Arthur Gretton, 2020. "Kernel Methods for Causal Functions: Dose, Heterogeneous, and Incremental Response Curves," Papers 2010.04855, arXiv.org, revised Oct 2022.
    4. Fukuyama, Hirofumi & Tsionas, Mike & Tan, Yong, 2024. "The impacts of innovation and trade openness on bank market power: The proposal of a minimum distance cost function approach and a causal structure analysis," European Journal of Operational Research, Elsevier, vol. 312(3), pages 1178-1194.
    5. Tsionas, Mike G. & Patel, Pankaj C., 2023. "Tinkering or orchestrating? The value of country-level asset management capability and entrepreneurship outcomes," International Journal of Production Economics, Elsevier, vol. 255(C).
    6. Tsionas, Mike G., 2022. "Convex non-parametric least squares, causal structures and productivity," European Journal of Operational Research, Elsevier, vol. 303(1), pages 370-387.
    7. Christian Stetter & Philipp Mennig & Johannes Sauer, 2022. "Using Machine Learning to Identify Heterogeneous Impacts of Agri-Environment Schemes in the EU: A Case Study," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 49(4), pages 723-759.
    8. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Dimitris Bertsimas & Agni Orfanoudaki & Rory B. Weiner, 2020. "Personalized treatment for coronary artery disease patients: a machine learning approach," Health Care Management Science, Springer, vol. 23(4), pages 482-506, December.
    10. Ruoxuan Xiong & Allison Koenecke & Michael Powell & Zhu Shen & Joshua T. Vogelstein & Susan Athey, 2021. "Federated Causal Inference in Heterogeneous Observational Data," Papers 2107.11732, arXiv.org, revised Apr 2023.
    11. Davide Viviano & Jelena Bradic, 2019. "Synthetic learner: model-free inference on treatments over time," Papers 1904.01490, arXiv.org, revised Aug 2022.
    12. Rina Friedberg & Julie Tibshirani & Susan Athey & Stefan Wager, 2018. "Local Linear Forests," Papers 1807.11408, arXiv.org, revised Sep 2020.
    13. Yiyi Huo & Yingying Fan & Fang Han, 2023. "On the adaptation of causal forests to manifold data," Papers 2311.16486, arXiv.org, revised Dec 2023.
    14. Julius Owusu, 2023. "Randomization Inference of Heterogeneous Treatment Effects under Network Interference," Papers 2308.00202, arXiv.org, revised Jan 2024.
    15. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
    16. Miruna Oprescu & Vasilis Syrgkanis & Zhiwei Steven Wu, 2018. "Orthogonal Random Forest for Causal Inference," Papers 1806.03467, arXiv.org, revised Sep 2019.
    17. Guido W. Imbens, 2022. "Causality in Econometrics: Choice vs Chance," Econometrica, Econometric Society, vol. 90(6), pages 2541-2566, November.
    18. Yuan Liao & Anna Simoni, 2012. "Semi-parametric Bayesian Partially Identified Models based on Support Function," Papers 1212.3267, arXiv.org, revised Nov 2013.
    19. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    20. Jean-Pierre Florens & Anna Simoni, 2021. "Gaussian Processes and Bayesian Moment Estimation," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 482-492, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2109.15062. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.