IDEAS home Printed from https://ideas.repec.org/p/hhs/ifauwp/2024_001.html
   My bibliography  Save this paper

Can model averaging improve propensity score based estimation of average treatment effects?

Author

Listed:
  • Zulj, Valentin

    (Department of Statistics, Uppsala University)

  • Jin, Shaobo

    (Department of Statistics, Uppsala University)

Abstract

When drawing causal inferences from observational data, researchers often model the propen sity score. To date, the literature on the estimation of propensity scores is vast, and includes covariate selection algorithms as well as super learners and model averaging procedures. The latter often tune the estimated scores to be either very accurate or to provide the best possible result in terms of covariate balance. This paper focuses on using inverse probability weighting to estimate average treatment effects, and makes the assertion that the context requires both accuracy and balance to yield suitable propensity scores. Using Monte Carlo simulation, the paper studies whether frequentist model averaging can be used to simultaneously account for both balance and accuracy in order to reduce the bias of estimated treatment effects. The candidate propensity scores are estimated using reproducing kernel Hilbert space regression, and the simulation results suggest that model averaging does not improve the performance of the individual estimators.

Suggested Citation

  • Zulj, Valentin & Jin, Shaobo, 2024. "Can model averaging improve propensity score based estimation of average treatment effects?," Working Paper Series 2024:1, IFAU - Institute for Evaluation of Labour Market and Education Policy.
  • Handle: RePEc:hhs:ifauwp:2024_001
    as

    Download full text from publisher

    File URL: https://www.ifau.se/globalassets/pdf/se/2024/wp-2024-1-can-model-averaging-improve-propensity-score-based-estimation-of-average-treatment-effects.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    2. Shangwei Zhao & Jun Liao & Dalei Yu, 2020. "Model averaging estimator in ridge regression and its large sample properties," Statistical Papers, Springer, vol. 61(4), pages 1719-1739, August.
    3. Kosuke Imai & Marc Ratkovic, 2014. "Covariate balancing propensity score," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 243-263, January.
    4. Donald B. Rubin, 2005. "Causal Inference Using Potential Outcomes: Design, Modeling, Decisions," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 322-331, March.
    5. Cheng Ju & Mary Combs & Samuel D. Lendle & Jessica M. Franklin & Richard Wyss & Sebastian Schneeweiss & Mark J. van der Laan, 2019. "Propensity score prediction for electronic healthcare databases using super learner and high-dimensional propensity score methods," Journal of Applied Statistics, Taylor & Francis Journals, vol. 46(12), pages 2216-2236, September.
    6. Yang Ning & Peng Sida & Kosuke Imai, 2020. "Robust estimation of causal effects via a high-dimensional covariate balancing propensity score," Biometrika, Biometrika Trust, vol. 107(3), pages 533-554.
    7. Karatzoglou, Alexandros & Smola, Alexandros & Hornik, Kurt & Zeileis, Achim, 2004. "kernlab - An S4 Package for Kernel Methods in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 11(i09).
    8. Xun Lu, 2015. "A Covariate Selection Criterion for Estimation of Treatment Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 506-522, October.
    9. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shou-Yung Yin & Chu-An Liu & Chang-Ching Lin, 2021. "Focused Information Criterion and Model Averaging for Large Panels With a Multifactor Error Structure," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 54-68, January.
    2. Noémi Kreif & Richard Grieve & Iván Díaz & David Harrison, 2015. "Evaluation of the Effect of a Continuous Treatment: A Machine Learning Approach with an Application to Treatment for Traumatic Brain Injury," Health Economics, John Wiley & Sons, Ltd., vol. 24(9), pages 1213-1228, September.
    3. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    4. Dasom Lee & Shu Yang & Lin Dong & Xiaofei Wang & Donglin Zeng & Jianwen Cai, 2023. "Improving trial generalizability using observational studies," Biometrics, The International Biometric Society, vol. 79(2), pages 1213-1225, June.
    5. Cousineau, Martin & Verter, Vedat & Murphy, Susan A. & Pineau, Joelle, 2023. "Estimating causal effects with optimization-based methods: A review and empirical comparison," European Journal of Operational Research, Elsevier, vol. 304(2), pages 367-380.
    6. Maciej Berk{e}sewicz, 2023. "Survey calibration for causal inference: a simple method to balance covariate distributions," Papers 2310.11969, arXiv.org, revised Mar 2024.
    7. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    8. Jiaming Mao & Jingzhi Xu, 2020. "Ensemble Learning with Statistical and Structural Models," Papers 2006.05308, arXiv.org.
    9. Shaobo Jin & Sebastian Ankargren, 2019. "Frequentist Model Averaging in Structural Equation Modelling," Psychometrika, Springer;The Psychometric Society, vol. 84(1), pages 84-104, March.
    10. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    11. Allyson Flaster, 2018. "Kids, College, and Capital: Parental Financial Support and College Choice," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(8), pages 979-1020, December.
    12. Alena Skolkova, 2023. "Model Averaging with Ridge Regularization," CERGE-EI Working Papers wp758, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    13. Shixiao Zhang & Peisong Han & Changbao Wu, 2023. "Calibration Techniques Encompassing Survey Sampling, Missing Data Analysis and Causal Inference," International Statistical Review, International Statistical Institute, vol. 91(2), pages 165-192, August.
    14. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2022. "Uncertain identification," Quantitative Economics, Econometric Society, vol. 13(1), pages 95-123, January.
    15. Jiang Du & Zhongzhan Zhang & Tianfa Xie, 2017. "Focused information criterion and model averaging in censored quantile regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 80(5), pages 547-570, July.
    16. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2017. "Uncertain identification," CeMMAP working papers CWP18/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    17. Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2017. "Uncertain identification," CeMMAP working papers 18/17, Institute for Fiscal Studies.
    18. Fang, Fang & Li, Jialiang & Xia, Xiaochao, 2022. "Semiparametric model averaging prediction for dichotomous response," Journal of Econometrics, Elsevier, vol. 229(2), pages 219-245.
    19. Kuanhao Jiang & Rajarshi Mukherjee & Subhabrata Sen & Pragya Sur, 2022. "A New Central Limit Theorem for the Augmented IPW Estimator: Variance Inflation, Cross-Fit Covariance and Beyond," Papers 2205.10198, arXiv.org, revised Oct 2022.
    20. Ruoyao Shi, 2021. "An Averaging Estimator for Two Step M Estimation in Semiparametric Models," Working Papers 202105, University of California at Riverside, Department of Economics.

    More about this item

    Keywords

    .;

    JEL classification:

    • C59 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:ifauwp:2024_001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ali Ghooloo (email available below). General contact details of provider: https://edirc.repec.org/data/ifagvse.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.