IDEAS home Printed from https://ideas.repec.org/p/chy/respap/173cherp.html
   My bibliography  Save this paper

Who benefits from health insurance? Uncovering heterogeneous policy impacts using causal machine learning

Author

Listed:
  • Noemi Kreif

    (Centre for Health Economics, University of York, York, UK)

  • Andrew Mirelman

    (World Health Organization, Geneva, Switzerland)

  • Rodrigo Moreno-Serra

    (Centre for Health Economics, University of York, York, UK)

  • Taufik Hidayat,

    (Center for Health Economics and Policy Studies (CHEPS), Faculty of Public Health, Universitas Indonesia, Depok, Indonesia)

  • Karla DiazOrdaz

    (Department of Medical Statistics, Faculty of Epidemiology and Population Health, London School of Hygiene & Tropical Medicine, London, UK)

  • Marc Suhrcke

    (Centre for Health Economics, University of York, UK and Luxembourg Institute of Socio-economic Research, Luxembourg)

Abstract

To be able to target health policies more efficiently, policymakers require knowledge about which individuals benefit most from a particular programme. While traditional approaches for subgroup analyses are constrained only to consider a small number of arbitrarily set, pre-defined subgroups, recently proposed causal machine learning (CML) approaches help explore treatment-effect heterogeneity in a more flexible yet principled way. This paper illustrates one such approach – ‘causal forests’ – in evaluating the effect of mothers’ health insurance enrolment in Indonesia. Contrasting two health insurance schemes (subsidised and contributory) to no insurance, we find beneficial average impacts of enrolment in contributory health insurance on maternal health care utilisation and infant mortality. For subsidised health insurance, however, both effects were smaller and not statistically significant. The causal forest algorithm identified significant heterogeneity in the impacts of the contributory insurance scheme: disadvantaged mothers (i.e. with lower wealth quintiles, lower educated, or in rural areas) benefit the most in terms of increased health care utilisation. No significant heterogeneity was found for the subsidised scheme, even though this programme targeted vulnerable populations. Our study demonstrates the power of CML approaches to uncover the heterogeneity in programme impacts, hence providing policymakers with valuable information for programme design.

Suggested Citation

  • Noemi Kreif & Andrew Mirelman & Rodrigo Moreno-Serra & Taufik Hidayat, & Karla DiazOrdaz & Marc Suhrcke, 2020. "Who benefits from health insurance? Uncovering heterogeneous policy impacts using causal machine learning," Working Papers 173cherp, Centre for Health Economics, University of York.
  • Handle: RePEc:chy:respap:173cherp
    as

    Download full text from publisher

    File URL: https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP173_health_insurance_causal_machine_learning.pdf
    File Function: First version, 2020
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dow, William H. & Schmeer, Kammi K., 2003. "Health insurance and child mortality in Costa Rica," Social Science & Medicine, Elsevier, vol. 57(6), pages 975-986, September.
    2. Zelalem Yilma & Anagaw Mebratie & Robert Sparrow & Marleen Dekker & Getnet Alemu & Arjun S. Bedi, 2015. "Impact of Ethiopia's Community Based Health Insurance on Household Economic Welfare," The World Bank Economic Review, World Bank, vol. 29(suppl_1), pages 164-173.
    3. Chen, Yuyu & Jin, Ginger Zhe, 2012. "Does health insurance coverage lead to better health and educational outcomes? Evidence from rural China," Journal of Health Economics, Elsevier, vol. 31(1), pages 1-14.
    4. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    5. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    6. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    7. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    8. Ranjan Shrestha, 2010. "The village midwife program and infant mortality in Indonesia," Bulletin of Indonesian Economic Studies, Taylor & Francis Journals, vol. 46(2), pages 193-211.
    9. Johar, Meliyanni, 2009. "The impact of the Indonesian health card program: A matching estimator approach," Journal of Health Economics, Elsevier, vol. 28(1), pages 35-53, January.
    10. Lingguo Cheng & Hong Liu & Ye Zhang & Ke Shen & Yi Zeng, 2015. "The Impact of Health Insurance on Health Outcomes and Spending of the Elderly: Evidence from China's New Cooperative Medical Scheme," Health Economics, John Wiley & Sons, Ltd., vol. 24(6), pages 672-691, June.
    11. Currie, Janet & Gruber, Jonathan, 1996. "Saving Babies: The Efficacy and Cost of Recent Changes in the Medicaid Eligibility of Pregnant Women," Journal of Political Economy, University of Chicago Press, vol. 104(6), pages 1263-1296, December.
    12. Hainmueller, Jens & Mummolo, Jonathan & Xu, Yiqing, 2019. "How Much Should We Trust Estimates from Multiplicative Interaction Models? Simple Tools to Improve Empirical Practice," Political Analysis, Cambridge University Press, vol. 27(2), pages 163-192, April.
    13. Hong Wang & Winnie Yip & Licheng Zhang & William C. Hsiao, 2009. "The impact of rural mutual health care on health status: evaluation of a social experiment in rural China," Health Economics, John Wiley & Sons, Ltd., vol. 18(S2), pages 65-82, July.
    14. Fink, Günther & Robyn, Paul Jacob & Sié, Ali & Sauerborn, Rainer, 2013. "Does health insurance improve health?," Journal of Health Economics, Elsevier, vol. 32(6), pages 1043-1056.
    15. Sparrow, Robert & Suryahadi, Asep & Widyanti, Wenefrida, 2013. "Social health insurance for the poor: Targeting and impact of Indonesia's Askeskin programme," Social Science & Medicine, Elsevier, vol. 96(C), pages 264-271.
    16. Susan Athey & Stefan Wager, 2021. "Policy Learning With Observational Data," Econometrica, Econometric Society, vol. 89(1), pages 133-161, January.
    17. Adam Wagstaff, 2010. "Estimating health insurance impacts under unobserved heterogeneity: the case of Vietnam's health care fund for the poor," Health Economics, John Wiley & Sons, Ltd., vol. 19(2), pages 189-208, February.
    18. Chou, Shin-Yi & Grossman, Michael & Liu, Jin-Tan, 2014. "The impact of National Health Insurance on birth outcomes: A natural experiment in Taiwan," Journal of Development Economics, Elsevier, vol. 111(C), pages 75-91.
    19. Arnab Acharya & Sukumar Vellakkal & Fiona Taylor & Edoardo Masset & Ambika Satija & Margaret Burke & Shah Ebrahim, 2013. "The Impact of Health Insurance Schemes for the Informal Sector in Low- and Middle-Income Countries: A Systematic Review," The World Bank Research Observer, World Bank, vol. 28(2), pages 236-266, August.
    20. Endang L. Achadi & Anhari Achadi & Eko Pambudi & Puti Marzoeki, 2014. "A Study on the Implementation of Jampersal Policy in Indonesia," Health, Nutrition and Population (HNP) Discussion Paper Series 91325, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Newham, Melissa & Valente, Marica, 2024. "The cost of influence: How gifts to physicians shape prescriptions and drug costs," Journal of Health Economics, Elsevier, vol. 95(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hua Chen & Jianing Xing & Xiaoxu Yang & Kai Zhan, 2021. "Heterogeneous Effects of Health Insurance on Rural Children’s Health in China: A Causal Machine Learning Approach," IJERPH, MDPI, vol. 18(18), pages 1-14, September.
    2. Darius Erlangga & Marc Suhrcke & Shehzad Ali & Karen Bloor, 2019. "The impact of public health insurance on health care utilisation, financial protection and health status in low- and middle-income countries: A systematic review," PLOS ONE, Public Library of Science, vol. 14(8), pages 1-20, August.
    3. Lin, Lin & Zai, Xianhua, 2022. "The Power of Public Insurance With Limited Benefits: Evidence from China's New Cooperative Medical Scheme," GLO Discussion Paper Series 1180, Global Labor Organization (GLO).
    4. Emily Gustafsson-Wright & Gosia Popławska & Zlata Tanović & Jacques Gaag, 2018. "The impact of subsidized private health insurance and health facility upgrades on healthcare utilization and spending in rural Nigeria," International Journal of Health Economics and Management, Springer, vol. 18(3), pages 221-276, September.
    5. repec:dem:wpaper:wp-2022-025 is not listed on IDEAS
    6. Michael C Knaus & Michael Lechner & Anthony Strittmatter, 2021. "Machine learning estimation of heterogeneous causal effects: Empirical Monte Carlo evidence," The Econometrics Journal, Royal Economic Society, vol. 24(1), pages 134-161.
    7. Kondo, Ayako & Shigeoka, Hitoshi, 2013. "Effects of universal health insurance on health care utilization, and supply-side responses: Evidence from Japan," Journal of Public Economics, Elsevier, vol. 99(C), pages 1-23.
    8. Henrika Langen & Martin Huber, 2022. "How causal machine learning can leverage marketing strategies: Assessing and improving the performance of a coupon campaign," Papers 2204.10820, arXiv.org, revised Jun 2022.
    9. Valente, Marica, 2023. "Policy evaluation of waste pricing programs using heterogeneous causal effect estimation," Journal of Environmental Economics and Management, Elsevier, vol. 117(C).
    10. Patrick Rehill & Nicholas Biddle, 2023. "Transparency challenges in policy evaluation with causal machine learning -- improving usability and accountability," Papers 2310.13240, arXiv.org, revised Mar 2024.
    11. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    12. Lingguo Cheng & Hong Liu & Ye Zhang & Ke Shen & Yi Zeng, 2015. "The Impact of Health Insurance on Health Outcomes and Spending of the Elderly: Evidence from China's New Cooperative Medical Scheme," Health Economics, John Wiley & Sons, Ltd., vol. 24(6), pages 672-691, June.
    13. Sophie Mitra & Michael Palmer & Shannon Pullaro & Daniel Mont & Nora Groce, 2017. "Health Insurance and Children in Low- and Middle-income Countries: A Review," The Economic Record, The Economic Society of Australia, vol. 93(302), pages 484-500, September.
    14. Syeda Anam Fatima Rizvi, 2020. "Cost effectiveness of health expenditures: A macro level study for developing and developed countries," Post-Print hal-03341702, HAL.
    15. Lisa Bagnoli, 2017. "Does National Health Insurance Improve Children's Health ?National and Regional Evidence from Ghana," Working Papers ECARES ECARES 2017-03, ULB -- Universite Libre de Bruxelles.
    16. Gabriel Okasa, 2022. "Meta-Learners for Estimation of Causal Effects: Finite Sample Cross-Fit Performance," Papers 2201.12692, arXiv.org.
    17. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP72/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Xinkun Nie & Stefan Wager, 2017. "Quasi-Oracle Estimation of Heterogeneous Treatment Effects," Papers 1712.04912, arXiv.org, revised Aug 2020.
    19. Combes, Pierre-Philippe & Gobillon, Laurent & Zylberberg, Yanos, 2022. "Urban economics in a historical perspective: Recovering data with machine learning," Regional Science and Urban Economics, Elsevier, vol. 94(C).
    20. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP54/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    21. Bokelmann, Björn & Lessmann, Stefan, 2024. "Improving uplift model evaluation on randomized controlled trial data," European Journal of Operational Research, Elsevier, vol. 313(2), pages 691-707.

    More about this item

    Keywords

    policy evaluation; machine learning; heterogeneous treatment effects; health insurance;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:chy:respap:173cherp. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gill Forder (email available below). General contact details of provider: https://edirc.repec.org/data/chyoruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.