IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/35537.html

Effects of Lottery Incentives for Influenza Vaccination: Evidence from a Large-Scale Randomized Trial and Causal Forest Analysis

Author

Listed:
  • Kelsey Moran
  • Gail M. Rosenbaum
  • Amir Goren
  • Michelle N. Meyer
  • Christopher F. Chabris
  • Joseph J. Doyle Jr.

Abstract

Financial incentives may encourage vaccination, but their cost-effectiveness depends on targeting patients who are most responsive. We conducted a randomized controlled trial with 57,579 adult patients in an integrated health system during the 2021–2022 influenza season. Patients with an upcoming appointment were randomized to a no-contact control, a simple reminder, a $1 cash incentive, or a scratch-off lottery ticket incentive worth up to $5,000. Any active intervention increased vaccination at the scheduled appointment by 2 percentage points (an 8% increase over the control mean) and by 1.5 percentage points over the full influenza season. The three active arms did not differ significantly, indicating that small financial incentives provided no additional benefit beyond a reminder. Using electronic health records and area-level characteristics, we used causal forests to estimate conditional average treatment effects. Predicted responsiveness varied substantially: patients in the top quartile were 3–4 times more likely to respond to incentives than those in the bottom quartile, whereas reminder effects were relatively homogeneous. These findings suggest that low-cost reminders can increase influenza vaccination, while machine-learning methods can help identify patients most responsive to small financial incentives.

Suggested Citation

  • Kelsey Moran & Gail M. Rosenbaum & Amir Goren & Michelle N. Meyer & Christopher F. Chabris & Joseph J. Doyle Jr., 2026. "Effects of Lottery Incentives for Influenza Vaccination: Evidence from a Large-Scale Randomized Trial and Causal Forest Analysis," NBER Working Papers 35537, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:35537
    Note: AG EH
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w35537.pdf
    Download Restriction: Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html. Free access is also available to older working papers.
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Jonathan M.V. Davis & Sara B. Heller, 2020. "Rethinking the Benefits of Youth Employment Programs: The Heterogeneous Effects of Summer Jobs," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 664-677, October.
    2. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Black, Dan A. & Grogger, Jeffrey & Kirchmaier, Tom & Sanders, Koen, 2023. "Criminal charges, risk assessment and violent recidivism in cases of domestic abuse," LSE Research Online Documents on Economics 121374, London School of Economics and Political Science, LSE Library.
    2. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    3. O'Neill, E. & Weeks, M., 2018. "Causal Tree Estimation of Heterogeneous Household Response to Time-Of-Use Electricity Pricing Schemes," Cambridge Working Papers in Economics 1865, Faculty of Economics, University of Cambridge.
    4. Phillip Heiler & Michael C. Knaus, 2021. "Effect or Treatment Heterogeneity? Policy Evaluation with Aggregated and Disaggregated Treatments," Papers 2110.01427, arXiv.org, revised Aug 2023.
    5. Victor Chernozhukov & Mert Demirer & Esther Duflo & Iván Fernández‐Val, 2025. "Fisher–Schultz Lecture: Generic Machine Learning Inference on Heterogeneous Treatment Effects in Randomized Experiments, With an Application to Immunization in India," Econometrica, Econometric Society, vol. 93(4), pages 1121-1164, July.
    6. Jere R. Behrman & C. Simon Fan & Naijia Guo & Xiangdong Wei & Hongliang Zhang & Junsen Zhang, 2024. "Tutoring Efficacy, Household Substitution, And Student Achievement: Experimental Evidence From An After‐School Tutoring Program In Rural China," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 65(1), pages 149-189, February.
    7. Goller, Daniel & Lechner, Michael & Pongratz, Tamara & Wolff, Joachim, 2025. "Active labor market policies for the long-term unemployed: New evidence from causal machine learning," Labour Economics, Elsevier, vol. 94(C).
    8. Kayo Murakami & Hideki Shimada & Yoshiaki Ushifusa & Takanori Ida, 2022. "Heterogeneous Treatment Effects Of Nudge And Rebate: Causal Machine Learning In A Field Experiment On Electricity Conservation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(4), pages 1779-1803, November.
    9. Kirakozian, Ankinée & Chiappini, Raphaël & Arfaoui, Nabila, 2025. "Nudging employees for greener mobility—A field experiment," Transportation Research Part A: Policy and Practice, Elsevier, vol. 199(C).
    10. Saskia Opitz & Dirk Sliwka & Timo Vogelsang & Tom Zimmermann, 2025. "The Algorithmic Assignment of Incentive Schemes," Management Science, INFORMS, vol. 71(2), pages 1546-1563, February.
    11. Jing Cao & Tracy Xiao Liu & Rong Ma & Ang Sun, 2025. "Antisocial Responses to the “Coal to Gas” Regulation: An Unintended Consequence of a Residential Energy Policy," Management Science, INFORMS, vol. 71(10), pages 8698-8726, October.
    12. Walter Sosa-Escudero & Maria Victoria Anauati & Wendy Brau, 2022. "Poverty, Inequality and Development Studies with Machine Learning," Advanced Studies in Theoretical and Applied Econometrics, in: Felix Chan & László Mátyás (ed.), Econometrics with Machine Learning, chapter 0, pages 291-335, Springer.
    13. Mesplé-Somps, Sandrine & Nilsson, Björn, 2023. "Role models, aspirations and desire to migrate," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 819-839.
    14. Hiroyuki Egami & Md. Shafiur Rahman & Tsuyoshi Yamamoto & Chihiro Egami & Takahisa Wakabayashi, 2024. "Causal effect of video gaming on mental well-being in Japan 2020–2022," Nature Human Behaviour, Nature, vol. 8(10), pages 1943-1956, October.
    15. Olga Takács & János Vincze, 2023. "Heterogeneous wage structure effects: a partial European East-West comparison," KRTK-KTI WORKING PAPERS 2305, Institute of Economics, Centre for Economic and Regional Studies.
    16. Patrick Rehill, 2025. "How Do Applied Researchers Use the Causal Forest? A Methodological Review," International Statistical Review, International Statistical Institute, vol. 93(2), pages 288-316, August.
    17. Christensen, Peter & Francisco, Paul & Myers, Erica & Shao, Hansen & Souza, Mateus, 2024. "Energy efficiency can deliver for climate policy: Evidence from machine learning-based targeting," Journal of Public Economics, Elsevier, vol. 234(C).
    18. Kevin Credit & Matthew Lehnert, 2024. "A structured comparison of causal machine learning methods to assess heterogeneous treatment effects in spatial data," Journal of Geographical Systems, Springer, vol. 26(4), pages 483-510, October.
    19. Evelina Gavrilova & Audun Langørgen & Floris T. Zoutman, 2025. "Difference‐in‐Difference Causal Forests With an Application to Payroll Tax Incidence in Norway," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(7), pages 727-740, November.
    20. repec:osf:socarx:qzm7y_v1 is not listed on IDEAS
    21. Jun Mao & Jiahao Xie & Zunguo Hu & Lijie Deng & Haitao Wu & Yu Hao, 2023. "Sustainable development through green innovation and resource allocation in cities: Evidence from machine learning," Sustainable Development, John Wiley & Sons, Ltd., vol. 31(4), pages 2386-2401, August.

    More about this item

    JEL classification:

    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:35537. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.