IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v174y2025ics0304387825000203.html
   My bibliography  Save this article

Can SMS interventions increase vaccination? Evidence from the COVID-19 pandemic in Kenya

Author

Listed:
  • Carney, Kevin
  • Rosenzweig, Leah R.
  • Wong, Wendy N.
  • Akech, Florence
  • Otieno, James
  • Maffioli, Elisa M.

Abstract

Researchers, practitioners, and policymakers often view Short Messaging Service (SMS) interventions as quick and inexpensive tools to influence individual decisions. SMS text messaging is particularly attractive in countries where much of the population lives in remote areas but mobile phone technology is becoming increasingly widespread. In partnership with the Ministry of Health in Kenya, we sent a series of SMS messages—incorporating behavioral nudges and financial incentives—to encourage individuals overdue for their second COVID-19 vaccine dose to complete their two-dose primary series. Applying principles from behavioral economics, we conducted four experiments between July 2022 and January 2023, sending randomized SMS messages to 51,903 individuals encouraging them to complete their vaccination. We found no evidence that these messages, designed to nudge behavior or offer financial incentives, significantly increased vaccination completion rates. A follow-up phone survey with a subsample of 105 respondents revealed that, while 91% of people remembered receiving the message, 84% of the sample reported being either not worried or only a little worried about the virus. Our data suggest that, despite recipients recalling the specific SMS, a single message with less salient content may not be effective in improving health outcomes.

Suggested Citation

  • Carney, Kevin & Rosenzweig, Leah R. & Wong, Wendy N. & Akech, Florence & Otieno, James & Maffioli, Elisa M., 2025. "Can SMS interventions increase vaccination? Evidence from the COVID-19 pandemic in Kenya," Journal of Development Economics, Elsevier, vol. 174(C).
  • Handle: RePEc:eee:deveco:v:174:y:2025:i:c:s0304387825000203
    DOI: 10.1016/j.jdeveco.2025.103469
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387825000203
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2025.103469?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Katherine L. Milkman & Linnea Gandhi & Mitesh S. Patel & Heather N. Graci & Dena M. Gromet & Hung Ho & Joseph S. Kay & Timothy W. Lee & Jake Rothschild & Jonathan E. Bogard & Ilana Brody & Christopher, 2022. "A 680,000-person megastudy of nudges to encourage vaccination in pharmacies," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(6), pages 2115126119-, February.
    2. Abhijit Banerjee & Arun G Chandrasekhar & Esther Duflo & Matthew O Jackson, 2019. "Using Gossips to Spread Information: Theory and Evidence from Two Randomized Controlled Trials," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(6), pages 2453-2490.
    3. Niccolò F. Meriggi & Maarten Voors & Madison Levine & Vasudha Ramakrishna & Desmond Maada Kangbai & Michael Rozelle & Ella Tyler & Sellu Kallon & Junisa Nabieu & Sarah Cundy & Ahmed Mushfiq Mobarak, 2024. "Last-mile delivery increases vaccine uptake in Sierra Leone," Nature, Nature, vol. 627(8004), pages 612-619, March.
    4. Michael Kremer & Edward Miguel, 2007. "The Illusion of Sustainability," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1007-1065.
    5. Hummel, Dennis & Maedche, Alexander, 2019. "How effective is nudging? A quantitative review on the effect sizes and limits of empirical nudging studies," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 80(C), pages 47-58.
    6. David Laibson, 2015. "Why Don't Present-Biased Agents Make Commitments?," American Economic Review, American Economic Association, vol. 105(5), pages 267-272, May.
    7. Bahety, Girija & Bauhoff, Sebastian & Patel, Dev & Potter, James, 2021. "Texts don’t nudge: An adaptive trial to prevent the spread of COVID-19 in India," Journal of Development Economics, Elsevier, vol. 153(C).
    8. Katherine L. Milkman & Sean F. Ellis & Dena M. Gromet & Youngwoo Jung & Alex S. Luscher & Rayyan S. Mobarak & Madeline K. Paxson & Ramon A. Silvera Zumaran & Robert Kuan & Ron Berman & Neil A. Lewis &, 2024. "Megastudy shows that reminders boost vaccination but adding free rides does not," Nature, Nature, vol. 631(8019), pages 179-188, July.
    9. Nava Ashraf & James Berry & Jesse M. Shapiro, 2010. "Can Higher Prices Stimulate Product Use? Evidence from a Field Experiment in Zambia," American Economic Review, American Economic Association, vol. 100(5), pages 2383-2413, December.
    10. Burlando, Alfredo & Chintagunta, Pradeep & Goldberg, Jessica & Graboyes, Melissa & Hangoma, Peter & Karlan, Dean & Macis, Mario & Prina, Silvia, 2024. "Passing the message: Peer outreach about COVID-19 precautions in Zambia," Journal of Development Economics, Elsevier, vol. 171(C).
    11. Rebecca L. Thornton, 2008. "The Demand for, and Impact of, Learning HIV Status," American Economic Review, American Economic Association, vol. 98(5), pages 1829-1863, December.
    12. Nwafor, Onyi & Singh, Rahul & Collier, Cassie & DeLeon, Dereck & Osborne, Jim & DeYoung, Jon, 2021. "Effectiveness of nudges as a tool to promote adherence to guidelines in healthcare and their organizational implications: A systematic review," Social Science & Medicine, Elsevier, vol. 286(C).
    13. Esther Duflo & Rema Hanna & Stephen P. Ryan, 2012. "Incentives Work: Getting Teachers to Come to School," American Economic Review, American Economic Association, vol. 102(4), pages 1241-1278, June.
    14. Robert Garlick & Kate Orkin & Simon Quinn, 2020. "Call Me Maybe: Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys," The World Bank Economic Review, World Bank, vol. 34(2), pages 418-443.
    15. Abhijit Banerjee & Arun G. Chandrasekhar & Suresh Dalpath & Esther Duflo & John Floretta & Matthew O. Jackson & Harini Kannan & Francine N. Loza & Anirudh Sankar & Anna Schrimpf & Maheshwor Shrestha, 2021. "Selecting the Most Effective Nudge: Evidence from a Large-Scale Experiment on Immunization," NBER Working Papers 28726, National Bureau of Economic Research, Inc.
    16. Anne Karing, 2024. "Social Signaling and Childhood Immunization: A Field Experiment in Sierra Leone," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(4), pages 2083-2133.
    17. Dean Karlan & Margaret McConnell & Sendhil Mullainathan & Jonathan Zinman, 2016. "Getting to the Top of Mind: How Reminders Increase Saving," Management Science, INFORMS, vol. 62(12), pages 3393-3411, December.
    18. Jessica Cohen & Pascaline Dupas, 2010. "Free Distribution or Cost-Sharing? Evidence from a Randomized Malaria Prevention Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 1-45.
    19. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    20. Barham, Tania & Maluccio, John A., 2009. "Eradicating diseases: The effect of conditional cash transfers on vaccination coverage in rural Nicaragua," Journal of Health Economics, Elsevier, vol. 28(3), pages 611-621, May.
    21. Hengchen Dai & Silvia Saccardo & Maria A. Han & Lily Roh & Naveen Raja & Sitaram Vangala & Hardikkumar Modi & Shital Pandya & Michael Sloyan & Daniel M. Croymans, 2021. "Behavioural nudges increase COVID-19 vaccinations," Nature, Nature, vol. 597(7876), pages 404-409, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sylvain Chassang & Gerard Padro I Miquel & Erik Snowberg, 2012. "Selective Trials: A Principal-Agent Approach to Randomized Controlled Experiments," American Economic Review, American Economic Association, vol. 102(4), pages 1279-1309, June.
    2. Lagarde, Mylène & Riumallo Herl, Carlos, 2025. "Better together? Group incentives and the demand for prevention," Journal of Development Economics, Elsevier, vol. 172(C).
    3. Islam, Asad & Kusnadi, Gita & Rezki, Jahen & Sim, Armand & van Empel, Giovanni & Vlassopoulos, Michael & Zenou, Yves, 2024. "Addressing vaccine hesitancy using local ambassadors: A randomized controlled trial in Indonesia," European Economic Review, Elsevier, vol. 163(C).
    4. Okeke, Edward N. & Adepiti, Clement A. & Ajenifuja, Kayode O., 2013. "What is the price of prevention? New evidence from a field experiment," Journal of Health Economics, Elsevier, vol. 32(1), pages 207-218.
    5. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    6. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    7. Molina Millán, Teresa & Macours, Karen, 2017. "Attrition in Randomized Control Trials: Using Tracking Information to Correct Bias," IZA Discussion Papers 10711, Institute of Labor Economics (IZA).
    8. Patrick Opoku Asuming & Hyuncheol Bryant Kim & Armand Sim, 2024. "Selection and behavioral responses of health insurance subsidies in the long run: Evidence from a field experiment in Ghana," Health Economics, John Wiley & Sons, Ltd., vol. 33(5), pages 992-1032, May.
    9. Powell-Jackson, Timothy & Hanson, Kara & Whitty, Christopher J.M. & Ansah, Evelyn K., 2014. "Who benefits from free healthcare? Evidence from a randomized experiment in Ghana," Journal of Development Economics, Elsevier, vol. 107(C), pages 305-319.
    10. Pascaline Dupas & Edward Miguel, 2016. "Impacts and Determinants of Health Levels in Low-Income Countries," NBER Working Papers 22235, National Bureau of Economic Research, Inc.
    11. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    12. Patrick Aylward & Hildah Essendi & Kristen Little & Nicholas Wilson, 2020. "Demand for self‐tests: Evidence from a Becker–DeGroot–Marschak mechanism field experiment," Health Economics, John Wiley & Sons, Ltd., vol. 29(4), pages 489-507, April.
    13. Mylène Lagarde & Carlos Riumallo Herl, 2023. "Stronger together: Group incentives and the demand for prevention," Tinbergen Institute Discussion Papers 23-0010/V, Tinbergen Institute.
    14. Renfu Luo & Grant Miller & Scott Rozelle & Sean Sylvia & Marcos Vera-Hernández, 2015. "Can Bureaucrats Really Be Paid Like CEOs? School Administrator Incentives for Anemia Reduction in Rural China," NBER Working Papers 21302, National Bureau of Economic Research, Inc.
    15. Alessandro Tarozzi & Ricardo Maertens & Kazi Matin Ahmed & Alexander van Geen, 2021. "Demand for Information on Environmental Health Risk, Mode of Delivery, and Behavioral Change: Evidence from Sonargaon, Bangladesh," The World Bank Economic Review, World Bank, vol. 35(3), pages 764-792.
    16. Teresa Molina Millán & Karen Macours, 2017. "Attrition in randomized control trials: Using tracking information to correct bias," FEUNL Working Paper Series novaf:wp1702, Universidade Nova de Lisboa, Faculdade de Economia.
    17. B Kelsey Jack, "undated". "Market Inefficiencies and the Adoption of Agricultural Technologies in Developing Countries," CID Working Papers 50, Center for International Development at Harvard University.
    18. Hoffmann, Bridget, 2018. "Do non-monetary prices target the poor? Evidence from a field experiment in India," Journal of Development Economics, Elsevier, vol. 133(C), pages 15-32.
    19. Victor Iajya & Nicola Lacetera & Mario Macis & Robert Slonim, 2012. "The Effects of Information, Social and Economic Incentives on Voluntary Undirected Blood Donations: Evidence from a Randomized Controlled Trial in Argentina," NBER Working Papers 18630, National Bureau of Economic Research, Inc.
    20. Fitzsimons, Emla & Malde, Bansi & Mesnard, Alice & Vera-Hernández, Marcos, 2016. "Nutrition, information and household behavior: Experimental evidence from Malawi," Journal of Development Economics, Elsevier, vol. 122(C), pages 113-126.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:174:y:2025:i:c:s0304387825000203. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.