IDEAS home Printed from https://ideas.repec.org/a/wly/jpamgt/v40y2021i4p1230-1248.html
   My bibliography  Save this article

Nudges Don't Work When the Benefits Are Ambiguous: Evidence from a High‐Stakes Education Program

Author

Listed:
  • Benjamin L. Castleman
  • Francis X. Murphy
  • Richard W. Patterson
  • William L. Skimmyhorn

Abstract

The Post‐9/11 GI Bill allows service members to transfer generous education benefits to a dependent. We run a large‐scale experiment that encourages service members to consider the transfer option among a population that includes individuals for whom the transfer benefits are clear and individuals for whom the net‐benefits are significantly more ambiguous. We find no impact of a one‐time e‐mail about benefits transfer among service members for whom we predict considerable ambiguity in the action, but sizeable impacts among service members for whom education benefits transfer is far less ambiguous. Our work contributes to the nascent literature investigating conditions when low‐touch nudges at scale may be effective.

Suggested Citation

  • Benjamin L. Castleman & Francis X. Murphy & Richard W. Patterson & William L. Skimmyhorn, 2021. "Nudges Don't Work When the Benefits Are Ambiguous: Evidence from a High‐Stakes Education Program," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(4), pages 1230-1248, September.
    • Handle: RePEc:wly:jpamgt:v:40:y:2021:i:4:p:1230-1248
    DOI: 10.1002/pam.22303
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/pam.22303
    Download Restriction: no
    File URL: https://libkey.io/10.1002/pam.22303?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Beshears, John & Choi, James J. & Laibson, David & Madrian, Brigitte C., 2013. "Simplification and saving," Journal of Economic Behavior & Organization, Elsevier, vol. 95(C), pages 130-145.
    2. Bird, Kelli A. & Castleman, Benjamin L. & Denning, Jeffrey T. & Goodman, Joshua & Lamberton, Cait & Rosinger, Kelly Ochs, 2021. "Nudging at scale: Experimental evidence from FAFSA completion campaigns," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 105-128.
    3. Castleman, Benjamin L. & Page, Lindsay C., 2015. "Summer nudging: Can personalized text messages and peer mentor outreach increase college going among low-income high school graduates?," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 144-160.
    4. Avery, Christopher & Castleman, Benjamin L. & Hurwitz, Michael & Long, Bridget Terry & Page, Lindsay C., 2021. "Digital messaging to improve college enrollment and success," Economics of Education Review, Elsevier, vol. 84(C).
    5. Gabriel D. Carroll & James J. Choi & David Laibson & Brigitte C. Madrian & Andrew Metrick, 2009. "Optimal Defaults and Active Decisions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(4), pages 1639-1674.
    6. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    7. Peter Bergman, 2021. "Parent-Child Information Frictions and Human Capital Investment: Evidence from a Field Experiment," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 286-322.
    8. Peter Bergman & Jeffrey T. Denning & Dayanand Manoli, 2019. "Is Information Enough? The Effect of Information about Education Tax Benefits on Student Outcomes," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 38(3), pages 706-731, June.
    9. John Bound & Sarah Turner, 2002. "Going to War and Going to College: Did World War II and the G.I. Bill Increase Educational Attainment for Returning Veterans?," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 784-815, October.
    10. Michael Hurwitz & Jonathan Smith, 2018. "Student Responsiveness To Earnings Data In The College Scorecard," Economic Inquiry, Western Economic Association International, vol. 56(2), pages 1220-1243, April.
    11. Benjamin L. Castleman & Lindsay C. Page, 2016. "Freshman Year Financial Aid Nudges: An Experiment to Increase FAFSA Renewal and College Persistence," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 389-415.
    12. Beshears, John & Choi, James J. & Laibson, David & Madrian, Brigitte C., 2021. "Active choice, implicit defaults, and the incentive to choose," Organizational Behavior and Human Decision Processes, Elsevier, vol. 163(C), pages 6-16.
    13. Castleman, Benjamin L. & Patterson, Richard & Skimmyhorn, William, 2020. "Benefits left on the table: Evidence from the Servicemembers’ Civil Relief Act," Economics of Education Review, Elsevier, vol. 78(C).
    14. Oreopoulos, Philip & Petronijevic, Uros, 2019. "The Remarkable Unresponsiveness of College Students to Nudging and What We Can Learn from It," IZA Discussion Papers 12460, Institute of Labor Economics (IZA).
    15. Susan E. Mayer & Ariel Kalil & Philip Oreopoulos & Sebastian Gallegos, 2019. "Using Behavioral Insights to Increase Parental Engagement: The Parents and Children Together Intervention," Journal of Human Resources, University of Wisconsin Press, vol. 54(4), pages 900-925.
    16. Beshears, John Leonard & Choi, James & Laibson, David I. & Madrian, Brigitte & Milkman, Katherine L, 2012. "Following through on Good Intentions: The Power of Planning Prompts," Scholarly Articles 8830778, Harvard Kennedy School of Government.
    17. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9-10), pages 1082-1095, October.
    18. Andrew Barr, 2015. "From the Battlefield to the Schoolyard: The Short- Term Impact of the Post- 9/11 GI Bill," Journal of Human Resources, University of Wisconsin Press, vol. 50(3), pages 580-613.
    19. Dean Karlan & Margaret McConnell & Sendhil Mullainathan & Jonathan Zinman, 2016. "Getting to the Top of Mind: How Reminders Increase Saving," Management Science, INFORMS, vol. 62(12), pages 3393-3411, December.
    20. Andrew Barr, 2019. "Fighting for Education: Financial Aid and Degree Attainment," Journal of Labor Economics, University of Chicago Press, vol. 37(2), pages 509-544.
    21. Todd Rogers & Avi Feller, 2018. "Reducing student absences at scale by targeting parents’ misbeliefs," Nature Human Behaviour, Nature, vol. 2(5), pages 335-342, May.
    22. Benjamin N. York & Susanna Loeb, 2014. "One Step at a Time: The Effects of an Early Literacy Text Messaging Program for Parents of Preschoolers," NBER Working Papers 20659, National Bureau of Economic Research, Inc.
    23. Joshua D. Angrist & Stacey H. Chen, 2011. "Schooling and the Vietnam-Era GI Bill: Evidence from the Draft Lottery," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 96-118, April.
    24. Allcott, Hunt, 2011. "Social norms and energy conservation," Journal of Public Economics, Elsevier, vol. 95(9), pages 1082-1095.
    25. Benjamin L. Castleman & Lindsay C. Page & Korynn Schooley, 2014. "The Forgotten Summer: Does the Offer of College Counseling After High School Mitigate Summer Melt Among College‐Intending, Low‐Income High School Graduates?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(2), pages 320-344, March.
    26. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2012. "The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1205-1242.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    2. Castleman, Benjamin L. & Murphy, Francis X. & Patterson, Richard & Skimmyhorn, William L., 2019. "Active Choice Framing and Intergenerational Education Benefits: Evidence from the Field," IZA Discussion Papers 12523, Institute of Labor Economics (IZA).
    3. Bird, Kelli A. & Castleman, Benjamin L. & Denning, Jeffrey T. & Goodman, Joshua & Lamberton, Cait & Rosinger, Kelly Ochs, 2021. "Nudging at scale: Experimental evidence from FAFSA completion campaigns," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 105-128.
    4. Lindsay C. Page & Judith Scott-Clayton, 2015. "Improving College Access in the United States: Barriers and Policy Responses," NBER Working Papers 21781, National Bureau of Economic Research, Inc.
    5. Justin C. Ortagus & Melvin J. Tanner & Isaac McFarlin Jr., 2020. "Can Re-Enrollment Campaigns Help Dropouts Return to College? Evidence from Florida Community Colleges," NBER Working Papers 26649, National Bureau of Economic Research, Inc.
    6. Eric P. Bettinger & Benjamin L. Castleman & Alice Choe & Zachary Mabel, 2022. "Finishing the Last Lap: Experimental Evidence on Strategies to Increase Attainment for Students Near College Completion," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1040-1059, September.
    7. Alina Martinez & Tamara Linkow & Hannah Miller & Amanda Parsad & Cristofer Price, "undated". "Study of College Transition Messaging in GEAR UP: Impacts on Enrolling and Staying in College," Mathematica Policy Research Reports c6113480c8134325ac685ddd9, Mathematica Policy Research.
    8. Avery, Christopher & Castleman, Benjamin L. & Hurwitz, Michael & Long, Bridget Terry & Page, Lindsay C., 2021. "Digital messaging to improve college enrollment and success," Economics of Education Review, Elsevier, vol. 84(C).
    9. Christa Deneault, 2023. "College Enrollment and Mandatory FAFSA Applications: Evidence from Louisiana," American Economic Journal: Economic Policy, American Economic Association, vol. 15(3), pages 465-494, August.
    10. Cortes, Kalena E. & Fricke, Hans & Loeb, Susanna & Song, David S. & York, Ben, 2019. "When Behavioral Barriers Are Too High or Low: How Timing Matters for Parenting Interventions," IZA Discussion Papers 12416, Institute of Labor Economics (IZA).
    11. Oreopoulos, Philip, 2020. "Promises and Limitations of Nudging in Education," IZA Discussion Papers 13718, Institute of Labor Economics (IZA).
    12. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    13. Rodríguez-Planas, Núria & Secor, Alan & De Balanzó Joue, Rafael, 2023. "Resilience-Thinking Training for College Students: Evidence from a Randomized Trial," IZA Discussion Papers 16627, Institute of Labor Economics (IZA).
    14. Bergman, Peter & Denning, Jeffrey T. & Manoli, Dayanand, 2017. "Broken Tax Breaks? Evidence from a Tax Credit Information Experiment with 1,000,000 Students," IZA Discussion Papers 10997, Institute of Labor Economics (IZA).
    15. French, Robert & Oreopoulos, Philip, 2017. "Behavioral barriers transitioning to college," Labour Economics, Elsevier, vol. 47(C), pages 48-63.
    16. Jabbari, Jason & Roll, Stephen & Bufe, Sam & McKay, Jessica, 2022. "“Take my word for it”: Group Texts and Testimonials Enhance State and Federal Student Aid Applications," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    17. Oded Gurantz & Jessica Howell & Michael Hurwitz & Cassandra Larson & Matea Pender & Brooke White, 2021. "A National‐Level Informational Experiment to Promote Enrollment in Selective Colleges," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(2), pages 453-479, March.
    18. Kast, Felipe & Meier, Stephan & Pomeranz, Dina, 2018. "Saving more in groups: Field experimental evidence from Chile," Journal of Development Economics, Elsevier, vol. 133(C), pages 275-294.
    19. Kelly Ochs Rosinger, 2019. "Can Simplifying Financial Aid Offers Impact College Enrollment and Borrowing? Experimental and Quasi-Experimental Evidence," Education Finance and Policy, MIT Press, vol. 14(4), pages 601-626, Fall.
    20. Cortes, Kalena E. & Fricke, Hans & Loeb, Susanna & Song, David S. & York, Benjamin N., 2023. "When behavioral barriers are too high or low – How timing matters for text-based parenting interventions," Economics of Education Review, Elsevier, vol. 92(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jpamgt:v:40:y:2021:i:4:p:1230-1248. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/journal/34787/home .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.