IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/26059.html
   My bibliography  Save this paper

The Remarkable Unresponsiveness of College Students to Nudging And What We Can Learn from It

Author

Listed:
  • Philip Oreopoulos
  • Uros Petronijevic

Abstract

We present results from a five-year effort to design promising online and text-message interventions to improve college achievement through several distinct channels. From a sample of nearly 25,000 students across three different campuses, we find some improvement from coaching-based interventions on mental health and study time, but none of the interventions we evaluate significantly influences academic outcomes (even for those students more at risk of dropping out). We interpret the results with our survey data and a model of student effort. Students study about five to eight hours fewer each week than they plan to, though our interventions do not alter this tendency. The coaching interventions make some students realize that more effort is needed to attain good grades but, rather than working harder, they settle by adjusting grade expectations downwards. Our study time impacts are not large enough for translating into significant academic benefits. More comprehensive but expensive programs appear more promising for helping college students outside the classroom.

Suggested Citation

  • Philip Oreopoulos & Uros Petronijevic, 2019. "The Remarkable Unresponsiveness of College Students to Nudging And What We Can Learn from It," NBER Working Papers 26059, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:26059
    Note: CH ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w26059.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Daron Acemoglu & David Autor, 2012. "What Does Human Capital Do? A Review of Goldin and Katz's The Race between Education and Technology," Journal of Economic Literature, American Economic Association, vol. 50(2), pages 426-463, June.
    2. William N. Evans & Melissa S. Kearney & Brendan Perry & James X. Sullivan, 2020. "Increasing Community College Completion Rates Among Low‐Income Students: Evidence from a Randomized Controlled Trial Evaluation of a Case‐Management Intervention," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(4), pages 930-965, September.
    3. Castleman, Benjamin L. & Page, Lindsay C., 2015. "Summer nudging: Can personalized text messages and peer mentor outreach increase college going among low-income high school graduates?," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 144-160.
    4. Raj Chetty & John N. Friedman & Emmanuel Saez & Nicholas Turner & Danny Yagan, 2017. "Mobility Report Cards: The Role of Colleges in Intergenerational Mobility," Working Papers 2017-059, Human Capital and Economic Opportunity Working Group.
    5. Philip Oreopoulos & Uros Petronijevic, 2018. "Student Coaching: How Far Can Technology Go?," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 299-329.
    6. Oreopoulos, Philip & Petronijevic, Uros & Logel, Christine & Beattie, Graham, 2020. "Improving non-academic student outcomes using online and text-message coaching," Journal of Economic Behavior & Organization, Elsevier, vol. 171(C), pages 342-360.
    7. Adam M. Lavecchia & Heidi Liu & Philip Oreopoulos, 2014. "Behavioral Economics of Education: Progress and Possibilities," NBER Working Papers 20609, National Bureau of Economic Research, Inc.
    8. Charles T. Clotfelter & Steven W. Hemelt & Helen F. Ladd, 2018. "Multifaceted Aid For Low‐Income Students And College Outcomes: Evidence From North Carolina," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 278-303, January.
    9. Christopher R. Dobronyi & Philip Oreopoulos & Uros Petronijevic, 2017. "Goal Setting, Academic Reminders, and College Success: A Large-Scale Field Experiment," NBER Working Papers 23738, National Bureau of Economic Research, Inc.
    10. Martin Nybom, 2017. "The Distribution of Lifetime Earnings Returns to College," Journal of Labor Economics, University of Chicago Press, vol. 35(4), pages 903-952.
    11. Philip Babcock & Mindy Marks, 2011. "The Falling Time Cost of College: Evidence from Half a Century of Time Use Data," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 468-478, May.
    12. Ben Ost & Weixiang Pan & Douglas Webber, 2018. "The Returns to College Persistence for Marginal Students: Regression Discontinuity Evidence from University Dismissal Policies," Journal of Labor Economics, University of Chicago Press, vol. 36(3), pages 779-805.
    13. Benjamin L. Castleman & Lindsay C. Page, 2016. "Freshman Year Financial Aid Nudges: An Experiment to Increase FAFSA Renewal and College Persistence," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 389-415.
    14. George Psacharopoulos & Harry Anthony Patrinos, 2018. "Returns to investment in education: a decennial review of the global literature," Education Economics, Taylor & Francis Journals, vol. 26(5), pages 445-458, September.
    15. Beattie, Graham & Laliberté, Jean-William P. & Oreopoulos, Philip, 2018. "Thrivers and divers: Using non-academic measures to predict college success and failure," Economics of Education Review, Elsevier, vol. 62(C), pages 170-182.
    16. Lavecchia, A.M. & Liu, H. & Oreopoulos, P., 2016. "Behavioral Economics of Education," Handbook of the Economics of Education,, Elsevier.
    17. Smith, Ken G. & Locke, Edwin A. & Barry, David, 1990. "Goal setting, planning, and organizational performance: An experimental simulation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 46(1), pages 118-134, June.
    18. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    19. Caroline M. Hoxby & Kevin Stange, 2018. "Introduction to "Productivity in Higher Education"," NBER Chapters, in: Productivity in Higher Education, pages 1-15, National Bureau of Economic Research, Inc.
    20. Beattie, Graham & Laliberté, Jean-William P. & Michaud-Leclerc, Catherine & Oreopoulos, Philip, 2019. "What sets college thrivers and divers apart? A contrast in study habits, attitudes, and mental health," Economics Letters, Elsevier, vol. 178(C), pages 50-53.
    21. Philip Oreopoulos & Reuben Ford, 2019. "Keeping College Options Open: A Field Experiment to Help all High School Seniors Through the College Application Process," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 38(2), pages 426-454, March.
    22. Philip Oreopoulos & Uros Petronijevic, 2013. "Making College Worth It: A Review of Research on the Returns to Higher Education," NBER Working Papers 19053, National Bureau of Economic Research, Inc.
    23. Philip Oreopoulos & Richard W. Patterson & Uros Petronijevic & Nolan G. Pope, 2018. "When Studying and Nudging Don’t Go as Planned: Unsuccessful Attempts to Help Traditional and Online College Students," NBER Working Papers 25036, National Bureau of Economic Research, Inc.
    24. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2012. "The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1205-1242.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).
    2. Raphael Brade & Oliver Himmler & Robert Jaeckle, 2023. "Relative Performance Feedback and Long-Term Tasks – Experimental Evidence from Higher Education," CESifo Working Paper Series 10346, CESifo.
    3. Oreopoulos, Philip, 2020. "Promises and Limitations of Nudging in Education," IZA Discussion Papers 13718, Institute of Labor Economics (IZA).
    4. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    5. Tamás Keller & Péter Szakál, 2021. "Not just words! Effects of a light-touch randomized encouragement intervention on students’ exam grades, self-efficacy, motivation, and test anxiety," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-27, September.
    6. Serena Canaan & Antoine Deeb & Pierre Mouganie, 2022. "Adviser Value Added and Student Outcomes: Evidence from Randomly Assigned College Advisers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 151-191, November.
    7. Islam, Asad & Kwon, Sungoh & Masood, Eema & Prakash, Nishith & Sabarwal, Shwetlena & Saraswat, Deepak, 2020. "When Goal-Setting Forges Ahead but Stops Short," GLO Discussion Paper Series 526, Global Labor Organization (GLO).
    8. Hervelin Jérémy, 2022. "Directing young dropouts via SMS: evidence from a field experiment," IZA Journal of Labor Policy, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 12(1), pages 1-12, January.
    9. Pugatch, Todd & Schroeder, Elizabeth & Wilson, Nicholas, 2022. "Study More Tomorrow," GLO Discussion Paper Series 1115, Global Labor Organization (GLO).
    10. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    11. Benjamin L. Castleman & Francis X. Murphy & Richard W. Patterson & William L. Skimmyhorn, 2021. "Nudges Don't Work When the Benefits Are Ambiguous: Evidence from a High‐Stakes Education Program," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(4), pages 1230-1248, September.
    12. Philip Oreopoulos, 2021. "What Limits College Success? A Review and Further Analysis of Holzer and Baum's Making College Work," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 546-573, June.
    13. Ferreyra,Maria Marta & Garriga,Carlos & Martin,Juan David & Sanchez Diaz,Angelica Maria, 2020. "Raising College Access and Completion : How Much Can Free College Help ?," Policy Research Working Paper Series 9428, The World Bank.
    14. Bird, Kelli A. & Castleman, Benjamin L. & Denning, Jeffrey T. & Goodman, Joshua & Lamberton, Cait & Rosinger, Kelly Ochs, 2021. "Nudging at scale: Experimental evidence from FAFSA completion campaigns," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 105-128.
    15. Brade, Raphael, 2022. "Social Information and Educational Investment - Nudging Remedial Math Course Participation," MPRA Paper 113076, University Library of Munich, Germany.
    16. Justin C. Ortagus & Melvin J. Tanner & Isaac McFarlin Jr., 2020. "Can Re-Enrollment Campaigns Help Dropouts Return to College? Evidence from Florida Community Colleges," NBER Working Papers 26649, National Bureau of Economic Research, Inc.
    17. Eric P. Bettinger & Benjamin L. Castleman & Alice Choe & Zachary Mabel, 2022. "Finishing the Last Lap: Experimental Evidence on Strategies to Increase Attainment for Students Near College Completion," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1040-1059, September.
    18. Gershoni, Naomi & Stryjan, Miri, 2023. "Do Deadlines Affect Project Completion? Experimental Evidence from Israeli Vocational Colleges," Journal of Economic Behavior & Organization, Elsevier, vol. 205(C), pages 359-375.
    19. Taylor K. Odle & Jennifer A. Delaney, 2022. "You are Admitted! Early Evidence on Enrollment from Idaho’s Direct Admissions System," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(6), pages 899-932, September.
    20. Lynn, Peter & Fumagalli, Laura & Muñoz-Bugarin, Jair, 2021. "Investigating the role of debt advice on borrowers’ well-being. An encouragement study on a new sample of over-indebted people in Britain," ISER Working Paper Series 2021-08, Institute for Social and Economic Research.
    21. William N. Evans & Melissa S. Kearney & Brendan Perry & James X. Sullivan, 2020. "Increasing Community College Completion Rates Among Low‐Income Students: Evidence from a Randomized Controlled Trial Evaluation of a Case‐Management Intervention," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(4), pages 930-965, September.
    22. Brade, Raphael, 2021. "Social Information and Educational Investment – Nudging Remedial Math Course Participation," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242393, Verein für Socialpolitik / German Economic Association.
    23. Kim, Soobin & Yun, John & Schneider, Barbara & Broda, Michael & Klager, Christopher & Chen, I-Chien, 2022. "The effects of growth mindset on college persistence and completion," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 219-235.
    24. Alina Martinez & Tamara Linkow & Hannah Miller & Amanda Parsad & Cristofer Price, "undated". "Study of College Transition Messaging in GEAR UP: Impacts on Enrolling and Staying in College," Mathematica Policy Research Reports c6113480c8134325ac685ddd9, Mathematica Policy Research.
    25. Aizat Nurshatayeva & Lindsay C. Page & Carol C. White & Hunter Gehlbach, 2021. "Are Artificially Intelligent Conversational Chatbots Uniformly Effective in Reducing Summer Melt? Evidence from a Randomized Controlled Trial," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(3), pages 392-402, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Oreopoulos, Philip & Petronijevic, Uros & Logel, Christine & Beattie, Graham, 2020. "Improving non-academic student outcomes using online and text-message coaching," Journal of Economic Behavior & Organization, Elsevier, vol. 171(C), pages 342-360.
    2. French, Robert & Oreopoulos, Philip, 2017. "Behavioral barriers transitioning to college," Labour Economics, Elsevier, vol. 47(C), pages 48-63.
    3. Adam M. Lavecchia & Philip Oreopoulos & Robert S. Brown, 2020. "Long-Run Effects from Comprehensive Student Support: Evidence from Pathways to Education," American Economic Review: Insights, American Economic Association, vol. 2(2), pages 209-224, June.
    4. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    5. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    6. Frauke H. Peter & C. Katharina Spieß & Vaishali Zambre, 2018. "Informing Students about College: An Efficient Way to Decrease the Socio-Economic Gap in Enrollment: Evidence from a Randomized Field Experiment," Discussion Papers of DIW Berlin 1770, DIW Berlin, German Institute for Economic Research.
    7. Alina Martinez & Tamara Linkow & Hannah Miller & Amanda Parsad & Cristofer Price, "undated". "Study of College Transition Messaging in GEAR UP: Impacts on Enrolling and Staying in College," Mathematica Policy Research Reports c6113480c8134325ac685ddd9, Mathematica Policy Research.
    8. Adam Altmejd & Andrés Barrios-Fernández & Marin Drlje & Joshua Goodman & Michael Hurwitz & Dejan Kovac & Christine Mulhern & Christopher Neilson & Jonathan Smith, 2021. "O Brother, Where Start Thou? Sibling Spillovers on College and Major Choice in Four Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(3), pages 1831-1886.
    9. Christopher R. Dobronyi & Philip Oreopoulos & Uros Petronijevic, 2017. "Goal Setting, Academic Reminders, and College Success: A Large-Scale Field Experiment," NBER Working Papers 23738, National Bureau of Economic Research, Inc.
    10. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    11. Beattie, Graham & Laliberté, Jean-William P. & Oreopoulos, Philip, 2018. "Thrivers and divers: Using non-academic measures to predict college success and failure," Economics of Education Review, Elsevier, vol. 62(C), pages 170-182.
    12. Bonilla-Mejía, Leonardo & Bottan, Nicolas L. & Ham, Andrés, 2019. "Information policies and higher education choices experimental evidence from Colombia," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    13. Peter, Frauke & Spiess, C. Katharina & Zambre, Vaishali, 2021. "Informing students about college: Increasing enrollment using a behavioral intervention?," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 524-549.
    14. Bird, Kelli A. & Castleman, Benjamin L. & Denning, Jeffrey T. & Goodman, Joshua & Lamberton, Cait & Rosinger, Kelly Ochs, 2021. "Nudging at scale: Experimental evidence from FAFSA completion campaigns," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 105-128.
    15. Joshua Hyman, 2018. "Nudges, College Enrollment, and College Persistence: Evidence From a Statewide Experiment in Michigan," Working papers 2018-10, University of Connecticut, Department of Economics.
    16. Christopher Neilson & Adam Altmejd & Andres Barrios-Fernandez & Marin Drlje & Dejan Kovac, 2019. "Siblings' Effects on College and Major Choices: Evidence from Chile, Croatia and Sweden," Working Papers 633, Princeton University, Department of Economics, Industrial Relations Section..
    17. Philip Oreopoulos, 2021. "What Limits College Success? A Review and Further Analysis of Holzer and Baum's Making College Work," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 546-573, June.
    18. Hermes, Henning & Lergetporer, Philipp & Peter, Frauke & Wiederhold, Simon, 2021. "Behavioral Barriers and the Socioeconomic Gap in Child Care Enrollment," IZA Discussion Papers 14698, Institute of Labor Economics (IZA).
    19. repec:hal:spmain:info:hdl:2441/527ht1a96e837pq2dubgo2953q is not listed on IDEAS
    20. Henning Hermes & Philipp Lergetporer & Frauke Peter & Simon Wiederhold, 2021. "Application Barriers and the Socioeconomic Gap in Child Care Enrollment," CESifo Working Paper Series 9282, CESifo.
    21. Lindsay C. Page & Judith Scott-Clayton, 2015. "Improving College Access in the United States: Barriers and Policy Responses," NBER Working Papers 21781, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • I2 - Health, Education, and Welfare - - Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:26059. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.