IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/23738.html
   My bibliography  Save this paper

Goal Setting, Academic Reminders, and College Success: A Large-Scale Field Experiment

Author

Listed:
  • Christopher R. Dobronyi
  • Philip Oreopoulos
  • Uros Petronijevic

Abstract

This paper presents an independent large-scale experimental evaluation of two online goal-setting interventions. Both interventions are based on promising findings from the field of social psychology. Approximately 1,400 first-year undergraduate students at a large Canadian university were randomly assigned to complete one of two online goal-setting treatments or a control task. Additionally, half of treated participants also were offered the opportunity to receive follow-up goal-oriented reminders through e-mail or text messages in an attempt to test a cost-effective method for increasing the saliency of treatment. Across all treatment groups, we observe no evidence of an effect on GPA, course credits, or second year persistence. Our estimates are precise enough to discern a seven percent standardized performance effect at a five percent significance level. Our results hold by subsample, for various outcome variables, and across a number of specifications.

Suggested Citation

  • Christopher R. Dobronyi & Philip Oreopoulos & Uros Petronijevic, 2017. "Goal Setting, Academic Reminders, and College Success: A Large-Scale Field Experiment," NBER Working Papers 23738, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:23738
    Note: CH ED LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w23738.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philip Oreopoulos & Robert S. Brown & Adam M. Lavecchia, 2017. "Pathways to Education: An Integrated Approach to Helping At-Risk High School Students," Journal of Political Economy, University of Chicago Press, vol. 125(4), pages 947-984.
    2. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    3. Philippe Belley & Lance Lochner, 2007. "The Changing Role of Family Income and Ability in Determining Educational Achievement," Journal of Human Capital, University of Chicago Press, vol. 1(1), pages 37-89.
    4. Tim Kautz & James J. Heckman & Ron Diris & Bas ter Weel & Lex Borghans, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-cognitive Skills to Promote Lifetime Success," OECD Education Working Papers 110, OECD Publishing.
    5. Sara Heller & Harold A. Pollack & Roseanna Ander & Jens Ludwig, 2013. "Preventing Youth Violence and Dropout: A Randomized Field Experiment," NBER Working Papers 19014, National Bureau of Economic Research, Inc.
    6. Kraft, Matthew A. & Rogers, Todd, 2015. "The underutilized potential of teacher-to-parent communication: Evidence from a field experiment," Economics of Education Review, Elsevier, vol. 47(C), pages 49-63.
    7. Philip Oreopoulos & Uros Petronijevic, 2018. "Student Coaching: How Far Can Technology Go?," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 299-329.
    8. Adam M. Lavecchia & Heidi Liu & Philip Oreopoulos, 2014. "Behavioral Economics of Education: Progress and Possibilities," NBER Working Papers 20609, National Bureau of Economic Research, Inc.
    9. Susan E. Mayer & Ariel Kalil & Philip Oreopoulos & Sebastian Gallegos, 2015. "Using Behavioral Insights to Increase Parental Engagement: The Parents and Children Together (PACT) Intervention," NBER Working Papers 21602, National Bureau of Economic Research, Inc.
    10. Beattie, Graham & Laliberté, Jean-William P. & Oreopoulos, Philip, 2018. "Thrivers and divers: Using non-academic measures to predict college success and failure," Economics of Education Review, Elsevier, vol. 62(C), pages 170-182.
    11. Lavecchia, A.M. & Liu, H. & Oreopoulos, P., 2016. "Behavioral Economics of Education," Handbook of the Economics of Education,, Elsevier.
    12. Smith, Ken G. & Locke, Edwin A. & Barry, David, 1990. "Goal setting, planning, and organizational performance: An experimental simulation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 46(1), pages 118-134, June.
    13. Locke, Edwin A. & Chah, Dong-Ok & Harrison, Scott & Lustgarten, Nancy, 1989. "Separating the effects of goal specificity from goal level," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(2), pages 270-287, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    2. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    3. Adam M. Lavecchia & Philip Oreopoulos & Robert S. Brown, 2020. "Long-Run Effects from Comprehensive Student Support: Evidence from Pathways to Education," American Economic Review: Insights, American Economic Association, vol. 2(2), pages 209-224, June.
    4. Islam, Asad & Kwon, Sungoh & Masood, Eema & Prakash, Nishith & Sabarwal, Shwetlena & Saraswat, Deepak, 2020. "When Goal-Setting Forges Ahead but Stops Short," GLO Discussion Paper Series 526, Global Labor Organization (GLO).
    5. Philip Oreopoulos & Uros Petronijevic, 2019. "The Remarkable Unresponsiveness of College Students to Nudging And What We Can Learn from It," NBER Working Papers 26059, National Bureau of Economic Research, Inc.
    6. Megan M. Tippetts & Bobbi Davis & Stephanie Nalbone & Cathleen D. Zick, 2022. "Thx 4 the msg: Assessing the Impact of Texting on Student Engagement and Persistence," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(6), pages 1073-1093, September.
    7. Philip Oreopoulos & Richard W. Patterson & Uros Petronijevic & Nolan G. Pope, 2018. "When Studying and Nudging Don’t Go as Planned: Unsuccessful Attempts to Help Traditional and Online College Students," NBER Working Papers 25036, National Bureau of Economic Research, Inc.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    2. Oreopoulos, Philip & Petronijevic, Uros, 2019. "The Remarkable Unresponsiveness of College Students to Nudging and What We Can Learn from It," IZA Discussion Papers 12460, Institute of Labor Economics (IZA).
    3. Philip Oreopoulos & Uros Petronijevic, 2018. "Student Coaching: How Far Can Technology Go?," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 299-329.
    4. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    5. Adam M. Lavecchia & Philip Oreopoulos & Robert S. Brown, 2020. "Long-Run Effects from Comprehensive Student Support: Evidence from Pathways to Education," American Economic Review: Insights, American Economic Association, vol. 2(2), pages 209-224, June.
    6. Beattie, Graham & Laliberté, Jean-William P. & Oreopoulos, Philip, 2018. "Thrivers and divers: Using non-academic measures to predict college success and failure," Economics of Education Review, Elsevier, vol. 62(C), pages 170-182.
    7. Oreopoulos, Philip & Petronijevic, Uros & Logel, Christine & Beattie, Graham, 2020. "Improving non-academic student outcomes using online and text-message coaching," Journal of Economic Behavior & Organization, Elsevier, vol. 171(C), pages 342-360.
    8. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).
    9. Adam Altmejd & Andrés Barrios-Fernández & Marin Drlje & Joshua Goodman & Michael Hurwitz & Dejan Kovac & Christine Mulhern & Christopher Neilson & Jonathan Smith, 2021. "O Brother, Where Start Thou? Sibling Spillovers on College and Major Choice in Four Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(3), pages 1831-1886.
    10. Canaan, Serena & Mouganie, Pierre, 2019. "Female Science Advisors and the STEM Gender Gap," IZA Discussion Papers 12415, Institute of Labor Economics (IZA).
    11. Bonilla-Mejía, Leonardo & Bottan, Nicolas L. & Ham, Andrés, 2019. "Information policies and higher education choices experimental evidence from Colombia," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    12. Saltiel, Fernando, 2020. "Gritting it out: The importance of non-cognitive skills in academic mismatch," Economics of Education Review, Elsevier, vol. 78(C).
    13. Lindsay C. Page & Judith Scott-Clayton, 2015. "Improving College Access in the United States: Barriers and Policy Responses," NBER Working Papers 21781, National Bureau of Economic Research, Inc.
    14. Boockmann, Bernhard & Nielen, Sebastian, 2016. "Mentoring disadvantaged youths during school-to-work transition: evidence from Germany," VfS Annual Conference 2016 (Augsburg): Demographic Change 145770, Verein für Socialpolitik / German Economic Association.
    15. Frauke H. Peter & C. Katharina Spieß & Vaishali Zambre, 2018. "Informing Students about College: An Efficient Way to Decrease the Socio-Economic Gap in Enrollment: Evidence from a Randomized Field Experiment," Discussion Papers of DIW Berlin 1770, DIW Berlin, German Institute for Economic Research.
    16. French, Robert & Oreopoulos, Philip, 2017. "Behavioral barriers transitioning to college," Labour Economics, Elsevier, vol. 47(C), pages 48-63.
    17. Judith Scott-Clayton & Lauren Schudde, 2016. "Performance Standards in Need-Based Student Aid," NBER Working Papers 22713, National Bureau of Economic Research, Inc.
    18. Peter Leopold S. Bergman & Eric W. Chan, 2017. "Leveraging Technology to Engage Parents at Scale: Evidence from a Randomized Controlled Trial," CESifo Working Paper Series 6493, CESifo.
    19. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    20. Elizabeth M. Caucutt & Lance Lochner & Youngmin Park, 2017. "Correlation, Consumption, Confusion, or Constraints: Why Do Poor Children Perform so Poorly?," Scandinavian Journal of Economics, Wiley Blackwell, vol. 119(1), pages 102-147, January.

    More about this item

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:23738. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.