IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp4754.html
   My bibliography  Save this paper

Longer-Term Impacts of Mentoring, Educational Services, and Incentives to Learn: Evidence from a Randomized Trial

Author

Listed:
  • Rodríguez-Planas, Núria

    (Queens College, CUNY)

Abstract

This paper is the first to use a randomized trial in the US to analyze the short- and long-term educational and employment impacts of an after-school program, the Quantum Opportunity Program, that offered disadvantaged high-school youth: mentoring, educational services, and financial rewards with the objective to improve high-school graduation and post-secondary schooling enrollment. Average impacts reveal that the hefty beneficial educational outcomes quickly faded away. Heterogeneity matters. While encouraging results are found for the younger youth; detrimental long-lived outcomes for males suggest that extrinsic rewards may be crowding out intrinsic motivation. Evidence by sites' funding source, which led to implementation differences, supports this hypothesis.

Suggested Citation

  • Rodríguez-Planas, Núria, 2010. "Longer-Term Impacts of Mentoring, Educational Services, and Incentives to Learn: Evidence from a Randomized Trial," IZA Discussion Papers 4754, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp4754
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp4754.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas J. Kane, 2007. "Evaluating the Impact of the D.C. Tuition Assistance Grant Program," Journal of Human Resources, University of Wisconsin Press, vol. 42(3).
    2. Gerfin, Michael & Lechner, Michael & Steiger, Heidi, 2005. "Does subsidised temporary employment get the unemployed back to work? Aneconometric analysis of two different schemes," Labour Economics, Elsevier, vol. 12(6), pages 807-835, December.
    3. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    4. Eric P. Bettinger & Bridget Terry Long, 2009. "Addressing the Needs of Underprepared Students in Higher Education: Does College Remediation Work?," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    5. Heckman, James J & Lochner, Lance & Taber, Christopher, 1998. "Tax Policy and Human-Capital Formation," American Economic Review, American Economic Association, vol. 88(2), pages 293-297, May.
    6. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, Oxford University Press, vol. 122(3), pages 1235-1264.
    7. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    8. Eliana Garces & Duncan Thomas & Janet Currie, 2002. "Longer-Term Effects of Head Start," American Economic Review, American Economic Association, vol. 92(4), pages 999-1012, September.
    9. Pietro Garibaldi & Francesco Giavazzi & Andrea Ichino & Enrico Rettore, 2012. "College Cost and Time to Complete a Degree: Evidence from Tuition Discontinuities," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 699-711, August.
    10. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    11. Michael Kremer & Edward Miguel & Rebecca Thornton, 2009. "Incentives to Learn," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 437-456, August.
    12. Edwin Leuven & Hessel Oosterbeek & Bas van der Klaauw, 2010. "The Effect of Financial Rewards on Students' Achievement: Evidence from a Randomized Experiment," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1243-1265, December.
    13. Edwin Leuven & Hessel Oosterbeek & Bas van der Klaauw, 2010. "The Effect of Financial Rewards on Students' Achievement: Evidence from a Randomized Experiment," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1243-1265, December.
    14. James Heckman, 2011. "Policies to foster human capital," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 73-137.
    15. repec:mpr:mprres:3655 is not listed on IDEAS
    16. Susan M. Dynarski, 2003. "Does Aid Matter? Measuring the Effect of Student Aid on College Attendance and Completion," American Economic Review, American Economic Association, vol. 93(1), pages 279-288, March.
    17. Victor Lavy & Analia Schlosser, 2005. "Targeted Remedial Education for Underperforming Teenagers: Costs and Benefits," Journal of Labor Economics, University of Chicago Press, vol. 23(4), pages 839-874, October.
    18. Carneiro, Pedro & Heckman, James J., 2003. "Human Capital Policy," IZA Discussion Papers 821, Institute of Labor Economics (IZA).
    19. Cameron, Stephen V & Heckman, James J, 1993. "The Nonequivalence of High School Equivalents," Journal of Labor Economics, University of Chicago Press, vol. 11(1), pages 1-47, January.
    20. Stephen Machin & Sandra McNally & Costas Meghir, 2010. "Resources and Standards in Urban Schools," Journal of Human Capital, University of Chicago Press, vol. 4(4), pages 365-393.
    21. Edward P. Lazear, 2000. "Performance Pay and Productivity," American Economic Review, American Economic Association, vol. 90(5), pages 1346-1361, December.
    22. repec:mpr:mprres:6097 is not listed on IDEAS
    23. Jacob A. Mincer, 1974. "Schooling, Experience, and Earnings," NBER Books, National Bureau of Economic Research, Inc, number minc74-1.
    24. Joshua Angrist & Eric Bettinger & Michael Kremer, 2006. "Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," American Economic Review, American Economic Association, vol. 96(3), pages 847-862, June.
    25. Cornwell, Christopher & Lee, Kyung Hee & Mustard, David B., 2003. "The Effects of Merit-Based Financial Aid on Course Enrollment, Withdrawal and Completion in College," IZA Discussion Papers 820, Institute of Labor Economics (IZA).
    26. C. Kirabo Jackson, 2010. "A Little Now for a Lot Later: A Look at a Texas Advanced Placement Incentive Program," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
    27. Christopher Cornwell & David B. Mustard & Deepa J. Sridhar, 2006. "The Enrollment Effects of Merit-Based Financial Aid: Evidence from Georgia's HOPE Program," Journal of Labor Economics, University of Chicago Press, vol. 24(4), pages 761-786, October.
    28. Peter Z. Schochet & John Burghardt & Sheena McConnell, "undated". "Does Job Corps Work? Impact Findings from the National Job Corps Study," Mathematica Policy Research Reports 5067e4907eba4a4881f510080, Mathematica Policy Research.
    29. Krueger, Alan B & Whitmore, Diane M, 2001. "The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR," Economic Journal, Royal Economic Society, vol. 111(468), pages 1-28, January.
    30. Saul Pleeter & John T. Warner, 2001. "The Personal Discount Rate: Evidence from Military Downsizing Programs," American Economic Review, American Economic Association, vol. 91(1), pages 33-53, March.
    31. Susan Dynarski, 2008. "Building the Stock of College-Educated Labor," Journal of Human Resources, University of Wisconsin Press, vol. 43(3), pages 576-610.
    32. Orazio Attanasio & Emla Fitzsimons & Ana Gómez & Martha Isabel Gutierrez & Costas Meghir & Alice Mesnard, 2006. "Child education and work choices in the presence of a conditional cash transfer programme in rural Colombia," IFS Working Papers W06/13, Institute for Fiscal Studies.
    33. Bettinger, Eric & Slonim, Robert, 2007. "Patience among children," Journal of Public Economics, Elsevier, vol. 91(1-2), pages 343-363, February.
    34. Janet Currie, 2001. "Early Childhood Education Programs," Journal of Economic Perspectives, American Economic Association, vol. 15(2), pages 213-238, Spring.
    35. Allen Schirm & Nuria Rodriguez-Planas & Myles Maxfield & Christina Clark Tuttle, 2003. "The Quantum Opportunity Program Demonstration: Short-Term Impacts," Mathematica Policy Research Reports 3bb786088fbe413b8ea3fd69a, Mathematica Policy Research.
    36. Elizabeth U. Cascio & Ethan G. Lewis, 2006. "Schooling and the Armed Forces Qualifying Test: Evidence from School-Entry Laws," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    37. Helena Holmlund & Olmo Silva, 2014. "Targeting Noncognitive Skills to Improve Cognitive Outcomes: Evidence from a Remedial Education Intervention," Journal of Human Capital, University of Chicago Press, vol. 8(2), pages 126-160.
    38. Bruno S. Frey, 1994. "How Intrinsic Motivation is Crowded out and in," Rationality and Society, , vol. 6(3), pages 334-352, July.
    39. Stephen Machin & Sandra McNally & Costas Meghir, 2004. "Improving Pupil Performance in English Secondary Schools: Excellence in Cities," Journal of the European Economic Association, MIT Press, vol. 2(2-3), pages 396-405, 04/05.
    40. Kluve, Jochen, 2006. "The Effectiveness of European Active Labor Market Policy," RWI Discussion Papers 37, RWI - Leibniz-Institut für Wirtschaftsforschung.
    41. David Deming & Susan Dynarski, 2009. "Into College, Out of Poverty? Policies to Increase the Postsecondary Attainment of the Poor," NBER Working Papers 15387, National Bureau of Economic Research, Inc.
    42. Lorraine Dearden & Carl Emmerson & Christine Frayne & Costas Meghir, 2005. "Education subsidies and school drop-out rates," IFS Working Papers W05/11, Institute for Fiscal Studies.
    43. repec:mpr:mprres:3525 is not listed on IDEAS
    44. Myles Maxfield & Laura Castner & Vida Maralani & Mary Vencill, 2003. "The Quantum Opportunity Program Demonstration: Implementation Findings," Mathematica Policy Research Reports 454e8a1ad16943249a9f9577d, Mathematica Policy Research.
    45. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    46. Peter Z. Schochet & John Burghardt & Sheena McConnell, 2008. "Does Job Corps Work? Impact Findings from the National Job Corps Study," American Economic Review, American Economic Association, vol. 98(5), pages 1864-1886, December.
    47. Kane, Thomas J., 1998. "Savings Incentives for Higher Education," National Tax Journal, National Tax Association, vol. 51(n. 3), pages 609-20, September.
    48. Jacob A. Mincer, 1974. "Schooling and Earnings," NBER Chapters, in: Schooling, Experience, and Earnings, pages 41-63, National Bureau of Economic Research, Inc.
    49. Kluve, Jochen, 2006. "The Effectiveness of European Active Labor Market Policy," IZA Discussion Papers 2018, Institute of Labor Economics (IZA).
    50. Duflo, Esther & Kremer, Michael & Robinson, Jonathan, 2009. "Nudging Farmers to Utilize Fertilizer: Theory and Experimental Evidence from Kenya," CEPR Discussion Papers 7402, C.E.P.R. Discussion Papers.
    51. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, Oxford University Press, vol. 112(2), pages 443-478.
    52. repec:zbw:rwidps:0037 is not listed on IDEAS
    53. repec:mpr:mprres:5879 is not listed on IDEAS
    54. Zvi Eckstein & Kenneth I. Wolpin, 1999. "Why Youths Drop Out of High School: The Impact of Preferences, Opportunities, and Abilities," Econometrica, Econometric Society, vol. 67(6), pages 1295-1340, November.
    55. Kane, Thomas J., 1998. "Savings Incentives for Higher Education," National Tax Journal, National Tax Association;National Tax Journal, vol. 51(3), pages 609-620, September.
    56. Robert Gibbons, 1996. "Incentives and Careers in Organizations," NBER Working Papers 5705, National Bureau of Economic Research, Inc.
    57. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joshua Angrist & Philip Oreopoulos & Tyler Williams, 2014. "When Opportunity Knocks, Who Answers?: New Evidence on College Achievement Awards," Journal of Human Resources, University of Wisconsin Press, vol. 49(3), pages 572-610.
    2. Bentaouet Kattan,Raja & Székely,Miguel, 2015. "Analyzing the dynamics of school dropout in upper secondary education in Latin America : a cohort approach," Policy Research Working Paper Series 7223, The World Bank.
    3. Gabriella Conti & James J. Heckman, 2012. "The Economics of Child Well-Being," NBER Working Papers 18466, National Bureau of Economic Research, Inc.
    4. Robert Metcalfe & Simon Burgess and Steven Proud, 2011. "Student effort and educational attainment: Using the England football team to identify the education production function," Economics Series Working Papers 586, University of Oxford, Department of Economics.
    5. Núria Rodríquez-Planas, 2010. "Mentoring, Educational Services, and Economic Incentives Longer-term Evidence on Risky Behaviors from a Randomized Trial," Working Papers 462, Barcelona School of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Núria Rodríquez-Planas, 2010. "Longer-term Impacts of Mentoring, Educational Services, and Incentives to Learn: Evidence from a Randomized Trial in the United States," UFAE and IAE Working Papers 821.10, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    2. Rodríguez-Planas, Núria, 2010. "Mentoring, Educational Services, and Incentives to Learn: What Do We Know About Them?," IZA Discussion Papers 5255, Institute of Labor Economics (IZA).
    3. Núria Rodríquez-Planas, 2010. "Mentoring, Educational Services, and Economic Incentives Longer-term Evidence on Risky Behaviors from a Randomized Trial," Working Papers 462, Barcelona School of Economics.
    4. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    5. Rodríguez-Planas, Núria, 2017. "School, drugs, mentoring, and peers: Evidence from a randomized trial in the US," Journal of Economic Behavior & Organization, Elsevier, vol. 139(C), pages 166-181.
    6. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    7. Rodríguez-Planas, Núria, 2012. "School and Drugs: Closing the Gap – Evidence from a Randomized Trial in the US," IZA Discussion Papers 6770, Institute of Labor Economics (IZA).
    8. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    9. Victor Lavy & Analia Schlosser, 2005. "Targeted Remedial Education for Underperforming Teenagers: Costs and Benefits," Journal of Labor Economics, University of Chicago Press, vol. 23(4), pages 839-874, October.
    10. Lindsay C. Page & Judith Scott-Clayton, 2015. "Improving College Access in the United States: Barriers and Policy Responses," NBER Working Papers 21781, National Bureau of Economic Research, Inc.
    11. Koch, Alexander & Nafziger, Julia & Nielsen, Helena Skyt, 2015. "Behavioral economics of education," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 3-17.
    12. Denny, Kevin & Doyle, Orla & McMullin, Patricia & O'Sullivan, Vincent, 2014. "Money, mentoring and making friends: The impact of a multidimensional access program on student performance," Economics of Education Review, Elsevier, vol. 40(C), pages 167-182.
    13. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    14. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.
    15. Uwe Dulleck & Juliana Silva-Goncalves & Benno Torgler, 2014. "Impact Evaluation of an Incentive Program on Educational Achievement of Indigenous Students," CREMA Working Paper Series 2014-13, Center for Research in Economics, Management and the Arts (CREMA).
    16. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    17. Núria Rodríguez-Planas, 2012. "Longer-Term Impacts of Mentoring, Educational Services, and Learning Incentives: Evidence from a Randomized Trial in the United States," American Economic Journal: Applied Economics, American Economic Association, vol. 4(4), pages 121-139, October.
    18. Martins, Pedro S., 2017. "Can Non-Cognitive Skills Programs Improve Achievement? Quasi-Experimental Evidence from EPIS," GLO Discussion Paper Series 105, Global Labor Organization (GLO).
    19. Pedro S. Martins, 2017. "(How) Do Non-Cognitive Skills Programs Improve Adolescent School Achievement? Experimental Evidence," Working Papers 81, Queen Mary, University of London, School of Business and Management, Centre for Globalisation Research.
    20. Elena Mattana & Juanna Joensen, 2016. "Student Aid, Academic Achievement, and Labor Market Behavior," 2016 Meeting Papers 1102, Society for Economic Dynamics.

    More about this item

    Keywords

    medium- and long-term effects; educational and employment outcomes; intrinsic and extrinsic motivation; short-; after-school programs;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp4754. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.