IDEAS home Printed from https://ideas.repec.org/a/spr/reihed/v57y2016i8d10.1007_s11162-016-9413-3.html
   My bibliography  Save this article

Pell Grants as Performance-Based Scholarships? An Examination of Satisfactory Academic Progress Requirements in the Nation’s Largest Need-Based Aid Program

Author

Listed:
  • Lauren Schudde

    (The University of Texas at Austin)

  • Judith Scott-Clayton

    (Teachers College, Columbia University)

Abstract

The Federal Pell Grant Program is the nation’s largest need-based grant program. While students’ initial eligibility for the Pell is based on financial need, renewal is contingent on meeting minimum academic standards similar to those in models of performance-based scholarships, including a grade point average (GPA) requirement and ratio of credits completed compared to those attempted. In this study, we describe federal satisfactory academic progress (SAP) requirements and illustrate the policy’s implementation in a statewide community college system. Using state administrative data, we demonstrate that a substantial portion of Pell recipients are at risk for Pell ineligibility due to their failure to meet SAP GPA or credit completion requirements. We then leverage the GPA component of the policy to explore the impacts of failure to meet standards on early college persistence and achievement, earning a credential, and transferring to a 4-year college using two methodological approaches: regression discontinuity (RD) and difference-in-differences (DD). Our results across the two approaches are mixed, with the RD providing null estimates and the DD indicating statistically significant impacts, including a negative effect on early college persistence. We conclude by discussing the implications for future research.

Suggested Citation

  • Lauren Schudde & Judith Scott-Clayton, 2016. "Pell Grants as Performance-Based Scholarships? An Examination of Satisfactory Academic Progress Requirements in the Nation’s Largest Need-Based Aid Program," Research in Higher Education, Springer;Association for Institutional Research, vol. 57(8), pages 943-967, December.
  • Handle: RePEc:spr:reihed:v:57:y:2016:i:8:d:10.1007_s11162-016-9413-3
    DOI: 10.1007/s11162-016-9413-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11162-016-9413-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11162-016-9413-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alan I. Barreca & Jason M. Lindo & Glen R. Waddell, 2016. "Heaping-Induced Bias In Regression-Discontinuity Designs," Economic Inquiry, Western Economic Association International, vol. 54(1), pages 268-293, January.
    2. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust data-driven inference in the regression-discontinuity design," Stata Journal, StataCorp LP, vol. 14(4), pages 909-946, December.
    3. Carruthers, Celeste K. & Özek, Umut, 2016. "Losing HOPE: Financial aid and the line between college and work," Economics of Education Review, Elsevier, vol. 53(C), pages 1-15.
    4. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    5. Lisa Barrow & Lashawn Richburg-Hayes & Cecilia Elena Rouse & Thomas Brock, 2014. "Paying for Performance: The Education Impacts of a Community College Scholarship Program for Low-Income Adults," Journal of Labor Economics, University of Chicago Press, vol. 32(3), pages 563-599.
    6. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    7. Christopher Cornwell & David B. Mustard & Deepa J. Sridhar, 2006. "The Enrollment Effects of Merit-Based Financial Aid: Evidence from Georgia's HOPE Program," Journal of Labor Economics, University of Chicago Press, vol. 24(4), pages 761-786, October.
    8. Susan Dynarski, 2008. "Building the Stock of College-Educated Labor," Journal of Human Resources, University of Wisconsin Press, vol. 43(3), pages 576-610.
    9. Susan M. Dynarski, 2003. "Does Aid Matter? Measuring the Effect of Student Aid on College Attendance and Completion," American Economic Review, American Economic Association, vol. 93(1), pages 279-288, March.
    10. Eric Bettinger, 2004. "How Financial Aid Affects Persistence," NBER Chapters, in: College Choices: The Economics of Where to Go, When to Go, and How to Pay For It, pages 207-238, National Bureau of Economic Research, Inc.
    11. Roland Bénabou & Jean Tirole, 2005. "Self-Confidence and Personal Motivation," International Economic Association Series, in: Bina Agarwal & Alessandro Vercelli (ed.), Psychology, Rationality and Economic Behaviour, chapter 2, pages 19-57, Palgrave Macmillan.
    12. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    13. Caroline M. Hoxby, 2004. "College Choices: The Economics of Where to Go, When to Go, and How to Pay For It," NBER Books, National Bureau of Economic Research, Inc, number hoxb04-1, March.
    14. Benjamin L. Castleman & Bridget Terry Long, 2016. "Looking beyond Enrollment: The Causal Effect of Need-Based Grants on College Access, Persistence, and Graduation," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 1023-1073.
    15. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    16. Paco Martorell & Brian McCall & Isaac McFarlin, 2014. "Do Public Tuition Subsidies Promote College Enrollment? Evidence From Community College Taxing Districts In Texas," Working Papers 14-32, Center for Economic Studies, U.S. Census Bureau.
    17. Guido Imbens & Karthik Kalyanaraman, 2012. "Optimal Bandwidth Choice for the Regression Discontinuity Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(3), pages 933-959.
    18. Marcus D. Casey & Jeffrey Cline & Ben Ost & Javaeria A. Qureshi, 2018. "Academic Probation, Student Performance, And Strategic Course‐Taking," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1646-1677, July.
    19. Christopher M. Cornwell & Kyung Hee Lee & David B. Mustard, 2005. "Student Responses to Merit Scholarship Retention Rules," Journal of Human Resources, University of Wisconsin Press, vol. 40(4), pages 895-917.
    20. Caroline Minter Hoxby, 2004. "Introduction to "College Choices: The Economics of Where to Go, When to Go, and How to Pay For It"," NBER Chapters, in: College Choices: The Economics of Where to Go, When to Go, and How to Pay For It, pages 1-12, National Bureau of Economic Research, Inc.
    21. Thomas J. Kane, 1995. "Rising Public College Tuition and College Entry: How Well Do Public Subsidies Promote Access to College?," NBER Working Papers 5164, National Bureau of Economic Research, Inc.
    22. Sarah R. Cohodes & Joshua S. Goodman, 2014. "Merit Aid, College Quality, and College Completion: Massachusetts' Adams Scholarship as an In-Kind Subsidy," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 251-285, October.
    23. Alan I. Barreca & Melanie Guldi & Jason M. Lindo & Glen R. Waddell, 2011. "Saving Babies? Revisiting the effect of very low birth weight classification," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 2117-2123.
    24. Joshua Angrist & David Autor & Sally Hudson & Amanda Pallais, 2014. "Leveling Up: Early Results from a Randomized Evaluation of Post-Secondary Aid," NBER Working Papers 20800, National Bureau of Economic Research, Inc.
    25. Altonji, Joseph G, 1993. "The Demand for and Return to Education When Education Outcomes Are Uncertain," Journal of Labor Economics, University of Chicago Press, vol. 11(1), pages 48-83, January.
    26. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
    27. Judith Scott-Clayton, 2011. "On Money and Motivation: A Quasi-Experimental Analysis of Financial Incentives for College Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 614-646.
    28. Manski, Charles F., 1989. "Schooling as experimentation: a reappraisal of the postsecondary dropout phenomenon," Economics of Education Review, Elsevier, vol. 8(4), pages 305-312, August.
    29. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2012. "The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1205-1242.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lisa Barrow & Cecilia Elena Rouse, 2018. "Financial Incentives and Educational Investment: The Impact of Performance-based Scholarships on Student Time Use," Education Finance and Policy, MIT Press, vol. 13(4), pages 419-448, Fall.
    2. Lindsay C. Page & Jennifer E. Iriti & Danielle J. Lowry & Aaron M. Anthony, 2019. "The Promise of Place-Based Investment in Postsecondary Access and Success: Investigating the Impact of the Pittsburgh Promise," Education Finance and Policy, MIT Press, vol. 14(4), pages 572-600, Fall.
    3. Zachary Mabel, 2020. "Aiding or Dissuading? The Effects of Reducing Lifetime Eligibility Limits for Need-Based Aid on Bachelor’s Degree Attainment and Time to Completion," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(8), pages 966-1001, December.
    4. Francesca Modena & Giulia Martina Tanzi & Santiago Pereda Fernandez, 2020. "On the design of grant assignment rules," Temi di discussione (Economic working papers) 1307, Bank of Italy, Economic Research and International Relations Area.
    5. Jeffrey T. Denning & Eric R. Eide & Kevin J. Mumford & Richard W. Patterson & Merrill Warnick, 2022. "Why Have College Completion Rates Increased?," American Economic Journal: Applied Economics, American Economic Association, vol. 14(3), pages 1-29, July.
    6. Keskiner, Hilal & Gür, Bekir S., 2023. "Questioning merit-based scholarships at nonprofit private universities: Lessons from Turkey," International Journal of Educational Development, Elsevier, vol. 97(C).
    7. Shuyu Qi & Qiutong Ma & Xiaohui Ji, 2022. "The Influence of Financial Aid Systems on Student Academic Development in Higher Education in China," Sustainability, MDPI, vol. 14(21), pages 1-20, October.
    8. Nicholas A. Bowman & Nayoung Jang & D. Martin Kivlighan & Nancy Schneider & Xiaomeng Ye, 2020. "The Impact of a Goal-Setting Intervention for Engineering Students on Academic Probation," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(1), pages 142-166, February.
    9. Minaya, Veronica & Agasisti, Tommaso & Bratti, Massimiliano, 2022. "When need meets merit: The effect of increasing merit requirements in need-based student aid," European Economic Review, Elsevier, vol. 146(C).
    10. Nicholas A. Bowman & Nayoung Jang, 2022. "What is the Purpose of Academic Probation? Its Substantial Negative Effects on Four-Year Graduation," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(8), pages 1285-1311, December.
    11. Vivian Yuen Ting Liu, 2020. "Is School Out for the Summer? The Impact of Year-Round Pell Grants on Academic and Employment Outcomes of Community College Students," Education Finance and Policy, MIT Press, vol. 15(2), pages 241-269, Spring.
    12. Carruthers, Celeste K. & Welch, Jilleah G., 2019. "Not whether, but where? Pell grants and college choices," Journal of Public Economics, Elsevier, vol. 172(C), pages 1-19.
    13. Wright, Nicholas A., 2021. "Need-based financing policies, college decision-making, and labor market behavior: Evidence from Jamaica," Journal of Development Economics, Elsevier, vol. 150(C).
    14. Judith Scott-Clayton & Lauren Schudde, 2016. "Performance Standards in Need-Based Student Aid," NBER Working Papers 22713, National Bureau of Economic Research, Inc.
    15. Veronica Rattini, 2022. "The Effects of Financial Aid on Graduation and Labor Market Outcomes: New Evidence from Matched Education-Labor Data," CESifo Working Paper Series 10010, CESifo.
    16. Anderson, Drew M. & Goldrick-Rab, Sara, 2018. "Aid after enrollment: Impacts of a statewide grant program at public two-year colleges," Economics of Education Review, Elsevier, vol. 67(C), pages 148-157.
    17. Rachel Baker & Brent Evans & Qiujie Li & Bianca Cung, 2019. "Does Inducing Students to Schedule Lecture Watching in Online Classes Improve Their Academic Performance? An Experimental Analysis of a Time Management Intervention," Research in Higher Education, Springer;Association for Institutional Research, vol. 60(4), pages 521-552, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lindsay C. Page & Judith Scott-Clayton, 2015. "Improving College Access in the United States: Barriers and Policy Responses," NBER Working Papers 21781, National Bureau of Economic Research, Inc.
    2. Judith Scott-Clayton & Lauren Schudde, 2016. "Performance Standards in Need-Based Student Aid," NBER Working Papers 22713, National Bureau of Economic Research, Inc.
    3. Veronica Rattini, 2022. "The Effects of Financial Aid on Graduation and Labor Market Outcomes: New Evidence from Matched Education-Labor Data," CESifo Working Paper Series 10010, CESifo.
    4. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    5. Bruce, Donald J. & Carruthers, Celeste K., 2014. "Jackpot? The impact of lottery scholarships on enrollment in Tennessee," Journal of Urban Economics, Elsevier, vol. 81(C), pages 30-44.
    6. Eric Bettinger & Oded Gurantz & Laura Kawano & Bruce Sacerdote, 2016. "The Long Run Impacts of Merit Aid: Evidence from California’s Cal Grant," NBER Working Papers 22347, National Bureau of Economic Research, Inc.
    7. Welch, Jilleah G., 2014. "HOPE for community college students: The impact of merit aid on persistence, graduation, and earnings," Economics of Education Review, Elsevier, vol. 43(C), pages 1-20.
    8. Gabrielle Fack & Julien Grenet, 2015. "Improving College Access and Success for Low-Income Students: Evidence from a Large Need-Based Grant Program," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 1-34, April.
    9. Charles T. Clotfelter & Steven W. Hemelt & Helen F. Ladd, 2018. "Multifaceted Aid For Low‐Income Students And College Outcomes: Evidence From North Carolina," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 278-303, January.
    10. Scott-Clayton, Judith & Zafar, Basit, 2019. "Financial aid, debt management, and socioeconomic outcomes: Post-college effects of merit-based aid," Journal of Public Economics, Elsevier, vol. 170(C), pages 68-82.
    11. Jeffrey T. Denning & Benjamin M. Marx & Lesley J. Turner, 2019. "ProPelled: The Effects of Grants on Graduation, Earnings, and Welfare," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 193-224, July.
    12. Melguizo, Tatiana & Sanchez, Fabio & Velasco, Tatiana, 2016. "Credit for Low-Income Students and Access to and Academic Performance in Higher Education in Colombia: A Regression Discontinuity Approach," World Development, Elsevier, vol. 80(C), pages 61-77.
    13. David L. Sjoquist & John V. Winters, 2015. "State Merit-Based Financial Aid Programs And College Attainment," Journal of Regional Science, Wiley Blackwell, vol. 55(3), pages 364-390, June.
    14. Benjamin L. Castleman & Bridget Terry Long, 2016. "Looking beyond Enrollment: The Causal Effect of Need-Based Grants on College Access, Persistence, and Graduation," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 1023-1073.
    15. Lovenheim, Michael F. & Owens, Emily G., 2014. "Does federal financial aid affect college enrollment? Evidence from drug offenders and the Higher Education Act of 1998," Journal of Urban Economics, Elsevier, vol. 81(C), pages 1-13.
    16. Christopher Erwin, 2019. "Low-performing student responses to state merit scholarships," Working Papers 2019-02, Auckland University of Technology, Department of Economics.
    17. Benjamin M. Marx & Lesley J. Turner, 2015. "Borrowing Trouble? Student Loans, the Cost of Borrowing, and Implications for the Effectiveness of Need-Based Grant Aid," NBER Working Papers 20850, National Bureau of Economic Research, Inc.
    18. Anderson, Drew M., 2020. "When financial aid is scarce: The challenge of allocating college aid where it is needed most," Journal of Public Economics, Elsevier, vol. 190(C).
    19. Wright, Nicholas A., 2020. "Perform better, or else: Academic probation, public praise, and students decision-making," Labour Economics, Elsevier, vol. 62(C).
    20. Lindsay C. Page & Jennifer E. Iriti & Danielle J. Lowry & Aaron M. Anthony, 2019. "The Promise of Place-Based Investment in Postsecondary Access and Success: Investigating the Impact of the Pittsburgh Promise," Education Finance and Policy, MIT Press, vol. 14(4), pages 572-600, Fall.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reihed:v:57:y:2016:i:8:d:10.1007_s11162-016-9413-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.