IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v98y2024ics0272775723001401.html
   My bibliography  Save this article

Higher education responses to accountability

Author

Listed:
  • Machado, Anaely
  • Terra, Rafael
  • Tannuri-Pianto, Maria

Abstract

This paper estimates the impact of accountability scores on Brazilian higher education. We implement a regression discontinuity design to explore a natural experiment resulting from the federal rules for assigning quality levels to undergraduate programs. We test whether program quality is sensitive to negative reinforcement, such as punishments imposed when a minimum threshold is not attained. The findings indicate that program administrators exhibit a positive response to the prospect of punishment by enhancing program quality in the subsequent evaluation cycle. The primary drivers of this advancement – infrastructure, teaching and learning evaluations, faculty dedication, and the proportion of faculty with a Ph.D. degree – are largely under the administrators’ direct control. However, quality indicators less subject to administrative manipulation, such as student performance and value-added measures, exhibit minimal change.

Suggested Citation

  • Machado, Anaely & Terra, Rafael & Tannuri-Pianto, Maria, 2024. "Higher education responses to accountability," Economics of Education Review, Elsevier, vol. 98(C).
  • Handle: RePEc:eee:ecoedu:v:98:y:2024:i:c:s0272775723001401
    DOI: 10.1016/j.econedurev.2023.102493
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775723001401
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econedurev.2023.102493?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    2. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    3. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    4. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020. "Simple Local Polynomial Density Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
    5. Woo, Seokjin & Lee, Soohyung & Kim, Kyunghee, 2015. "Carrot and stick?: Impact of a low-stakes school accountability program on student achievement," Economics Letters, Elsevier, vol. 137(C), pages 195-199.
    6. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    7. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    8. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    9. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    10. Justine S. Hastings & Jeffrey M. Weinstein, 2008. "Information, School Choice, and Academic Achievement: Evidence from Two Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(4), pages 1373-1414.
    11. Matias D. Cattaneo & Luke Keele & Rocío Titiunik & Gonzalo Vazquez-Bare, 2021. "Extrapolating Treatment Effects in Multi-Cutoff Regression Discontinuity Designs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1941-1952, October.
    12. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    13. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    14. Matias D. Cattaneo & Rocío Titiunik & Gonzalo Vazquez-Bare, 2020. "Analysis of regression-discontinuity designs with multiple cutoffs or multiple scores," Stata Journal, StataCorp LP, vol. 20(4), pages 866-891, December.
    15. Serena Canaan & Pierre Mouganie, 2018. "Returns to Education Quality for Low-Skilled Students: Evidence from a Discontinuity," Journal of Labor Economics, University of Chicago Press, vol. 36(2), pages 395-436.
    16. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    17. David J. Deming & Sarah Cohodes & Jennifer Jennings & Christopher Jencks, 2016. "School Accountability, Postsecondary Attainment, and Earnings," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 848-862, December.
    18. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    19. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    20. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    21. Derek Neal & Diane Whitmore Schanzenbach, 2010. "Left Behind by Design: Proficiency Counts and Test-Based Accountability," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 263-283, May.
    22. Matias D. Cattaneo & Luke Keele & Rocio Titiunik, 2021. "Covariate Adjustment in Regression Discontinuity Designs," Papers 2110.08410, arXiv.org, revised Aug 2022.
    23. Braz Camargo & Rafael Camelo & Sergio Firpo & Vladimir Ponczek, 2018. "Information, Market Incentives, and Student Performance: Evidence from a Regression Discontinuity Design in Brazil," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 414-444.
    24. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    25. Rezende, Marcelo, 2010. "The effects of accountability on higher education," Economics of Education Review, Elsevier, vol. 29(5), pages 842-856, October.
    26. repec:mpr:mprres:6364 is not listed on IDEAS
    27. David J. Deming & David Figlio, 2016. "Accountability in US Education: Applying Lessons from K-12 Experience to Higher Education," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 33-56, Summer.
    28. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Coelli & Gigi Foster & Andrew Leigh, 2018. "Do School Principals Respond to Increased Public Scrutiny? New Survey Evidence from Australia," The Economic Record, The Economic Society of Australia, vol. 94(S1), pages 73-101, June.
    2. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    3. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    4. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    5. Morozumi, Atsuyoshi & Tanaka, Ryuichi, 2020. "Should School-Level Results of National Assessments Be Made Public?," IZA Discussion Papers 13450, Institute of Labor Economics (IZA).
    6. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    7. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    8. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    9. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    10. Gregg, John J. & Lavertu, Stéphane, 2023. "Test-based accountability and educational equity: Breaking through local district politics?," Economics of Education Review, Elsevier, vol. 97(C).
    11. Cuesta, José Ignacio & González, Felipe & Larroulet Philippi, Cristian, 2020. "Distorted quality signals in school markets," Journal of Development Economics, Elsevier, vol. 147(C).
    12. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    13. Dor Leventer & Daniel Nevo, 2024. "Correcting invalid regression discontinuity designs with multiple time period data," Papers 2408.05847, arXiv.org.
    14. Evan Riehl & Meredith Welch, 2023. "Accountability, Test Prep Incentives, and the Design of Math and English Exams," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 60-96, January.
    15. Rajashri Chakrabarti, 2013. "Accountability with Voucher Threats, Responses, and the Test-Taking Population: Regression Discontinuity Evidence from Florida," Education Finance and Policy, MIT Press, vol. 8(2), pages 121-167, April.
    16. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    17. Trinidad, Jose Eos, 2022. "Meaning-Making, Negotiation, and Change: Reviewing the Organization and Ecology of School Accountability," SocArXiv ywm8b, Center for Open Science.
    18. Meltem Dayioglu & Müşerref Küçükbayrak & Semih Tumen, 2022. "The impact of age-specific minimum wages on youth employment and education: a regression discontinuity analysis," International Journal of Manpower, Emerald Group Publishing Limited, vol. 43(6), pages 1352-1377, March.
    19. Jacobus Cilliers & Isaac M. Mbiti & Andrew Zeitlin, 2021. "Can Public Rankings Improve School Performance?: Evidence from a Nationwide Reform in Tanzania," Journal of Human Resources, University of Wisconsin Press, vol. 56(3), pages 655-685.
    20. Fontana, Nicola & Nannicini, Tommaso & Tabellini, Guido, 2023. "Historical roots of political extremism: The effects of Nazi occupation of Italy," Journal of Comparative Economics, Elsevier, vol. 51(3), pages 723-743.

    More about this item

    Keywords

    Regression discontinuity; Accountability; Higher education; Impact evaluation;
    All these keywords.

    JEL classification:

    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:98:y:2024:i:c:s0272775723001401. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.