IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v98y2024ics0272775723001401.html
   My bibliography  Save this article

Higher education responses to accountability

Author

Listed:
  • Machado, Anaely
  • Terra, Rafael
  • Tannuri-Pianto, Maria

Abstract

This paper estimates the impact of accountability scores on Brazilian higher education. We implement a regression discontinuity design to explore a natural experiment resulting from the federal rules for assigning quality levels to undergraduate programs. We test whether program quality is sensitive to negative reinforcement, such as punishments imposed when a minimum threshold is not attained. The findings indicate that program administrators exhibit a positive response to the prospect of punishment by enhancing program quality in the subsequent evaluation cycle. The primary drivers of this advancement – infrastructure, teaching and learning evaluations, faculty dedication, and the proportion of faculty with a Ph.D. degree – are largely under the administrators’ direct control. However, quality indicators less subject to administrative manipulation, such as student performance and value-added measures, exhibit minimal change.

Suggested Citation

  • Machado, Anaely & Terra, Rafael & Tannuri-Pianto, Maria, 2024. "Higher education responses to accountability," Economics of Education Review, Elsevier, vol. 98(C).
  • Handle: RePEc:eee:ecoedu:v:98:y:2024:i:c:s0272775723001401
    DOI: 10.1016/j.econedurev.2023.102493
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775723001401
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econedurev.2023.102493?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Justine S. Hastings & Jeffrey M. Weinstein, 2008. "Information, School Choice, and Academic Achievement: Evidence from Two Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(4), pages 1373-1414.
    2. Figlio, David N. & Rouse, Cecilia Elena, 2006. "Do accountability and voucher threats improve low-performing schools?," Journal of Public Economics, Elsevier, vol. 90(1-2), pages 239-255, January.
    3. David J. Deming & Sarah Cohodes & Jennifer Jennings & Christopher Jencks, 2016. "School Accountability, Postsecondary Attainment, and Earnings," The Review of Economics and Statistics, MIT Press, vol. 98(5), pages 848-862, December.
    4. Chakrabarti, Rajashri, 2014. "Incentives and responses under No Child Left Behind: Credible threats and the role of competition," Journal of Public Economics, Elsevier, vol. 110(C), pages 124-146.
    5. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    6. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    7. Cattaneo, Matias D & Jansson, Michael & Ma, Xinwei, 2020. "Simple Local Polynomial Density Estimators," Department of Economics, Working Paper Series qt9vt997qn, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    8. Cecilia Elena Rouse & Jane Hannaway & Dan Goldhaber & David Figlio, 2013. "Feeling the Florida Heat? How Low-Performing Schools Respond to Voucher and Accountability Pressure," American Economic Journal: Economic Policy, American Economic Association, vol. 5(2), pages 251-281, May.
    9. Woo, Seokjin & Lee, Soohyung & Kim, Kyunghee, 2015. "Carrot and stick?: Impact of a low-stakes school accountability program on student achievement," Economics Letters, Elsevier, vol. 137(C), pages 195-199.
    10. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    11. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    12. Figlio, David N. & Winicki, Joshua, 2005. "Food for thought: the effects of school accountability plans on school nutrition," Journal of Public Economics, Elsevier, vol. 89(2-3), pages 381-394, February.
    13. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    14. Derek Neal & Diane Whitmore Schanzenbach, 2010. "Left Behind by Design: Proficiency Counts and Test-Based Accountability," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 263-283, May.
    15. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    16. Cattaneo, Matias D & Jansson, Michael & Ma, Xinwei, 2020. "Simple Local Polynomial Density Estimators," University of California at San Diego, Economics Working Paper Series qt9vt997qn, Department of Economics, UC San Diego.
    17. Matias D. Cattaneo & Luke Keele & Rocio Titiunik, 2021. "Covariate Adjustment in Regression Discontinuity Designs," Papers 2110.08410, arXiv.org, revised Aug 2022.
    18. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2020. "Simple Local Polynomial Density Estimators," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1449-1455, July.
    19. Braz Camargo & Rafael Camelo & Sergio Firpo & Vladimir Ponczek, 2018. "Information, Market Incentives, and Student Performance: Evidence from a Regression Discontinuity Design in Brazil," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 414-444.
    20. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    21. Rezende, Marcelo, 2010. "The effects of accountability on higher education," Economics of Education Review, Elsevier, vol. 29(5), pages 842-856, October.
    22. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    23. repec:mpr:mprres:6364 is not listed on IDEAS
    24. Jonah Rockoff & Lesley J. Turner, 2010. "Short-Run Impacts of Accountability on School Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 2(4), pages 119-147, November.
    25. Matias D. Cattaneo & Luke Keele & Rocío Titiunik & Gonzalo Vazquez-Bare, 2021. "Extrapolating Treatment Effects in Multi-Cutoff Regression Discontinuity Designs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1941-1952, October.
    26. David J. Deming & David Figlio, 2016. "Accountability in US Education: Applying Lessons from K-12 Experience to Higher Education," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 33-56, Summer.
    27. Matias D. Cattaneo & Rocío Titiunik & Gonzalo Vazquez-Bare, 2020. "Analysis of regression-discontinuity designs with multiple cutoffs or multiple scores," Stata Journal, StataCorp LP, vol. 20(4), pages 866-891, December.
    28. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2013. "Does it pay to get an A? School resource allocations in response to accountability ratings," Journal of Urban Economics, Elsevier, vol. 73(1), pages 30-42.
    29. Chiang, Hanley, 2009. "How accountability pressure on failing schools affects student achievement," Journal of Public Economics, Elsevier, vol. 93(9-10), pages 1045-1057, October.
    30. Serena Canaan & Pierre Mouganie, 2018. "Returns to Education Quality for Low-Skilled Students: Evidence from a Discontinuity," Journal of Labor Economics, University of Chicago Press, vol. 36(2), pages 395-436.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feng, Li & Figlio, David & Sass, Tim, 2018. "School accountability and teacher mobility," Journal of Urban Economics, Elsevier, vol. 103(C), pages 1-17.
    2. Michael Coelli & Gigi Foster & Andrew Leigh, 2018. "Do School Principals Respond to Increased Public Scrutiny? New Survey Evidence from Australia," The Economic Record, The Economic Society of Australia, vol. 94(S1), pages 73-101, June.
    3. Meltem Dayioglu & Müşerref Küçükbayrak & Semih Tumen, 2022. "The impact of age-specific minimum wages on youth employment and education: a regression discontinuity analysis," International Journal of Manpower, Emerald Group Publishing Limited, vol. 43(6), pages 1352-1377, March.
    4. Bragança, Arthur & Dahis, Ricardo, 2022. "Cutting special interests by the roots: Evidence from the Brazilian Amazon," Journal of Public Economics, Elsevier, vol. 215(C).
    5. Craig, Steven G. & Imberman, Scott A. & Perdue, Adam, 2015. "Do administrators respond to their accountability ratings? The response of school budgets to accountability grades," Economics of Education Review, Elsevier, vol. 49(C), pages 55-68.
    6. Patricia M. Anderson & Kristin F. Butcher & Diane Whitmore Schanzenbach, 2017. "Adequate (or Adipose?) Yearly Progress: Assessing the Effect of “No Child Left Behind” on Children's Obesity," Education Finance and Policy, MIT Press, vol. 12(1), pages 54-76, Winter.
    7. Holbein, John B. & Ladd, Helen F., 2017. "Accountability pressure: Regression discontinuity estimates of how No Child Left Behind influenced student behavior," Economics of Education Review, Elsevier, vol. 58(C), pages 55-67.
    8. Morozumi, Atsuyoshi & Tanaka, Ryuichi, 2020. "Should School-Level Results of National Assessments Be Made Public?," IZA Discussion Papers 13450, Institute of Labor Economics (IZA).
    9. Pierre Koning & Karen Wiel, 2012. "School Responsiveness to Quality Rankings: An Empirical Analysis of Secondary Education in the Netherlands," De Economist, Springer, vol. 160(4), pages 339-355, December.
    10. Canaan, Serena & Mouganie, Pierre & Zhang, Peng, 2022. "The Long-Run Educational Benefits of High-Achieving Classrooms," IZA Discussion Papers 15039, Institute of Labor Economics (IZA).
    11. Johnsen, Julian V. & Willén, Alexander, 2022. "The effect of negative income shocks on pensioners," Labour Economics, Elsevier, vol. 76(C).
    12. Babii, Andrii & Kumar, Rohit, 2023. "Isotonic regression discontinuity designs," Journal of Econometrics, Elsevier, vol. 234(2), pages 371-393.
    13. Guillaume Blanc & Masahiro Kubo, 2023. "French," Economics Discussion Paper Series 2308, Economics, The University of Manchester.
    14. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    15. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    16. Cingano, Federico & Palomba, Filippo & Pinotti, Paolo & Rettore, Enrico, 2023. "Granting more bang for the buck: The heterogeneous effects of firm subsidies," Labour Economics, Elsevier, vol. 83(C).
    17. Kettlewell, Nathan & Siminski, Peter, 2020. "Optimal Model Selection in RDD and Related Settings Using Placebo Zones," IZA Discussion Papers 13639, Institute of Labor Economics (IZA).
    18. Cuesta, José Ignacio & González, Felipe & Larroulet Philippi, Cristian, 2020. "Distorted quality signals in school markets," Journal of Development Economics, Elsevier, vol. 147(C).
    19. Jessen, Jonas & Jessen, Robin & Galecka-Burdziak, Ewa & Góra, Marek & Kluve, Jochen, 2023. "The Micro and Macro Effects of Changes in the Potential Benefit Duration," IZA Discussion Papers 15978, Institute of Labor Economics (IZA).
    20. Daniel Graeber & Felicitas Schikora, 2021. "Hate Is Too Great a Burden to Bear: Hate Crimes and the Mental Health of Refugees," SOEPpapers on Multidisciplinary Panel Data Research 1130, DIW Berlin, The German Socio-Economic Panel (SOEP).

    More about this item

    Keywords

    Regression discontinuity; Accountability; Higher education; Impact evaluation;
    All these keywords.

    JEL classification:

    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:98:y:2024:i:c:s0272775723001401. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.