IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v84y2007i1p61-75.html
   My bibliography  Save this article

Socioeconomic status or noise? Tradeoffs in the generation of school quality information

Author

Listed:
  • Mizala, Alejandra
  • Romaguera, Pilar
  • Urquiola, Miguel

Abstract

This paper calculates a time series of simple, standard measures of schools’ relative performance. These are drawn from a 1997-2004 panel of Chilean schools, using individual-level information on test scores and student characteristics for each year. The results suggest there is a stark tradeoff in the extent to which rankings generated using these measures: i) can be shown to be very similar to rankings based purely on students’ socioeconomic status, and ii) are very volatile from year to year. At least in Chile, therefore, producing a meaningful ranking of schools that may inform parents and policymakers may be harder than is commonly assumed.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Mizala, Alejandra & Romaguera, Pilar & Urquiola, Miguel, 2007. "Socioeconomic status or noise? Tradeoffs in the generation of school quality information," Journal of Development Economics, Elsevier, vol. 84(1), pages 61-75, September.
  • Handle: RePEc:eee:deveco:v:84:y:2007:i:1:p:61-75
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304-3878(06)00142-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Esther Duflo, 2005. "Monitoring Works: Getting Teachers to Come to School," Working Papers id:301, eSocialSciences.
    2. Reinikka, Ritva & Svensson, Jakob, 2004. "The power of information : evidence from a newspaper campaign to reduce capture," Policy Research Working Paper Series 3239, The World Bank.
    3. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    4. Abhijit Banerjee & Esther Duflo, 2006. "Addressing Absence," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 117-132, Winter.
    5. Thomas J. Kane & Douglas O. Staiger, 2002. "The Promise and Pitfalls of Using Imprecise School Accountability Measures," Journal of Economic Perspectives, American Economic Association, vol. 16(4), pages 91-114, Fall.
    6. Eric Hanushek, 2004. "United States lessons about school accountability," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 2(4), pages 27-32, 01.
    7. Kenneth Y. Chay & Patrick J. McEwan & Miguel Urquiola, 2005. "The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools," American Economic Review, American Economic Association, vol. 95(4), pages 1237-1258, September.
    8. repec:ces:ifodic:v:2:y:2004:i:4:p:14567717 is not listed on IDEAS
    9. Paul Glewwe & Nauman Ilias & Michael Kremer, 2010. "Teacher Incentives," American Economic Journal: Applied Economics, American Economic Association, vol. 2(3), pages 205-227, July.
    10. Abhijit Banerjee & Angus Deaton & Esther Duflo, 2004. "Wealth, Health, and Health Services in Rural Rajasthan," American Economic Review, American Economic Association, vol. 94(2), pages 326-330, May.
    11. Alejandra Mizala & Pilar Romaguera, 2000. "School Performance and Choice: The Chilean Experience," Journal of Human Resources, University of Wisconsin Press, vol. 35(2), pages 392-417.
    12. Lant Pritchett, 2004. "Towards a New Consensus for Addressing the Global Challenge of the Lack of Education," Working Papers 43, Center for Global Development.
    13. Alejandra Mizala & Pilar Romaguera, 2002. "Evaluación del Desempeño e Incentivos en la Educación Chilena," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 39(118), pages 353-394.
    14. Eric Hanushek, 2004. "United States lessons about school accountability," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 2(04), pages 27-32, January.
    15. Thomas J. Kane & Douglas O. Staiger, 2001. "Improving School Accountability Measures," NBER Working Papers 8156, National Bureau of Economic Research, Inc.
    16. Hanushek, Eric A. & Kain, John F. & Rivkin, Steven G., 2004. "Disruption versus Tiebout improvement: the costs and benefits of switching schools," Journal of Public Economics, Elsevier, vol. 88(9-10), pages 1721-1746, August.
    17. Hsieh, Chang-Tai & Urquiola, Miguel, 2006. "The effects of generalized school choice on achievement and stratification: Evidence from Chile's voucher program," Journal of Public Economics, Elsevier, vol. 90(8-9), pages 1477-1503, September.
    18. Ritva Reinikka & Jakob Svensson, 2004. "Local Capture: Evidence from a Central Government Transfer Program in Uganda," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(2), pages 679-705.
    19. Victor Lavy, 2002. "Evaluating the Effect of Teachers' Group Performance Incentives on Pupil Achievement," Journal of Political Economy, University of Chicago Press, vol. 110(6), pages 1286-1317, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dennis Epple & Richard E. Romano & Miguel Urquiola, 2017. "School Vouchers: A Survey of the Economics Literature," Journal of Economic Literature, American Economic Association, vol. 55(2), pages 441-492, June.
    2. Camargo, Braz & Camelo, Rafael & Firpo, Sergio & Ponczek, Vladimir, 2014. "Information, Market Incentives, and Student Performance," IZA Discussion Papers 7941, Institute of Labor Economics (IZA).
    3. Zoghbi, Ana Carolina & Rocha, Fabiana & Mattos, Enlinson, 2013. "Education production efficiency: Evidence from Brazilian universities," Economic Modelling, Elsevier, vol. 31(C), pages 94-103.
    4. W. Bentley MacLeod & Miguel Urquiola, 2009. "Anti-Lemons: School Reputation and Educational Quality," NBER Working Papers 15112, National Bureau of Economic Research, Inc.
    5. Cáceres-Delpiano, Julio & Giolito, Eugenio & Castillo, Sebastián, 2018. "Early impacts of college aid," Economics of Education Review, Elsevier, vol. 63(C), pages 154-166.
    6. Levon Barseghyan & Damon Clark & Stephen Coate, 2014. "Public School Choice: An Economic Analysis," NBER Working Papers 20701, National Bureau of Economic Research, Inc.
    7. Fack, Gabrielle & Grenet, Julien, 2010. "When do better schools raise housing prices? Evidence from Paris public and private schools," Journal of Public Economics, Elsevier, vol. 94(1-2), pages 59-77, February.
    8. Alejandro Arenas Alzate, 2021. "Mejores colegios en Colombia: efecto de las condiciones socioeconómicas sobre el desempeno escolar," Documentos de Trabajo de Valor Público 19829, Universidad EAFIT.
    9. Mizala, Alejandra & Urquiola, Miguel, 2013. "School markets: The impact of information approximating schools' effectiveness," Journal of Development Economics, Elsevier, vol. 103(C), pages 313-335.
    10. Alejandra Mizala & Miguel Urquiola, 2007. "Parental choice and school markets: The impact of information approximating school effectiveness," Documentos de Trabajo 239, Centro de Economía Aplicada, Universidad de Chile.
    11. Barrera-Osorio, Felipe & Raju, Dhushyanth, 2017. "Teacher performance pay: Experimental evidence from Pakistan," Journal of Public Economics, Elsevier, vol. 148(C), pages 75-91.
    12. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    13. De Hoyos Navarro,Rafael E. & Holland,Peter Anthony & Troiano,Sara, 2015. "Understanding the trends in learning outcomes in Argentina, 2000 to 2012," Policy Research Working Paper Series 7518, The World Bank.
    14. MacLeod, W. Bentley & Urquiola, Miguel, 2012. "Competition and Educational Productivity: Incentives Writ Large," IZA Discussion Papers 7063, Institute of Labor Economics (IZA).
    15. Jane Friesen & Mohsen Javdani & Justin Smith & Simon Woodcock, 2012. "How do school ‘report cards’ affect school choice decisions?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 45(2), pages 784-807, May.
    16. Nunes, Luis C. & Reis, Ana Balcão & Seabra, Carmo, 2015. "The publication of school rankings: A step toward increased accountability?," Economics of Education Review, Elsevier, vol. 49(C), pages 15-23.
    17. Correa, Juan A. & Parro, Francisco & Sánchez, Rafael, 2021. "The Effect of School Voucher Spending on Initial Earnings," IZA Discussion Papers 14552, Institute of Labor Economics (IZA).
    18. Bernardo Lara & Alejandra Mizala & Andrea Repetto, 2009. "The Effectiveness of Private Voucher Education: Evidence from Structural School Switches," Documentos de Trabajo 263, Centro de Economía Aplicada, Universidad de Chile.
    19. W. Bentley MacLeod & Miguel Urquiola, 2018. "Is Education Consumption or Investment? Implications for the Effect of School Competition," NBER Working Papers 25117, National Bureau of Economic Research, Inc.
    20. Johnson, Doug & Parrado, Andres, 2021. "Assessing the assessments: Taking stock of learning outcomes data in India," International Journal of Educational Development, Elsevier, vol. 84(C).
    21. Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2013. "A multilevel decomposition of school performance using robust nonparametric frontier techniques," Economics of Education Review, Elsevier, vol. 32(C), pages 104-121.
    22. Raymundo M. Campos Vázquez & Freddy D. Urbina Romero, 2011. "Desempeño educativo en México: la prueba Enlace," Estudios Económicos, El Colegio de México, Centro de Estudios Económicos, vol. 26(2), pages 249-292.
    23. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    24. Jorge Calero & Josep-Oriol Escardíbul, 2007. "Evaluación de servicios educativos: el rendimiento en los centros públicos y privados medido en PISA-2003," Hacienda Pública Española / Review of Public Economics, IEF, vol. 183(4), pages 33-66, december.
    25. Nicolás Grau, 2016. "A Dynamic Model of Elementary School Choice," Working Papers wp417, University of Chile, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bourdon, Jean & Frölich, Markus & Michaelowa, Katharina, 2007. "Teacher Shortages, Teacher Contracts and their Impact on Education in Africa," IZA Discussion Papers 2844, Institute of Labor Economics (IZA).
    2. Ayako Wakano, 2016. "The effect of locally hired teachers on school outcomes (the Dose response function estimation evidence from Kenya)," Discussion Papers in Economics and Business 16-15, Osaka University, Graduate School of Economics.
    3. Alejandra Mizala & Miguel Urquiola, 2007. "Parental choice and school markets: The impact of information approximating school effectiveness," Documentos de Trabajo 239, Centro de Economía Aplicada, Universidad de Chile.
    4. Kenneth Y. Chay & Patrick J. McEwan & Miguel Urquiola, 2005. "The Central Role of Noise in Evaluating Interventions That Use Test Scores to Rank Schools," American Economic Review, American Economic Association, vol. 95(4), pages 1237-1258, September.
    5. Emiliana Vegas & Ilana Umansky, 2005. "Improving Teaching and Learning through Effective Incentives : What Can We Learn from Education Reforms in Latin America?," World Bank Publications - Reports 8694, The World Bank Group.
    6. Ayako Wakano, 2016. "The effect of ratio between PTA teachers and Government employed teachers on Education outcomes in Kenya Primary Schools," Discussion Papers in Economics and Business 16-14, Osaka University, Graduate School of Economics.
    7. Mizala, Alejandra & Urquiola, Miguel, 2013. "School markets: The impact of information approximating schools' effectiveness," Journal of Development Economics, Elsevier, vol. 103(C), pages 313-335.
    8. Björkman, Martina & Reinikka, Ritva & Svensson, Jakob, 2006. "Local Accountability," Seminar Papers 749, Stockholm University, Institute for International Economic Studies.
    9. Elizabeth Beasley & Elise Huillery, 2011. "Understanding Community Participation to Make Services Work," Sciences Po publications info:hdl:2441/eu4vqp9ompq, Sciences Po.
    10. Abhijit V. Banerjee & Rukmini Banerji & Esther Duflo & Rachel Glennerster & Stuti Khemani, 2010. "Pitfalls of Participatory Programs: Evidence from a Randomized Evaluation in Education in India," American Economic Journal: Economic Policy, American Economic Association, vol. 2(1), pages 1-30, February.
    11. Alejandra Mizala & Pilar Romaguera, 2003. "Rendimiento Escolar y Premios por Desempeño. La Experiencia Latinoamericana (Scholastic performance and performance awards)," Documentos de Trabajo 157, Centro de Economía Aplicada, Universidad de Chile.
    12. Felipe Barrera-Osorio & Dario Maldonado & Catherine Rodríguez, 2012. "Calidad de la educación básica y media en Colombia: diagnóstico y propuestas," Documentos de Trabajo 10078, Universidad del Rosario.
    13. Reback, Randall, 2008. "Teaching to the rating: School accountability and the distribution of student achievement," Journal of Public Economics, Elsevier, vol. 92(5-6), pages 1394-1415, June.
    14. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2007. "Are Teacher Absences Worth Worrying About in the U.S.?," NBER Working Papers 13648, National Bureau of Economic Research, Inc.
    15. Yanez-Pagans, Monica & Machicado-Salas, Gustavo, 2014. "Bureaucratic Delay, Local-Level Monitoring, and Delivery of Small Infrastructure Projects: Evidence from a Field Experiment in Bolivia," World Development, Elsevier, vol. 59(C), pages 394-407.
    16. Alejandro J. Ganimian & Richard J. Murnane, 2014. "Improving Educational Outcomes in Developing Countries: Lessons from Rigorous Impact Evaluations," NBER Working Papers 20284, National Bureau of Economic Research, Inc.
    17. Elizabeth Beasley & Elise Huillery, 2011. "Understanding Community Participation to Make Services Work," Working Papers hal-01073687, HAL.
    18. Pauline Dixon, 2013. "International Aid and Private Schools for the Poor," Books, Edward Elgar Publishing, number 15122.
    19. repec:hal:spmain:info:hdl:2441/eu4vqp9ompqllr09iatqiagpl is not listed on IDEAS
    20. Jayachandran, Seema, 2014. "Incentives to teach badly: After-school tutoring in developing countries," Journal of Development Economics, Elsevier, vol. 108(C), pages 190-205.
    21. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:84:y:2007:i:1:p:61-75. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.