IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v32y2013icp104-121.html
   My bibliography  Save this article

A multilevel decomposition of school performance using robust nonparametric frontier techniques

Author

Listed:
  • Thieme, Claudio
  • Prior, Diego
  • Tortosa-Ausina, Emili

Abstract

We propose a methodology for evaluating educational performance, from a multilevel perspective. We use partial frontier approaches to mitigate the influence of outliers and the curse of dimensionality. Our estimation considers idiosyncratic variables at the school, class, and student levels. Our model is applied to a sample of students in fourth year of primary school in urban schools in Chile. Results are in line with previous findings that less than 30% of the variance in students’ educational attainment is attributable to their schools. Results also corroborate that a model considering only student-level variables yields high inefficiencies not attributable to school management, but rather to inadequate resource-endowment policy. Therefore, when disregarding specific variables concerning the resources allocated to the schools, the performance of those schools is undervalued, largely because inefficiencies caused by suboptimal resource endowments or difficulties arising from the socioeconomic environment are instead attributed to poor school management.

Suggested Citation

  • Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2013. "A multilevel decomposition of school performance using robust nonparametric frontier techniques," Economics of Education Review, Elsevier, vol. 32(C), pages 104-121.
  • Handle: RePEc:eee:ecoedu:v:32:y:2013:i:c:p:104-121
    DOI: 10.1016/j.econedurev.2012.08.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775712001082
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anand, Priyanka & Mizala, Alejandra & Repetto, Andrea, 2009. "Using school scholarships to estimate the effect of private education on the academic achievement of low-income students in Chile," Economics of Education Review, Elsevier, vol. 28(3), pages 370-381, June.
    2. Léopold Simar & Paul Wilson, 2000. "Statistical Inference in Nonparametric Frontier Models: The State of the Art," Journal of Productivity Analysis, Springer, vol. 13(1), pages 49-78, January.
    3. Mark Schneider & Gregory Elacqua & Jack Buckley, 2006. "School choice in Chile: Is it class or the classroom?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 25(3), pages 577-601.
    4. Hsieh, Chang-Tai & Urquiola, Miguel, 2006. "The effects of generalized school choice on achievement and stratification: Evidence from Chile's voucher program," Journal of Public Economics, Elsevier, vol. 90(8-9), pages 1477-1503, September.
    5. Pierre Ouellette & Valerie Vierstraete, 2005. "An evaluation of the efficiency of Quebec's school boards using the Data Envelopment Analysis method," Applied Economics, Taylor & Francis Journals, vol. 37(14), pages 1643-1653.
    6. Maria Teresa Balaguer-Coll & Diego Prior & Emili Tortosa-Ausina, 2010. "Devolution Dynamics of Spanish Local Government," Environment and Planning A, , vol. 42(6), pages 1476-1495, June.
    7. Laurent Weill, 2004. "Measuring Cost Efficiency in European Banking: A Comparison of Frontier Techniques," Journal of Productivity Analysis, Springer, vol. 21(2), pages 133-152, March.
    8. Patrinos, Harry Anthony, 1995. "Socioeconomic background, schooling, experience, ability and monetary rewards in Greece," Economics of Education Review, Elsevier, vol. 14(1), pages 85-91, March.
    9. José Manuel Pastor & Emili Tortosa-Ausina, 2008. "Social Capital And Bank Performance: An International Comparison For Oecd Countries," Manchester School, University of Manchester, vol. 76(2), pages 223-265, March.
    10. Francisco Gallego, 2002. "Competencia y Resultados Educativos: Teoría y Evidencia para Chile," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 39(118), pages 309-352.
    11. Emmanuel Thanssoulis, 1999. "Setting Achievement Targets for School Children," Education Economics, Taylor & Francis Journals, vol. 7(2), pages 101-119.
    12. Bifulco, Robert & Bretschneider, Stuart, 2001. "Estimating school efficiency: A comparison of methods using simulated data," Economics of Education Review, Elsevier, vol. 20(5), pages 417-429, October.
    13. A. Bessent & W. Bessent & J. Kennington & B. Reagan, 1982. "An Application of Mathematical Programming to Assess Productivity in the Houston Independent School District," Management Science, INFORMS, vol. 28(12), pages 1355-1367, December.
    14. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    15. Park, B.U. & Simar, L. & Weiner, Ch., 2000. "The Fdh Estimator For Productivity Efficiency Scores," Econometric Theory, Cambridge University Press, vol. 16(06), pages 855-877, December.
    16. Emmanuel Thanassoulis & Maria Da Conceicao & A. Silva Portela, 2002. "School Outcomes: Sharing the Responsibility Between Pupil and School1," Education Economics, Taylor & Francis Journals, vol. 10(2), pages 183-207.
    17. Mizala, Alejandra & Romaguera, Pilar & Urquiola, Miguel, 2007. "Socioeconomic status or noise? Tradeoffs in the generation of school quality information," Journal of Development Economics, Elsevier, vol. 84(1), pages 61-75, September.
    18. George Battese & D. Rao & Christopher O'Donnell, 2004. "A Metafrontier Production Function for Estimation of Technical Efficiencies and Technology Gaps for Firms Operating Under Different Technologies," Journal of Productivity Analysis, Springer, vol. 21(1), pages 91-103, January.
    19. Summers, Anita A & Wolfe, Barbara L, 1977. "Do Schools Make a Difference?," American Economic Review, American Economic Association, vol. 67(4), pages 639-652, September.
    20. Mizala, Alejandra & Romaguera, Pilar, 2001. "Factores socioeconómicos explicativos de los resultados escolares en la educación secundaria en Chile," El Trimestre Económico, Fondo de Cultura Económica, vol. 0(272), pages 515-549, Otubre-di.
    21. Lee, Lung-Fei, 1983. "Generalized Econometric Models with Selectivity," Econometrica, Econometric Society, vol. 51(2), pages 507-512, March.
    22. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    23. Claudio Sapelli & Bernardita Vial, 2002. "The Performance of Private and Public Schools in the Chilean Voucher System," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 39(118), pages 423-454.
    24. Maria Alberta Oliveira & Carlos Santos, 2005. "Assessing school efficiency in Portugal using FDH and bootstrapping," Applied Economics, Taylor & Francis Journals, vol. 37(8), pages 957-968.
    25. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 31(3), pages 129-137.
    26. Wheelock, David C. & Wilson, Paul W., 2009. "Robust Nonparametric Quantile Estimation of Efficiency and Productivity Change in U.S. Commercial Banking, 1985–2004," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(3), pages 354-368.
    27. Kneip, Alois & Simar, Léopold & Wilson, Paul W., 2008. "Asymptotics And Consistent Bootstraps For Dea Estimators In Nonparametric Frontier Models," Econometric Theory, Cambridge University Press, vol. 24(06), pages 1663-1697, December.
    28. De Borger, Bruno & Kerstens, Kristiaan, 1996. "Cost efficiency of Belgian local governments: A comparative analysis of FDH, DEA, and econometric approaches," Regional Science and Urban Economics, Elsevier, vol. 26(2), pages 145-170, April.
    29. Emrouznejad, Ali & Parker, Barnett R. & Tavares, Gabriel, 2008. "Evaluation of research in efficiency and productivity: A survey and analysis of the first 30 years of scholarly literature in DEA," Socio-Economic Planning Sciences, Elsevier, vol. 42(3), pages 151-157, September.
    30. Christopher O’Donnell & D. Rao & George Battese, 2008. "Metafrontier frameworks for the study of firm-level efficiencies and technology ratios," Empirical Economics, Springer, vol. 34(2), pages 231-255, March.
    31. Patrick McEwan, 2001. "The Effectiveness of Public, Catholic, and Non-Religious Private Schools in Chile's Voucher System," Education Economics, Taylor & Francis Journals, vol. 9(2), pages 103-128.
    32. Henderson, Vernon & Mieszkowski, Peter & Sauvageau, Yvon, 1978. "Peer group effects and educational production functions," Journal of Public Economics, Elsevier, vol. 10(1), pages 97-106, August.
    33. George E. Battese & D. S. Prasada Rao, 2002. "Technology Gap, Efficiency, and a Stochastic Metafrontier Function," International Journal of Business and Economics, College of Business and College of Finance, Feng Chia University, Taichung, Taiwan, vol. 1(2), pages 87-93, August.
    34. Sietske Waslander & Cissy Pater & Maartje van der Weide, 2010. "Markets in Education: An Analytical Review of Empirical Research on Market Mechanisms in Education," OECD Education Working Papers 52, OECD Publishing.
    35. Subodh Kumar & R. Robert Russell, 2002. "Technological Change, Technological Catch-up, and Capital Deepening: Relative Contributions to Growth and Convergence," American Economic Review, American Economic Association, vol. 92(3), pages 527-548, June.
    36. Ferrier, Gary D. & Lovell, C. A. Knox, 1990. "Measuring cost efficiency in banking : Econometric and linear programming evidence," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 229-245.
    37. Silva Portela, Maria Conceicao A. & Thanassoulis, Emmanuel, 2001. "Decomposing school and school-type efficiency," European Journal of Operational Research, Elsevier, vol. 132(2), pages 357-373, July.
    38. Resti, Andrea, 1997. "Evaluating the cost-efficiency of the Italian Banking System: What can be learned from the joint application of parametric and non-parametric techniques," Journal of Banking & Finance, Elsevier, vol. 21(2), pages 221-250, February.
    39. Léopold Simar, 2003. "Detecting Outliers in Frontier Models: A Simple Approach," Journal of Productivity Analysis, Springer, vol. 20(3), pages 391-424, November.
    40. Alejandra Mizala & Pilar Romaguera & Dario Farren, 2002. "The technical efficiency of schools in Chile," Applied Economics, Taylor & Francis Journals, vol. 34(12), pages 1533-1552.
    41. Kneip, Alois & Park, Byeong U. & Simar, L opold, 1998. "A Note On The Convergence Of Nonparametric Dea Estimators For Production Efficiency Scores," Econometric Theory, Cambridge University Press, vol. 14(06), pages 783-793, December.
    42. Bauer, Paul W. & Berger, Allen N. & Ferrier, Gary D. & Humphrey, David B., 1998. "Consistency Conditions for Regulatory Analysis of Financial Institutions: A Comparison of Frontier Efficiency Methods," Journal of Economics and Business, Elsevier, vol. 50(2), pages 85-114, March.
    43. Fan, Yanqin & Li, Qi & Weersink, Alfons, 1996. "Semiparametric Estimation of Stochastic Production Frontier Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(4), pages 460-468, October.
    44. Cook, Wade D. & Seiford, Larry M., 2009. "Data envelopment analysis (DEA) - Thirty years on," European Journal of Operational Research, Elsevier, vol. 192(1), pages 1-17, January.
    45. McEwan, Patrick J., 2003. "Peer effects on student achievement: evidence from Chile," Economics of Education Review, Elsevier, vol. 22(2), pages 131-141, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education, Elsevier.
    2. Laura López Torres & Diego Prior, 2014. "Measuring school demand in the presence of spatial dependence. A conditional approach," Investigaciones de Economía de la Educación volume 9,in: Adela García Aracil & Isabel Neira Gómez (ed.), Investigaciones de Economía de la Educación 9, edition 1, volume 9, chapter 4, pages 117-141 Asociación de Economía de la Educación.
    3. Masci, Chiara & Ieva, Francesca & Agasisti, Tommaso & Paganoni, Anna Maria, 2016. "Does class matter more than school? Evidence from a multilevel statistical analysis on Italian junior secondary school students," Socio-Economic Planning Sciences, Elsevier, vol. 54(C), pages 47-57.
    4. repec:eee:regeco:v:65:y:2017:i:c:p:89-103 is not listed on IDEAS
    5. repec:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_jors.2015.42 is not listed on IDEAS
    6. Gómez-Calvet, Roberto & Conesa, David & Gómez-Calvet, Ana Rosa & Tortosa-Ausina, Emili, 2014. "Energy efficiency in the European Union: What can be learned from the joint application of directional distance functions and slacks-based measures?," Applied Energy, Elsevier, vol. 132(C), pages 137-154.
    7. Kristof de Witte & Laura López-Torres, 2015. "Efficiency in Education. A Review of Literature and a Way Forward," Working Papers 1501, Departament Empresa, Universitat Autònoma de Barcelona, revised Apr 2015.
    8. López-Torres, Laura & Prior, Diego, 2013. "Do Parents Perceive The Technical Quality Of Public Schools? An Activity Analysis Approach," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 13(3), pages 39-60.
    9. José Manuel Cordero & Diego Prior & Rosa Simancas, 2016. "A comparison of public and private schools in Spain using robust nonparametric frontier methods," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 24(3), pages 659-680, September.
    10. Jesús Peiró-Palomino, 2016. "European regional convergence revisited: the role of intangible assets," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 57(1), pages 165-194, July.
    11. Meryem Duygun & Huseyin Ozturk & Mohamed Shaban & Emili Tortosa-Ausina, 2014. "Quo Vadis, raters? A frontier approach to identify misratings in sovereign credit risk," Working Papers 2014/10, Economics Department, Universitat Jaume I, Castellón (Spain).
    12. Paolo Liberati & Raffaele Lagravinese & Giuliano Resce, 2017. "How Does Economic Social And Cultural Status Affect The Efficiency Of Educational Attainments? A Comparative Analysis On Pisa Results," Departmental Working Papers of Economics - University 'Roma Tre' 0217, Department of Economics - University Roma Tre.
    13. repec:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_jors.2015.92 is not listed on IDEAS

    More about this item

    Keywords

    Efficiency; Multilevel analysis; Order-m; School effectiveness;

    JEL classification:

    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:32:y:2013:i:c:p:104-121. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.