IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v81y2022ics003801211930672x.html
   My bibliography  Save this article

Assessing the efficiency of secondary schools: Evidence from OECD countries participating in PISA 2015

Author

Listed:
  • Cordero, Jose Manuel
  • Polo, Cristina
  • Simancas, Rosa

Abstract

One of the most important issues accompanying the publication of the main results of the well-known Programme for International Student Assessment (PISA) is the classification of countries according to student attainment. However, this ranking does not take into account some highly relevant factors, such as the different resource endowments of each education system or the heterogeneous context in which schools operate. This study aims to provide a fuller picture of education system operation worldwide by assessing the managerial efficiency of secondary schools in a cross-country framework. To do this, we use data from OECD countries participating in PISA 2015 and apply a robust nonparametric approach that accounts for the fact that schools were operating under heterogeneous conditions before the efficiency measures of performance were estimated. Our results suggest that the consideration of both school resources and environmental factors significantly modifies the country ranking based solely on student results.

Suggested Citation

  • Cordero, Jose Manuel & Polo, Cristina & Simancas, Rosa, 2022. "Assessing the efficiency of secondary schools: Evidence from OECD countries participating in PISA 2015," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
  • Handle: RePEc:eee:soceps:v:81:y:2022:i:c:s003801211930672x
    DOI: 10.1016/j.seps.2020.100927
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S003801211930672X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.seps.2020.100927?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bogetoft, Peter & Heinesen, Eskil & Tranæs, Torben, 2015. "The efficiency of educational production: A comparison of the Nordic countries with other OECD countries," Economic Modelling, Elsevier, vol. 50(C), pages 310-321.
    2. Johnes, Jill, 2015. "Operational Research in education," European Journal of Operational Research, Elsevier, vol. 243(3), pages 683-696.
    3. Simar, Léopold & Vanhems, Anne & Van Keilegom, Ingrid, 2016. "Unobserved heterogeneity and endogeneity in nonparametric frontier estimation," Journal of Econometrics, Elsevier, vol. 190(2), pages 360-373.
    4. Cinzia Daraio & Léopold Simar & Paul W. Wilson, 2020. "Fast and efficient computation of directional distance estimators," Annals of Operations Research, Springer, vol. 288(2), pages 805-835, May.
    5. Simar, Léopold & Vanhems, Anne, 2012. "Probabilistic characterization of directional distances and their robust versions," Journal of Econometrics, Elsevier, vol. 166(2), pages 342-354.
    6. Douglas Sutherland & Robert Price & Eric Gonand, 2009. "Improving public spending efficiency in primary and secondary education," OECD Journal: Economic Studies, OECD Publishing, vol. 2009(1), pages 1-30.
    7. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2012. "How to measure the impact of environmental factors in a nonparametric production model," European Journal of Operational Research, Elsevier, vol. 223(3), pages 818-833.
    8. Ammermuller, Andreas & Heijke, Hans & Wo[ss]mann, Ludger, 2005. "Schooling quality in Eastern Europe: Educational production during transition," Economics of Education Review, Elsevier, vol. 24(5), pages 579-599, October.
    9. Mastromarco, Camilla & Simar, Léopold, 2018. "Globalization and productivity: A robust nonparametric world frontier analysis," Economic Modelling, Elsevier, vol. 69(C), pages 134-149.
    10. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2019. "A bootstrap approach for bandwidth selection in estimating conditional efficiency measures," European Journal of Operational Research, Elsevier, vol. 277(2), pages 784-797.
    11. Stavros Kourtzidis & Panayiotis Tzeremes & Nickolaos G. Tzeremes, 2019. "Conditional time-dependent nonparametric estimators with an application to healthcare production function," Journal of Applied Statistics, Taylor & Francis Journals, vol. 46(13), pages 2481-2490, October.
    12. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    13. Daraio, Cinzia & Simar, Léopold, 2014. "Directional distances and their robust versions: Computational and testing issues," European Journal of Operational Research, Elsevier, vol. 237(1), pages 358-369.
    14. Víctor Giménez & Claudio Thieme & Diego Prior & Emili Tortosa-Ausina, 2017. "An international comparison of educational systems: a temporal analysis in presence of bad outputs," Journal of Productivity Analysis, Springer, vol. 47(1), pages 83-101, February.
    15. Afonso, Antonio & St. Aubyn, Miguel, 2006. "Cross-country efficiency of secondary education provision: A semi-parametric analysis with non-discretionary inputs," Economic Modelling, Elsevier, vol. 23(3), pages 476-491, May.
    16. Harold Fried & Shelton Schmidt & Suthathip Yaisawarng, 1999. "Incorporating the Operating Environment Into a Nonparametric Measure of Technical Efficiency," Journal of Productivity Analysis, Springer, vol. 12(3), pages 249-267, November.
    17. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    18. V Giménez & D Prior & C Thieme, 2007. "Technical efficiency, managerial efficiency and objective-setting in the educational system: an international comparison," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(8), pages 996-1007, August.
    19. Eva Crespo-Cebada & Francisco Pedraja-Chaparro & Daniel Santín, 2014. "Does school ownership matter? An unbiased efficiency comparison for regions of Spain," Journal of Productivity Analysis, Springer, vol. 41(1), pages 153-172, February.
    20. Coco, Giuseppe & Lagravinese, Raffaele, 2014. "Cronyism and education performance," Economic Modelling, Elsevier, vol. 38(C), pages 443-450.
    21. Badin, Luiza & Daraio, Cinzia & Simar, Léopold, 2010. "Optimal bandwidth selection for conditional efficiency measures: A data-driven approach," European Journal of Operational Research, Elsevier, vol. 201(2), pages 633-640, March.
    22. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    23. Nolwenn Roudaut & Anne Vanhems, 2012. "Explaining firms efficiency in the Ivorian manufacturing sector: a robust nonparametric approach," Journal of Productivity Analysis, Springer, vol. 37(2), pages 155-169, April.
    24. Mastromarco, Camilla & Simar, Leopold, 2017. "Cross-Section Dependence and Latent Heterogeneity to Evaluate the Impact of Human Capital on Country Performance," LIDAM Discussion Papers ISBA 2017030, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    25. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    26. Jerik Hanushek & Dennis Kimko, 2006. "Schooling, Labor-force Quality, and the Growth of Nations," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 154-193.
    27. Christopher O’Donnell & D. Rao & George Battese, 2008. "Metafrontier frameworks for the study of firm-level efficiencies and technology ratios," Empirical Economics, Springer, vol. 34(2), pages 231-255, March.
    28. Nickolaos G. Tzeremes, 2019. "Technological change, technological catch-up and export orientation: evidence from Latin American Countries," Journal of Productivity Analysis, Springer, vol. 52(1), pages 85-100, December.
    29. Léopold Simar & Paul Wilson, 2011. "Two-stage DEA: caveat emptor," Journal of Productivity Analysis, Springer, vol. 36(2), pages 205-218, October.
    30. Fei-Ching Wang & Wei-Ting Hung & Jui-Kou Shang, 2006. "Measuring pure managerial efficiency of international tourist hotels in Taiwan," The Service Industries Journal, Taylor & Francis Journals, vol. 26(1), pages 59-71, January.
    31. Harald Tauchmann, 2012. "Partial frontier efficiency analysis," Stata Journal, StataCorp LP, vol. 12(3), pages 461-478, September.
    32. Aparicio, Juan & Cordero, Jose M. & Pastor, Jesus T., 2017. "The determination of the least distance to the strongly efficient frontier in Data Envelopment Analysis oriented models: Modelling and computational aspects," Omega, Elsevier, vol. 71(C), pages 1-10.
    33. Seok-Oh Jeong & Byeong Park & Léopold Simar, 2010. "Nonparametric conditional efficiency measures: asymptotic properties," Annals of Operations Research, Springer, vol. 173(1), pages 105-122, January.
    34. Cinzia Daraio & Léopold Simar, 2016. "Efficiency and benchmarking with directional distances: a data-driven approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 67(7), pages 928-944, July.
    35. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    36. Andrew Worthington, 2001. "An Empirical Survey of Frontier Efficiency Measurement Techniques in Education," Education Economics, Taylor & Francis Journals, vol. 9(3), pages 245-268.
    37. Peter Hall & Jeff Racine & Qi Li, 2004. "Cross-Validation and the Estimation of Conditional Probability Densities," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1015-1026, December.
    38. Florens, Jean-Pierre & Simar, Léopold & Van Keilegom, Ingrid, 2014. "Frontier estimation in nonparametric location-scale models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 456-470.
    39. Ludger Wößmann, 2003. "Schooling Resources, Educational Institutions and Student Performance: the International Evidence," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 65(2), pages 117-170, May.
    40. repec:dau:papers:123456789/7958 is not listed on IDEAS
    41. José Manuel Cordero & Daniel Santín & Rosa Simancas, 2017. "Assessing European primary school performance through a conditional nonparametric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 364-376, April.
    42. Li, Qi & Racine, Jeffrey S, 2008. "Nonparametric Estimation of Conditional CDF and Quantile Functions With Mixed Categorical and Continuous Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 423-434.
    43. Eric A. Hanushek, 2003. "The Failure of Input-Based Schooling Policies," Economic Journal, Royal Economic Society, vol. 113(485), pages 64-98, February.
    44. Aristovnik, Aleksander & Obadić, Alka, 2014. "Measuring relative efficiency of secondary education in selected EU and OECD countries: the case of Slovenia and Croatia," MPRA Paper 63936, University Library of Munich, Germany.
    45. José M. Cordero & Víctor Cristóbal & Daniel Santín, 2018. "Causal Inference On Education Policies: A Survey Of Empirical Studies Using Pisa, Timss And Pirls," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 878-915, July.
    46. Cazals, Catherine & Fève, Frédérique & Florens, Jean-Pierre & Simar, Léopold, 2016. "Nonparametric instrumental variables estimation for efficiency frontier," Journal of Econometrics, Elsevier, vol. 190(2), pages 349-359.
    47. Daniel Santín & Gabriela Sicilia, 2017. "Impact evaluation and frontier methods in education: a step forward," Chapters, in: Geraint Johnes & Jill Johnes & Tommaso Agasisti & Laura López-Torres (ed.), Handbook of Contemporary Education Economics, chapter 10, pages 211-245, Edward Elgar Publishing.
    48. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    49. Camilla Mastromarco & Lenka Stastna & Jana Votapkova, 2019. "Efficiency of hospitals in the Czech Republic: Conditional efficiency approach," Journal of Productivity Analysis, Springer, vol. 51(1), pages 73-89, February.
    50. Azar Dufrechou, Paola, 2016. "The efficiency of public education spending in Latin America: A comparison to high-income countries," International Journal of Educational Development, Elsevier, vol. 49(C), pages 188-203.
    51. Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2013. "A multilevel decomposition of school performance using robust nonparametric frontier techniques," Economics of Education Review, Elsevier, vol. 32(C), pages 104-121.
    52. Jose Manuel Cordero-Ferrera & Francisco Pedraja-Chaparro & Javier Salinas-Jimenez, 2008. "Measuring efficiency in education: an analysis of different approaches for incorporating non-discretionary inputs," Applied Economics, Taylor & Francis Journals, vol. 40(10), pages 1323-1339.
    53. Rolf Färe & Shawna Grosskopf, 2000. "Theory and Application of Directional Distance Functions," Journal of Productivity Analysis, Springer, vol. 13(2), pages 93-103, March.
    54. Agasisti, Tommaso & Zoido, Pablo, 2019. "The efficiency of schools in developing countries, analysed through PISA 2012 data," Socio-Economic Planning Sciences, Elsevier, vol. 68(C).
    55. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    56. Ms. Victoria Gunnarsson & Stéphane Carcillo & Marijn Verhoeven, 2007. "Education and Health in G7 Countries: Achieving Better Outcomes with Less Spending," IMF Working Papers 2007/263, International Monetary Fund.
    57. Deutsch, Joseph & Dumas, Audrey & Silber, Jacques, 2013. "Estimating an educational production function for five countries of Latin America on the basis of the PISA data," Economics of Education Review, Elsevier, vol. 36(C), pages 245-262.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cordero, Jose M. & Polo, Cristina & Santín, Daniel & Simancas, Rosa, 2018. "Efficiency measurement and cross-country differences among schools: A robust conditional nonparametric analysis," Economic Modelling, Elsevier, vol. 74(C), pages 45-60.
    2. López-Torres, Laura & Johnes, Jill & Elliott, Caroline & Polo, Cristina, 2021. "The effects of competition and collaboration on efficiency in the UK independent school sector," Economic Modelling, Elsevier, vol. 96(C), pages 40-53.
    3. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    4. Capasso, Salvatore & Kaisari, Maria & Kounetas, Konstantinos & Lainas, Elias, 2024. "School productive performance and technology gaps: New evidence from PISA 2018," Economic Modelling, Elsevier, vol. 131(C).
    5. Daraio, Cinzia & Simar, Léopold & Wilson, Paul W., 2021. "Quality as a latent heterogeneity factor in the efficiency of universities," Economic Modelling, Elsevier, vol. 99(C).
    6. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    7. José Manuel Cordero & Daniel Santín & Rosa Simancas, 2017. "Assessing European primary school performance through a conditional nonparametric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 364-376, April.
    8. Paolo Liberati & Raffaele Lagravinese & Giuliano Resce, 2017. "How Does Economic Social And Cultural Status Affect The Efficiency Of Educational Attainments? A Comparative Analysis On Pisa Results," Departmental Working Papers of Economics - University 'Roma Tre' 0217, Department of Economics - University Roma Tre.
    9. Belmonte-Martin, Irene & Ortiz, Lidia & Polo, Cristina, 2021. "Local tax management in Spain: A study of the conditional efficiency of provincial tax agencies," Socio-Economic Planning Sciences, Elsevier, vol. 78(C).
    10. Bădin, Luiza & Daraio, Cinzia & Simar, Léopold, 2019. "A bootstrap approach for bandwidth selection in estimating conditional efficiency measures," European Journal of Operational Research, Elsevier, vol. 277(2), pages 784-797.
    11. Sushanta Mallick & Aarti Rughoo & Nickolaos G. Tzeremes & Wei Xu, 2020. "Technological Change and Catching-Up in the Indian Banking Sector: A Time-Dependent Nonparametric Frontier Approach," Computational Economics, Springer;Society for Computational Economics, vol. 56(1), pages 217-237, June.
    12. López-Torres, Laura & Prior, Diego, 2022. "Long-term efficiency of public service provision in a context of budget restrictions. An application to the education sector," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    13. Michael L. Polemis & Thanasis Stengos & Nickolaos G. Tzeremes, 2020. "Modeling the effect of competition on US manufacturing sectors’ efficiency: an order-m frontier analysis," Journal of Productivity Analysis, Springer, vol. 54(1), pages 27-41, August.
    14. Daraio, Cinzia & Simar, Leopold & Wilson, Paul, 2019. "Quality and its impact on efficiency," LIDAM Discussion Papers ISBA 2019004, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    15. Cinzia Daraio & Léopold Simar & Paul W. Wilson, 2020. "Fast and efficient computation of directional distance estimators," Annals of Operations Research, Springer, vol. 288(2), pages 805-835, May.
    16. Luiza Bădin & Cinzia Daraio & Léopold Simar, 2014. "Explaining inefficiency in nonparametric production models: the state of the art," Annals of Operations Research, Springer, vol. 214(1), pages 5-30, March.
    17. Léopold Simar & Paul W. Wilson, 2015. "Statistical Approaches for Non-parametric Frontier Models: A Guided Tour," International Statistical Review, International Statistical Institute, vol. 83(1), pages 77-110, April.
    18. Baležentis, Tomas & De Witte, Kristof, 2015. "One- and multi-directional conditional efficiency measurement – Efficiency in Lithuanian family farms," European Journal of Operational Research, Elsevier, vol. 245(2), pages 612-622.
    19. Nickolaos G. Tzeremes, 2019. "Technological change, technological catch-up and export orientation: evidence from Latin American Countries," Journal of Productivity Analysis, Springer, vol. 52(1), pages 85-100, December.
    20. Camilla Mastromarco & Léopold Simar, 2021. "Latent heterogeneity to evaluate the effect of human capital on world technology frontier," Journal of Productivity Analysis, Springer, vol. 55(2), pages 71-89, April.

    More about this item

    Keywords

    Student attainment; Efficiency; Nonparametric methods; Cross-country analysis; Robust frontiers;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:81:y:2022:i:c:s003801211930672x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.