IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v95y2020ics030504831930427x.html
   My bibliography  Save this article

Benchmarking of secondary schools based on Students’ results in higher education

Author

Listed:
  • Silva, Maria C.A.
  • Camanho, Ana S.
  • Barbosa, Flávia

Abstract

The performance of secondary schools is usually assessed based on students’ results on national exams at the end of secondary education. This research uses data on academic achievements by first-year university students to benchmark secondary schools on their ability to lead students to success in higher education. The analysis is conducted using data of University of Porto and Catholic University of Porto, Portugal, for a three-year period, corresponding to more than 10.000 students from 65 degrees, for which the school of origin is known. A number of variables representing students’ success in Higher education were constructed for each school in our sample and aggregated through a Benefit of the Doubt indicator. Results suggest that the schools’ ranking based on schools’ ability to prepare students for university success is quite different from the ranking based on results on national exams. Given these findings, we propose complementing schools’ performance assessments (traditionally based on national exam results or indicators of value added) with indicators that account for the preparation of students for success in future challenges, which is indisputably a key objective of secondary education. We propose a composite indicator for the analysis of these complementary aims as well, and results show that frontier units indeed exhibit trade offs between traditional measures of performance and our new measure of performance.

Suggested Citation

  • Silva, Maria C.A. & Camanho, Ana S. & Barbosa, Flávia, 2020. "Benchmarking of secondary schools based on Students’ results in higher education," Omega, Elsevier, vol. 95(C).
  • Handle: RePEc:eee:jomega:v:95:y:2020:i:c:s030504831930427x
    DOI: 10.1016/j.omega.2019.102119
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030504831930427X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2019.102119?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. M C A S Portela & A S Camanho, 2010. "Analysis of complementary methodologies for the estimation of school value added," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(7), pages 1122-1132, July.
    3. K Kerstens & I Van de Woestyne, 2011. "Negative data in DEA: a simple proportional distance function approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(7), pages 1413-1419, July.
    4. repec:lan:wpaper:1092 is not listed on IDEAS
    5. Bradley, Steve & Taylor, Jim, 1998. "The Effect of School Size on Exam Performance in Secondary Schools," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 60(3), pages 291-324, August.
    6. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    7. Silva Portela, Maria Conceicao A. & Thanassoulis, Emmanuel, 2001. "Decomposing school and school-type efficiency," European Journal of Operational Research, Elsevier, vol. 132(2), pages 357-373, July.
    8. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.
    9. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    10. Biresh K Sahoo & Ramadhar Singh & Bineet Mishra & Krithiga Sankaran, 2015. "Research Productivity in Management Schools of India: A Directional Benefit-of-Doubt Model Analysis," Working Papers id:7139, eSocialSciences.
    11. Smith, Jeremy & Naylor, Robin, 2005. "Schooling effects on subsequent university performance: evidence for the UK university population," Economics of Education Review, Elsevier, vol. 24(5), pages 549-562, October.
    12. Aparicio, Juan & Cordero, Jose M. & Gonzalez, Martin & Lopez-Espin, Jose J., 2018. "Using non-radial DEA to assess school efficiency in a cross-country perspective: An empirical analysis of OECD countries," Omega, Elsevier, vol. 79(C), pages 9-20.
    13. repec:lan:wpaper:1016 is not listed on IDEAS
    14. Muniz, M. A., 2002. "Separating managerial inefficiency and external conditions in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 143(3), pages 625-643, December.
    15. Alejandra Mizala & Pilar Romaguera & Dario Farren, 2002. "The technical efficiency of schools in Chile," Applied Economics, Taylor & Francis Journals, vol. 34(12), pages 1533-1552.
    16. Fusco, Elisa, 2015. "Enhancing non-compensatory composite indicators: A directional proposal," European Journal of Operational Research, Elsevier, vol. 242(2), pages 620-630.
    17. Kirjavainen, Tanja & Loikkanent, Heikki A., 1998. "Efficiency differences of finnish senior secondary schools: An application of DEA and Tobit analysis," Economics of Education Review, Elsevier, vol. 17(4), pages 377-394, October.
    18. M C A Silva Portela & E Thanassoulis & G Simpson, 2004. "Negative data in DEA: a directional distance approach applied to bank branches," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(10), pages 1111-1121, October.
    19. Carla Haelermans & John Ruggiero, 2017. "Non-parametric estimation of the cost of adequacy in education: the case of Dutch schools," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 390-398, April.
    20. Emmanuel Thanassoulis & Kristof Witte & Jill Johnes & Geraint Johnes & Giannis Karagiannis & Conceição S. Portela, 2016. "Applications of Data Envelopment Analysis in Education," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, chapter 0, pages 367-438, Springer.
    21. Cherchye, Laurens & De Witte, Kristof & Ooghe, Erwin & Nicaise, Ides, 2010. "Efficiency and equity in private and public education: A nonparametric comparison," European Journal of Operational Research, Elsevier, vol. 202(2), pages 563-573, April.
    22. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    23. Hanushek, Eric A, 1986. "The Economics of Schooling: Production and Efficiency in Public Schools," Journal of Economic Literature, American Economic Association, vol. 24(3), pages 1141-1177, September.
    24. Sahoo, Biresh K. & Singh, Ramadhar & Mishra, Bineet & Sankaran, Krithiga, 2017. "Research productivity in management schools of India during 1968-2015: A directional benefit-of-doubt model analysis," Omega, Elsevier, vol. 66(PA), pages 118-139.
    25. Cyrenne, Philippe & Chan, Alan, 2012. "High school grades and university performance: A case study," Economics of Education Review, Elsevier, vol. 31(5), pages 524-542.
    26. M C S Portela & A S Camanho & D Borges, 2012. "Performance assessment of secondary schools: the snapshot of a country taken by DEA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 63(8), pages 1098-1115, August.
    27. K De Witte & E Thanassoulis & G Simpson & G Battisti & A Charlesworth-May, 2010. "Assessing pupil and school performance by non-parametric and parametric techniques," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(8), pages 1224-1237, August.
    28. J A Sharp & W Meng & W Liu, 2007. "A modified slacks-based measure model for data envelopment analysis with ‘natural’ negative outputs and inputs," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(12), pages 1672-1677, December.
    29. Jeremy Smith & Robin Naylor, 2001. "Determinants of Degree Performance in UK Universities: A Statistical Analysis of the 1993 Student Cohort," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 63(1), pages 29-60, February.
    30. D J Mayston, 2003. "Measuring and managing educational performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(7), pages 679-691, July.
    31. Chambers, Robert G. & Chung, Yangho & Fare, Rolf, 1996. "Benefit and Distance Functions," Journal of Economic Theory, Elsevier, vol. 70(2), pages 407-419, August.
    32. repec:lan:wpaper:1015 is not listed on IDEAS
    33. Kamila Danilowicz-Gösele & Katharina Lerche & Johannes Meya & Robert Schwager, 2017. "Determinants of students' success at university," Education Economics, Taylor & Francis Journals, vol. 25(5), pages 513-532, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Laura Carosi & Ana Camanho & Giovanna D’Inverno & Kristof Witte & Rossana Riccardi, 2020. "Preface to the special issue on performance measurement and efficiency analysis—theory and practice," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 43(2), pages 409-412, December.
    2. Mergoni, Anna & Soncin, Mara & Agasisti, Tommaso, 2023. "The effect of ICT on schools’ efficiency: Empirical evidence on 23 European countries," Omega, Elsevier, vol. 119(C).
    3. Kadziński, Miłosz & Stamenković, Mladen & Uniejewski, Maciej, 2022. "Stepwise benchmarking for multiple criteria sorting," Omega, Elsevier, vol. 108(C).
    4. Silva, Pedro Luís & DesJardins, Stephen L. & Biscaia, Ricardo & Sá, Carla & Teixeira, Pedro N., 2023. "Public and Private School Grade Inflations Patterns in Secondary Education," IZA Discussion Papers 16016, Institute of Labor Economics (IZA).
    5. Francesco Chelli & Mariateresa Ciommi & Francesca Mariani & Gloria Polinesi & Maria Cristina Recchioni & Giuseppe Ricciardo Lamonica & Luca Salvati, 2022. "A Story of Strengths and Weaknesses in Tertiary Education: Evaluating ‘Mobility’ and ‘Opportunities’ in OECD Countries with Composite Indicators," Sustainability, MDPI, vol. 14(24), pages 1-19, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. Johnes, Jill, 2015. "Operational Research in education," European Journal of Operational Research, Elsevier, vol. 243(3), pages 683-696.
    3. M. Portela & A. Camanho & A. Keshvari, 2013. "Assessing the evolution of school performance and value-added: trends over four years," Journal of Productivity Analysis, Springer, vol. 39(1), pages 1-14, February.
    4. Kao, Chiang, 2020. "Measuring efficiency in a general production possibility set allowing for negative data," European Journal of Operational Research, Elsevier, vol. 282(3), pages 980-988.
    5. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    6. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    7. Juan Aparicio & Magdalena Kapelko, 2019. "Enhancing the Measurement of Composite Indicators of Corporate Social Performance," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 807-826, July.
    8. M. C. Portela & A. S. Camanho, 2007. "Performance Assessment of Portuguese Secondary Schools," Working Papers de Economia (Economics Working Papers) 07, Católica Porto Business School, Universidade Católica Portuguesa.
    9. Claudio Thieme & Diego Prior & Víctor Giménez & Emili Tortosa-Ausina, 2011. "Desempeño de los centros educativos: ¿un problema de recursos o capacidades organizativas?," Hacienda Pública Española / Review of Public Economics, IEF, vol. 199(4), pages 81-118, December.
    10. Agasisti, Tommaso & de Oliveira Ribeiro, Celma & Montemor, Daniel Sanches, 2022. "The efficiency of Brazilian elementary public schools," International Journal of Educational Development, Elsevier, vol. 93(C).
    11. M J Mancebón & M A Muñiz, 2008. "Private versus public high schools in Spain: disentangling managerial and programme efficiencies," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(7), pages 892-901, July.
    12. Kao, Chiang, 2022. "Measuring efficiency in a general production possibility set allowing for negative data: An extension and a focus on returns to scale," European Journal of Operational Research, Elsevier, vol. 296(1), pages 267-276.
    13. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    14. M-J Mancebón & J Calero & Á Choi & D P Ximénez-de-Embún, 2012. "The efficiency of public and publicly subsidized high schools in Spain: Evidence from PISA-2006," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 63(11), pages 1516-1533, November.
    15. Ruiyue Lin & Zhiping Chen, 2017. "A directional distance based super-efficiency DEA model handling negative data," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(11), pages 1312-1322, November.
    16. López-Torres, Laura & Nicolini, Rosella & Prior, Diego, 2017. "Does strategic interaction affect demand for school places? A conditional efficiency approach," Regional Science and Urban Economics, Elsevier, vol. 65(C), pages 89-103.
    17. Ramon Sala-Garrido & Manuel Mocholí-Arce & María Molinos-Senante, 2021. "Assessing the Quality of Service of Water Companies: a ‘Benefit of the Doubt’ Composite Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 371-387, May.
    18. López-Torres, Laura & Prior, Diego, 2022. "Long-term efficiency of public service provision in a context of budget restrictions. An application to the education sector," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    19. Juan Aparicio & Magdalena Kapelko & Juan F. Monge, 2020. "A Well-Defined Composite Indicator: An Application to Corporate Social Responsibility," Journal of Optimization Theory and Applications, Springer, vol. 186(1), pages 299-323, July.
    20. Henriques, C.O. & Marcenaro-Gutierrez, O.D., 2021. "Efficiency of secondary schools in Portugal: A novel DEA hybrid approach," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:95:y:2020:i:c:s030504831930427x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.