IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v288y2020i2d10.1007_s10479-019-03329-5.html
   My bibliography  Save this article

The performance of education systems in the light of Europe 2020 strategy

Author

Listed:
  • Dovile Stumbriene

    (Vilnius University Institute of Data Science and Digital Technologies)

  • Ana S. Camanho

    (Universidade do Porto)

  • Audrone Jakaitiene

    (Vilnius University Institute of Data Science and Digital Technologies)

Abstract

The performance evaluation of education systems is at the top of the agenda of governments and education authorities worldwide. However, research involving cross-country comparisons of the performance of education systems is still incipient. This paper proposes a new composite indicator to summarise the performance of education systems, enabling benchmarking comparisons and the definition of objectives for improvement. The research analyses different modelling alternatives for the construction of composite indicators, with varying degrees of weight flexibility. Our study uses annual data of 29 European countries, collected from Eurostat and the Organisation for Economic Co-operation and Development databases. The results obtained in terms of performance scores and country rankings are presented and their managerial implications are discussed. We conclude that composite indicators estimated using frontier techniques can support the transition from the paradigm of performance assessment (control) to performance management (improvement).

Suggested Citation

  • Dovile Stumbriene & Ana S. Camanho & Audrone Jakaitiene, 2020. "The performance of education systems in the light of Europe 2020 strategy," Annals of Operations Research, Springer, vol. 288(2), pages 577-608, May.
    • Handle: RePEc:spr:annopr:v:288:y:2020:i:2:d:10.1007_s10479-019-03329-5
    DOI: 10.1007/s10479-019-03329-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-019-03329-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-019-03329-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Morais, Paulo & Camanho, Ana S., 2011. "Evaluation of performance of European cities with the aim to promote quality of life improvements," Omega, Elsevier, vol. 39(4), pages 398-409, August.
    2. António Afonso & Miguel St. Aubyn, 2004. "Non-parametric Approaches to Education and Health Expenditure Efficiency in OECD Countries," Working Papers Department of Economics 2004/01, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    3. Bogetoft, Peter & Heinesen, Eskil & Tranæs, Torben, 2015. "The efficiency of educational production: A comparison of the Nordic countries with other OECD countries," Economic Modelling, Elsevier, vol. 50(C), pages 310-321.
    4. Hanushek, Eric A. & Luque, Javier A., 2003. "Efficiency and equity in schools around the world," Economics of Education Review, Elsevier, vol. 22(5), pages 481-502, October.
    5. Douglas Sutherland & Robert Price & Eric Gonand, 2009. "Improving public spending efficiency in primary and secondary education," OECD Journal: Economic Studies, OECD Publishing, vol. 2009(1), pages 1-30.
    6. Laurens Cherchye & Wim Moesen & Tom Van Puyenbroeck, 2004. "Legitimately Diverse, yet Comparable: On Synthesizing Social Inclusion Performance in the EU," Journal of Common Market Studies, Wiley Blackwell, vol. 42(5), pages 919-955, December.
    7. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    8. repec:dau:papers:123456789/7958 is not listed on IDEAS
    9. A. Charnes & W. W. Cooper & E. Rhodes, 1981. "Evaluating Program and Managerial Efficiency: An Application of Data Envelopment Analysis to Program Follow Through," Management Science, INFORMS, vol. 27(6), pages 668-697, June.
    10. Osman Zaim & Rolf Färe & Shawna Grosskopf, 2001. "An Economic Approach to Achievement and Improvement Indexes," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 56(1), pages 91-118, October.
    11. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    12. Sarrico, C. S. & Dyson, R. G., 2004. "Restricting virtual weights in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 159(1), pages 17-34, November.
    13. Grupp, Hariolf & Mogee, Mary Ellen, 2004. "Indicators for national science and technology policy: how robust are composite indicators?," Research Policy, Elsevier, vol. 33(9), pages 1373-1384, November.
    14. Despotis, D.K., 2005. "Measuring human development via data envelopment analysis: the case of Asia and the Pacific," Omega, Elsevier, vol. 33(5), pages 385-390, October.
    15. André Sapir, 2006. "Globalization and the Reform of European Social Models," Journal of Common Market Studies, Wiley Blackwell, vol. 44(2), pages 369-390, June.
    16. Afonso, Antonio & St. Aubyn, Miguel, 2006. "Cross-country efficiency of secondary education provision: A semi-parametric analysis with non-discretionary inputs," Economic Modelling, Elsevier, vol. 23(3), pages 476-491, May.
    17. Fried, Harold O. & Lovell, C. A. Knox & Schmidt, Shelton S. (ed.), 2008. "The Measurement of Productive Efficiency and Productivity Growth," OUP Catalogue, Oxford University Press, number 9780195183528.
    18. Andrés Fuentes, 2009. "Raising Education Outcomes in Spain," OECD Economics Department Working Papers 666, OECD Publishing.
    19. Giannis Karagiannis, 2017. "On aggregate composite indicators," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(7), pages 741-746, July.
    20. Emmanuel Thanassoulis & Kristof Witte & Jill Johnes & Geraint Johnes & Giannis Karagiannis & Conceição S. Portela, 2016. "Applications of Data Envelopment Analysis in Education," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, chapter 0, pages 367-438, Springer.
    21. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    22. V Giménez & D Prior & C Thieme, 2007. "Technical efficiency, managerial efficiency and objective-setting in the educational system: an international comparison," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(8), pages 996-1007, August.
    23. André Sapir, 2006. "Globaliseringen och de europeiska sociala modellernas reformering," ULB Institutional Repository 2013/8118, ULB -- Universite Libre de Bruxelles.
    24. Thompson, Russell G. & Langemeier, Larry N. & Lee, Chih-Tah & Lee, Euntaik & Thrall, Robert M., 1990. "The role of multiplier bounds in efficiency analysis with application to Kansas farming," Journal of Econometrics, Elsevier, vol. 46(1-2), pages 93-108.
    25. A. Zanella & A. Camanho & T. Dias, 2015. "The assessment of cities’ livability integrating human wellbeing and environmental impact," Annals of Operations Research, Springer, vol. 226(1), pages 695-726, March.
    26. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    27. Dyson, R. G. & Allen, R. & Camanho, A. S. & Podinovski, V. V. & Sarrico, C. S. & Shale, E. A., 2001. "Pitfalls and protocols in DEA," European Journal of Operational Research, Elsevier, vol. 132(2), pages 245-259, July.
    28. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    29. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    30. Russell G. Thompson & F. D. Singleton & Robert M. Thrall & Barton A. Smith, 1986. "Comparative Site Evaluations for Locating a High-Energy Physics Lab in Texas," Interfaces, INFORMS, vol. 16(6), pages 35-49, December.
    31. Yongjun Shen & Elke Hermans & Tom Brijs & Geert Wets, 2013. "Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(2), pages 739-756, November.
    32. Simon Breakspear, 2012. "The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance," OECD Education Working Papers 71, OECD Publishing.
    33. Tommaso Agasisti, 2011. "Performances and spending efficiency in higher education: a European comparison through non-parametric approaches," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 199-224.
    34. R. Allen & A. Athanassopoulos & R.G. Dyson & E. Thanassoulis, 1997. "Weights restrictions and value judgements in Data Envelopment Analysis: Evolution, development and future directions," Annals of Operations Research, Springer, vol. 73(0), pages 13-34, October.
    35. D K Despotis, 2005. "A reassessment of the human development index via data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(8), pages 969-980, August.
    36. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    37. A Zanella & A S Camanho & T G Dias, 2013. "Benchmarking countries’ environmental performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(3), pages 426-438, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lívia Mariana Lopes de Souza Torres & Francisco S. Ramos, 2024. "Are Brazilian Higher Education Institutions Efficient in Their Graduate Activities? A Two-Stage Dynamic Data-Envelopment-Analysis Cooperative Approach," Mathematics, MDPI, vol. 12(6), pages 1-41, March.
    2. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    3. M. M. Segovia-González & I. Contreras, 2023. "A Composite Indicator to Compare the Performance of Male and Female Students in Educational Systems," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 165(1), pages 181-212, January.
    4. Charlotte Wüst & Nicky Rogge, 2022. "How is the European Union progressing towards its Europe 2020 targets? A benefit-of-the-doubt window analysis," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 49(2), pages 405-438, May.
    5. Tourinho, Marco & Barbosa, Flávia & Santos, Paulo Rosa & Pinto, Francisco Taveira & Camanho, Ana S., 2023. "Productivity change in Brazilian water services: A benchmarking study of national and regional trends," Socio-Economic Planning Sciences, Elsevier, vol. 86(C).
    6. Giménez, Víctor & Prior, Diego & Thieme, Claudio & Tortosa-Ausina, Emili, 2024. "International comparisons of COVID-19 pandemic management: What can be learned from activity analysis techniques?," Omega, Elsevier, vol. 122(C).
    7. Francesco Chelli & Mariateresa Ciommi & Francesca Mariani & Gloria Polinesi & Maria Cristina Recchioni & Giuseppe Ricciardo Lamonica & Luca Salvati, 2022. "A Story of Strengths and Weaknesses in Tertiary Education: Evaluating ‘Mobility’ and ‘Opportunities’ in OECD Countries with Composite Indicators," Sustainability, MDPI, vol. 14(24), pages 1-19, December.
    8. Martina Vittorietti & Ornella Giambalvo & Vincenzo Giuseppe Genova & Fabio Aiello, 2023. "A new measure for the attitude to mobility of Italian students and graduates: a topological data analysis approach," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(2), pages 509-543, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    2. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    3. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    4. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    5. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    6. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    7. Kalinichenko, Olena & Amado, Carla A.F. & Santos, Sérgio P., 2022. "Exploring the potential of Data Envelopment Analysis for enhancing pay-for-performance programme design in primary health care," European Journal of Operational Research, Elsevier, vol. 298(3), pages 1084-1100.
    8. Pereira, Miguel Alves & Camanho, Ana Santos & Figueira, José Rui & Marques, Rui Cunha, 2021. "Incorporating preference information in a range directional composite indicator: The case of Portuguese public hospitals," European Journal of Operational Research, Elsevier, vol. 294(2), pages 633-650.
    9. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    10. Mai, Nhat Chi, 2015. "Efficiency of the banking system in Vietnam under financial liberalization," OSF Preprints qsf6d, Center for Open Science.
    11. Henriques, C.O. & Marcenaro-Gutierrez, O.D., 2021. "Efficiency of secondary schools in Portugal: A novel DEA hybrid approach," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    12. Lampe, Hannes W. & Hilgers, Dennis, 2015. "Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA," European Journal of Operational Research, Elsevier, vol. 240(1), pages 1-21.
    13. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    14. Annalina Sarra & Eugenia Nissi, 2020. "A Spatial Composite Indicator for Human and Ecosystem Well-Being in the Italian Urban Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(2), pages 353-377, April.
    15. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    16. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    17. Fusco, Elisa & Maggi, Bernardo & Rizzuto, Livia, 2022. "Alternative indicators for the evaluation of renewables in Europe: An efficiency approach," Renewable Energy, Elsevier, vol. 190(C), pages 48-65.
    18. Giménez, Víctor & Prior, Diego & Thieme, Claudio & Tortosa-Ausina, Emili, 2024. "International comparisons of COVID-19 pandemic management: What can be learned from activity analysis techniques?," Omega, Elsevier, vol. 122(C).
    19. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.
    20. António J. R. Santos & Sérgio P. Santos & Carla A. F. Amado & Efigénio L. Rebelo & Júlio C. Mendes, 2020. "Labor inspectorates’ efficiency and effectiveness assessment as a learning path to improve work-related accident prevention," Annals of Operations Research, Springer, vol. 288(2), pages 609-651, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:288:y:2020:i:2:d:10.1007_s10479-019-03329-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.