IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v163y2022i3d10.1007_s11205-022-02944-3.html
   My bibliography  Save this article

On the use of Synthetic Indexes Based on Multi-Criteria Decision Making to Study the Efficiency of Teachers

Author

Listed:
  • Ana B. Ruiz

    (Universidad de Málaga)

  • Mariano Luque

    (Universidad de Málaga)

  • Oscar D. Marcenaro-Gutierrez

    (Universidad de Málaga)

Abstract

Efficiency in education constitutes a dimension of the quality of education and gaining knowledge about the teachers’ efficiency can contribute to improving the learning achievement of students. The main purpose of this paper is to evaluate the teachers’ efficiency in order to determine which policies should be promoted in the future to reach a teaching environment enabling the teachers to be efficient. That is, we want to have a better insight about how to distribute the available resources to improve key factors of the teaching-learning context that are desirable to let them to achieve efficiency. To this aim, we measure the teachers’ efficiency from a wide multi-criteria decision making sense. We consider all the significant variables at the same importance level, assuming that efficient teachers are those achieving the best possible values for all of them simultaneously. Data from TIMSS and PIRLS 2011 for fourth-grade Spanish teachers in reading, mathematics and science are used. Firstly, three synthetic indexes (weak, strong and mixed) are built using a multi-criteria decision making approach that incorporates desirable ranges for the variable values. This allows us to know which teachers are performing better, within or worse than the desired limits. Afterward, a second stage analysis is performed to investigate the extent to which the controllable variables are determinant in the teachers’ rankings associated with these indexes. With all of this, key variables for being in the best/worst ranking positions are identified, which lets us better know which measures should be taken to promote efficiency in teaching.

Suggested Citation

  • Ana B. Ruiz & Mariano Luque & Oscar D. Marcenaro-Gutierrez, 2022. "On the use of Synthetic Indexes Based on Multi-Criteria Decision Making to Study the Efficiency of Teachers," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 163(3), pages 1269-1300, October.
  • Handle: RePEc:spr:soinre:v:163:y:2022:i:3:d:10.1007_s11205-022-02944-3
    DOI: 10.1007/s11205-022-02944-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-022-02944-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11205-022-02944-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Huebener, Mathias & Kuger, Susanne & Marcus, Jan, 2017. "Increased instruction hours and the widening gap in student performance," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 47, pages 15-34.
    2. Maria A. Cattaneo & Chantal Oggenfuss & Stefan C. Wolter, 2017. "The more, the better? The impact of instructional time on student performance," Education Economics, Taylor & Francis Journals, vol. 25(5), pages 433-445, September.
    3. Essid, Hédi & Ouellette, Pierre & Vigeant, Stéphane, 2010. "Measuring efficiency of Tunisian schools in the presence of quasi-fixed inputs: A bootstrap data envelopment analysis approach," Economics of Education Review, Elsevier, vol. 29(4), pages 589-596, August.
    4. Hanushek, Eric A. & Woessmann, Ludger, 2007. "The role of education quality for economic growth," Policy Research Working Paper Series 4122, The World Bank.
    5. Sims, David P., 2008. "Strategic responses to school accountability measures: It's all in the timing," Economics of Education Review, Elsevier, vol. 27(1), pages 58-68, February.
    6. Steven G. Rivkin & Jeffrey C. Schiman, 2015. "Instruction Time, Classroom Quality, and Academic Achievement," Economic Journal, Royal Economic Society, vol. 125(588), pages 425-448, November.
    7. Hendrik Jürges & Kerstin Schneider, 2008. "Fair ranking of teachers," Studies in Empirical Economics, in: Christian Dustmann & Bernd Fitzenberger & Stephen Machin (ed.), The Economics of Education and Training, pages 157-177, Springer.
    8. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    9. Haelermans, Carla & Ruggiero, John, 2013. "Estimating technical and allocative efficiency in the public sector: A nonparametric analysis of Dutch schools," European Journal of Operational Research, Elsevier, vol. 227(1), pages 174-181.
    10. Victor Lavy, 2015. "Do Differences in Schools' Instruction Time Explain International Achievement Gaps? Evidence from Developed and Developing Countries," Economic Journal, Royal Economic Society, vol. 125(588), pages 397-424, November.
    11. Pérez-Moreno, Salvador & Rodríguez, Beatriz & Luque, Mariano, 2016. "Assessing global competitiveness under multi-criteria perspective," Economic Modelling, Elsevier, vol. 53(C), pages 398-408.
    12. Ruiz, Francisco & Cabello, José M. & Pérez-Gladish, Blanca, 2018. "Building Ease-of-Doing-Business synthetic indicators using a double reference point approach," Technological Forecasting and Social Change, Elsevier, vol. 131(C), pages 130-140.
    13. Woessmann Ludger, 2010. "Institutional Determinants of School Efficiency and Equity: German States as a Microcosm for OECD Countries," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 230(2), pages 234-270, April.
    14. Mariano Luque & Salvador Pérez-Moreno & Beatriz Rodríguez, 2016. "Measuring Human Development: A Multi-criteria Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 125(3), pages 713-733, February.
    15. Francisco Ruiz & José Manuel Cabello, 2021. "MRP-PCI: A Multiple Reference Point Based Partially Compensatory Composite Indicator for Sustainability Assessment," Sustainability, MDPI, vol. 13(3), pages 1-19, January.
    16. Ludger Vessman & Jerik Hanushek, 2007. "The role of education quality in economic growth (Part I)," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 2, pages 86-116.
    17. Eva Crespo-Cebada & Francisco Pedraja-Chaparro & Daniel Santín, 2014. "Does school ownership matter? An unbiased efficiency comparison for regions of Spain," Journal of Productivity Analysis, Springer, vol. 41(1), pages 153-172, February.
    18. Luque, Mariano & Miettinen, Kaisa & Eskelinen, Petri & Ruiz, Francisco, 2009. "Incorporating preference information in interactive reference point methods for multiobjective optimization," Omega, Elsevier, vol. 37(2), pages 450-462, April.
    19. Vincent Blackburn & Shae Brennan & John Ruggiero, 2014. "Input-Oriented Efficiency Measures in Australian Schools," International Series in Operations Research & Management Science, in: Nonparametric Estimation of Educational Production and Costs using Data Envelopment Analysis, edition 127, chapter 0, pages 101-117, Springer.
    20. Blackburn, Vincent & Brennan, Shae & Ruggiero, John, 2014. "Measuring efficiency in Australian Schools: A preliminary analysis," Socio-Economic Planning Sciences, Elsevier, vol. 48(1), pages 4-9.
    21. O. D. Marcenaro-Gutierrez & M. Luque & L. A. Lopez-Agudo, 2016. "Balancing Teachers’ Math Satisfaction and Other Indicators of the Education System’s Performance," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(3), pages 1319-1348, December.
    22. Andrew Johnson & John Ruggiero, 2014. "Nonparametric measurement of productivity and efficiency in education," Annals of Operations Research, Springer, vol. 221(1), pages 197-210, October.
    23. Podinovski, Victor V. & Ismail, Ihsan & Bouzdine-Chameeva, Tatiana & Zhang, Wenjuan, 2014. "Combining the assumptions of variable and constant returns to scale in the efficiency evaluation of secondary schools," European Journal of Operational Research, Elsevier, vol. 239(2), pages 504-513.
    24. Mariano Luque & Salvador Pérez-Moreno & José A. Robles & Beatriz Rodriguez, 2017. "Measuring Child and Maternal Health in Developing Countries: A Proposal of New Hybrid MDG Composite Indices," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 12(3), pages 737-758, September.
    25. Elena Claudia Meroni & Giovanni Abbiati, 2016. "How do students react to longer instruction time? Evidence from Italy," Education Economics, Taylor & Francis Journals, vol. 24(6), pages 592-611, November.
    26. Luis Alejandro Lopez–Agudo & Oscar Marcenaro–Gutierrez, 2019. "Are Spanish Children Taking Advantage of their Weekly Classroom Time?," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 12(1), pages 187-211, February.
    27. Peter Wanke & Vincent Blackburn & Carlos Pestana Barros, 2016. "Cost and learning efficiency drivers in Australian schools: a two-stage network DEA approach," Applied Economics, Taylor & Francis Journals, vol. 48(38), pages 3577-3604, August.
    28. Vincent Blackburn & Shae Brennan & John Ruggiero, 2014. "Output-Oriented Efficiency Measures in Australian Schools," International Series in Operations Research & Management Science, in: Nonparametric Estimation of Educational Production and Costs using Data Envelopment Analysis, edition 127, chapter 0, pages 119-123, Springer.
    29. D K Despotis, 2005. "A reassessment of the human development index via data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(8), pages 969-980, August.
    30. Steven G. Rivkin & Jeffrey C. Schiman, 2015. "Instruction Time, Classroom Quality, and Academic Achievement," Economic Journal, Royal Economic Society, vol. 0(588), pages 425-448, November.
    31. Anna Gromada & Claire Shewbridge, 2016. "Student Learning Time: A Literature Review," OECD Education Working Papers 127, OECD Publishing.
    32. Luque, Mariano & Marcenaro-Gutierrez, Oscar D. & Ruiz, Ana B., 2020. "Evaluating the global efficiency of teachers through a multi-criteria approach," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    33. F Ruiz & J M Cabello & M Luque, 2011. "An application of reference point techniques to the calculation of synthetic sustainability indicators," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(1), pages 189-197, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luque, Mariano & Marcenaro-Gutierrez, Oscar D. & Ruiz, Ana B., 2020. "Evaluating the global efficiency of teachers through a multi-criteria approach," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    2. Huebener, Mathias & Kuger, Susanne & Marcus, Jan, 2017. "Increased instruction hours and the widening gap in student performance," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 47, pages 15-34.
    3. Barrios-Fernández, Andrés & Bovini, Giulia, 2021. "It’s time to learn: School institutions and returns to instruction time," Economics of Education Review, Elsevier, vol. 80(C).
    4. K. Kounetas & G. Androulakis & M. Kaisari & G. Manousakis, 2023. "Educational reforms and secondary school's efficiency performance in Greece: a bootstrap DEA and multilevel approach," Operational Research, Springer, vol. 23(1), pages 1-29, March.
    5. Thompson, Paul N., 2021. "Is four less than five? Effects of four-day school weeks on student achievement in Oregon," Journal of Public Economics, Elsevier, vol. 193(C).
    6. Strazzeri, Maurizio & Oggenfuss, Chantal & Wolter, Stefan C., 2022. "Much Ado about Nothing? School Curriculum Reforms and Students' Educational Trajectories," IZA Discussion Papers 15505, Institute of Labor Economics (IZA).
    7. Fischer, Martin & Karlsson, Martin & Nilsson, Therese & Schwarz, Nina, 2016. "The Sooner the Better? Compulsory Schooling Reforms in Sweden," IZA Discussion Papers 10430, Institute of Labor Economics (IZA).
    8. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    9. José M. Cordero & Víctor Cristóbal & Daniel Santín, 2018. "Causal Inference On Education Policies: A Survey Of Empirical Studies Using Pisa, Timss And Pirls," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 878-915, July.
    10. Luis Alejandro Lopez–Agudo & Oscar Marcenaro–Gutierrez, 2019. "Are Spanish Children Taking Advantage of their Weekly Classroom Time?," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 12(1), pages 187-211, February.
    11. Wedel, Katharina, 2021. "Instruction time and student achievement: The moderating role of teacher qualifications," Economics of Education Review, Elsevier, vol. 85(C).
    12. Legenzova Renata & Gaigalienė Asta & Rudytė Dalia & Skunčikienė Solveiga & Kazlauskienė Vilma, 2023. "Assessment of public education expenditure efficiency across Lithuanian municipalities," Financial Internet Quarterly (formerly e-Finanse), Sciendo, vol. 19(4), pages 63-79, December.
    13. Huebener, Mathias & Marcus, Jan, 2017. "Compressing instruction time into fewer years of schooling and the impact on student performance," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 58, pages 1-14.
    14. Simon Briole, 2019. "From Teacher Quality to Teaching Quality: Instructional Productivity and Teaching Practices in the US," Working Papers halshs-01993616, HAL.
    15. Katharina Wedel, 2021. "Instruction Time and Student Achievement: The Moderating Role of Teacher Qualifications," ifo Working Paper Series 344, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    16. Ismael Sanz & J .D. Tenaa, 2020. "A Natural Experiment on the Effect of Instruction Time and Quality: Lessons for the Covid-19 Outbreak," Working Papers 202032, University of Liverpool, Department of Economics.
    17. Vincenzo Andrietti & Xuejuan Su, 2019. "The Impact of Schooling Intensity on Student Learning: Evidence from a Quasi-Experiment," Education Finance and Policy, MIT Press, vol. 14(4), pages 679-701, Fall.
    18. Ahmadi, Mohammad Javad, 2021. "The use of instructional time in early grade reading classrooms: A study in Herat Province of Afghanistan," International Journal of Educational Development, Elsevier, vol. 84(C).
    19. Yahia, F.B. & Essid, H., 2019. "Determinants of Tunisian Schools’ Efficiency: A DEA-Tobit Approach," Journal of Applied Management and Investments, Department of Business Administration and Corporate Security, International Humanitarian University, vol. 8(1), pages 44-56, February.
    20. Martin Fischer & Martin Karlsson & Therese Nilsson & Nina Schwarz, 2020. "The Long-Term Effects of Long Terms – Compulsory Schooling Reforms in Sweden," Journal of the European Economic Association, European Economic Association, vol. 18(6), pages 2776-2823.

    More about this item

    Keywords

    Efficiency; Teachers; Synthetic index; Multi-criteria decision making;
    All these keywords.

    JEL classification:

    • A22 - General Economics and Teaching - - Economic Education and Teaching of Economics - - - Undergraduate
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:163:y:2022:i:3:d:10.1007_s11205-022-02944-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.