IDEAS home Printed from https://ideas.repec.org/a/pal/jorsoc/v68y2017i4d10.1057_s41274-016-0165-4.html
   My bibliography  Save this article

Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis

Author

Listed:
  • Emmanuel Thanassoulis

    (Aston University)

  • Prasanta Kumar Dey

    (Aston University)

  • Konstantinos Petridis

    (Aston University)

  • Ioannis Goniadis

    (University of Macedonia)

  • Andreas C. Georgiou

    (University of Macedonia)

Abstract

Evaluating higher education teaching performance is complex as it involves consideration of both objective and subjective criteria. The student evaluation of teaching (SET) is used to improve higher education quality. However, the traditional approaches to considering students’ responses to SET questionnaires for improving teaching quality have several shortcomings. This study proposes an integrated approach to higher education teaching evaluation that combines the analytical hierarchy process (AHP) and data envelopment analysis (DEA). The AHP allows consideration of the varying importance of each criterion of teaching performance, while DEA enables the comparison of tutors on teaching as perceived by students with a view to identifying the scope for improvement by each tutor. The proposed teaching evaluation method is illustrated using data from a higher education institution in Greece.

Suggested Citation

  • Emmanuel Thanassoulis & Prasanta Kumar Dey & Konstantinos Petridis & Ioannis Goniadis & Andreas C. Georgiou, 2017. "Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 431-445, April.
    • Handle: RePEc:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_s41274-016-0165-4
    DOI: 10.1057/s41274-016-0165-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41274-016-0165-4
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1057/s41274-016-0165-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yang, Taho & Kuo, Chunwei, 2003. "A hierarchical AHP/DEA methodology for the facilities layout design problem," European Journal of Operational Research, Elsevier, vol. 147(1), pages 128-136, May.
    2. De Witte, Kristof & Rogge, Nicky, 2011. "Accounting for exogenous influences in performance evaluations of teachers," Economics of Education Review, Elsevier, vol. 30(4), pages 641-653, August.
    3. Sueyoshi, Toshiyuki & Shang, Jennifer & Chiang, Wen-Chyuan, 2009. "A decision support framework for internal audit prioritization in a rental car company: A combined use between DEA and AHP," European Journal of Operational Research, Elsevier, vol. 199(1), pages 219-231, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oleg Badunenko & Daniel J. Henderson, 2024. "Production analysis with asymmetric noise," Journal of Productivity Analysis, Springer, vol. 61(1), pages 1-18, February.
    2. Prasanta Kumar Dey & Guo-liang Yang & Chrysovalantis Malesios & Debashree De & Konstantinos Evangelinos, 2021. "Performance Management of Supply Chain Sustainability in Small and Medium-Sized Enterprises Using a Combined Structural Equation Modelling and Data Envelopment Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 58(3), pages 573-613, October.
    3. Xianmei Wang & Hanhui Hu, 2017. "Sustainability in Chinese Higher Educational Institutions’ Social Science Research: A Performance Interface toward Efficiency," Sustainability, MDPI, vol. 9(11), pages 1-18, October.
    4. Wanjing Cheng & Dongxu Mo & Yajun Tian & Wenqiang Xu & Kechang Xie, 2018. "Research on the Composite Index of the Modern Chinese Energy System," Sustainability, MDPI, vol. 11(1), pages 1-17, December.
    5. Solmaz Ghaffarian Asl & Necdet Osam, 2021. "A Study of Teacher Performance in English for Academic Purposes Course: Evaluating Efficiency," SAGE Open, , vol. 11(4), pages 21582440211, October.
    6. Cong Cao & Tianlan Wei & Shengyuan Xu & Fan Su & Haiquan Fang, 2023. "Comprehensive evaluation of higher education systems using indicators: PCA and EWM methods," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    7. Nelson Amowine & Zhiqiang Ma & Mingxing Li & Zhixiang Zhou & Benjamin Azembila Asunka & James Amowine, 2019. "Energy Efficiency Improvement Assessment in Africa: An Integrated Dynamic DEA Approach," Energies, MDPI, vol. 12(20), pages 1-17, October.
    8. Petridis, Konstantinos & Tampakoudis, Ioannis & Drogalas, George & Kiosses, Nikolaos, 2022. "A Support Vector Machine model for classification of efficiency: An application to M&A," Research in International Business and Finance, Elsevier, vol. 61(C).
    9. Lihui Xiong & Ximiao Dong & Jiaqi Fang, 2023. "Interdisciplinary Teaching Reform of Financial Engineering Majors Based on the Analytic Hierarchy Process in the Post-Pandemic Era," Sustainability, MDPI, vol. 15(11), pages 1-17, May.
    10. Wen Li & Yicheng Ye & Nanyan Hu & Xianhua Wang & Qihu Wang, 2019. "Real-Time Warning and Risk Assessment of Tailings Dam Disaster Status Based on Dynamic Hierarchy-Grey Relation Analysis," Complexity, Hindawi, vol. 2019, pages 1-14, April.
    11. Zhang, Ganggang & Wu, Jie & Zhu, Qingyuan, 2020. "Performance evaluation and enrollment quota allocation for higher education institutions in China," Evaluation and Program Planning, Elsevier, vol. 81(C).
    12. Georgios Tsaples & Jason Papathanasiou & Andreas C. Georgiou, 2022. "An Exploratory DEA and Machine Learning Framework for the Evaluation and Analysis of Sustainability Composite Indicators in the EU," Mathematics, MDPI, vol. 10(13), pages 1-27, June.
    13. Tao Ding & Zhixiang Zhou & Qianzhi Dai & Liang Liang, 2020. "Analysis of China’s Regional Economic Environmental Performance: A Non-radial Multi-objective DEA Approach," Computational Economics, Springer;Society for Computational Economics, vol. 55(4), pages 1209-1231, April.
    14. Lena Malesevic Perovic & Maja Mihaljevic Kosor, 2020. "The Efficiency of Universities in Achieving Sustainable Development Goals," The AMFITEATRU ECONOMIC journal, Academy of Economic Studies - Bucharest, Romania, vol. 22(54), pages 516-516, April.
    15. Qi-Zhen Zhang & Shan Jiang & Ran Liu & Hu-Chen Liu, 2020. "An Integrated Decision-Making Model for Analyzing Key Performance Indicators in University Performance Management," Mathematics, MDPI, vol. 8(10), pages 1-16, October.
    16. Ma, Zhanxin & See, Kok Fong & Yu, Ming-Miin & Zhao, Chunying, 2021. "Research efficiency analysis of China's university faculty members: A modified meta-frontier DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 76(C).
    17. Xi Xiong & Guo-liang Yang & Kai-di Liu & De-qun Zhou, 2022. "A proposed fixed-sum carryovers reallocation DEA approach for social scientific resources of Chinese public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4097-4121, July.
    18. Qiuhu Shao & Jingfeng Yuan & Jin Lin & Wei Huang & Junwei Ma & Hongxing Ding, 2021. "A SBM-DEA based performance evaluation and optimization for social organizations participating in community and home-based elderly care services," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-25, March.
    19. Ao Yu & Zhuoqiang Jia & Weike Zhang & Ke Deng & Francisco Herrera, 2020. "A Dynamic Credit Index System for TSMEs in China Using the Delphi and Analytic Hierarchy Process (AHP) Methods," Sustainability, MDPI, vol. 12(5), pages 1-21, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dyckhoff, Harald & Souren, Rainer, 2022. "Integrating multiple criteria decision analysis and production theory for performance evaluation: Framework and review," European Journal of Operational Research, Elsevier, vol. 297(3), pages 795-816.
    2. Yande Gong & Joe Zhu & Ya Chen & Wade D. Cook, 2018. "DEA as a tool for auditing: application to Chinese manufacturing industry with parallel network structures," Annals of Operations Research, Springer, vol. 263(1), pages 247-269, April.
    3. Jorge David Quinteo Otero & William Orlando Prieto Bustos & Fernando Barrios Aguirre & Laura Elena Leviller Guardo, 2008. "Determinantes de la eficiencia técnica en las empresas colombianas, 2001-2004," Revista Semestre Económico, Universidad de Medellín, November.
    4. H Seol & H Lee & S Kim & Y Park, 2008. "The impact of information technology on organizational efficiency in public services: a DEA-based DT approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 231-238, February.
    5. Tseng, Fang-Mei & Chiu, Yu-Jing & Chen, Ja-Shen, 2009. "Measuring business performance in the high-tech manufacturing industry: A case study of Taiwan's large-sized TFT-LCD panel companies," Omega, Elsevier, vol. 37(3), pages 686-697, June.
    6. Pongou, Roland & Tchantcho, Bertrand & Tedjeugang, Narcisse, 2014. "Power theories for multi-choice organizations and political rules: Rank-order equivalence," Operations Research Perspectives, Elsevier, vol. 1(1), pages 42-49.
    7. Gulati, Rachita & Kattumuri, Ruth & Kumar, Sunil, 2020. "A non-parametric index of corporate governance in the banking industry: An application to Indian data," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    8. Anne Boring, 2015. "Gender Biases in student evaluations of teachers," Documents de Travail de l'OFCE 2015-13, Observatoire Francais des Conjonctures Economiques (OFCE).
    9. Lai, Po‐Lin & Potter, Andrew & Beynon, Malcolm & Beresford, Anthony, 2015. "Evaluating the efficiency performance of airports using an integrated AHP/DEA-AR technique," Transport Policy, Elsevier, vol. 42(C), pages 75-85.
    10. Gholam R. Amin & Osama El‐Temtamy & Samy Garas, 2022. "Audit Risk Evaluation Using Data Envelopment Analysis with Ordinal Data," Abacus, Accounting Foundation, University of Sydney, vol. 58(3), pages 589-602, September.
    11. Baskaran, Venkatesan & Nachiappan, Subramanian & Rahman, Shams, 2012. "Indian textile suppliers' sustainability evaluation using the grey approach," International Journal of Production Economics, Elsevier, vol. 135(2), pages 647-658.
    12. Cordero Ferrera, Jose Manuel & Alonso Morán, Edurne & Nuño Solís, Roberto & Orueta, Juan F. & Souto Arce, Regina, 2013. "Efficiency assessment of primary care providers: A conditional nonparametric approach," MPRA Paper 51926, University Library of Munich, Germany.
    13. Tommaso Agasisti & Ekaterina Shibanova, 2020. "Autonomy, Performance And Efficiency: An Empirical Analysis Of Russian Universities 2014-2018," HSE Working papers WP BRP 224/EC/2020, National Research University Higher School of Economics.
    14. Zhang, Ruijun & Lu, Jie & Zhang, Guangquan, 2011. "A knowledge-based multi-role decision support system for ore blending cost optimization of blast furnaces," European Journal of Operational Research, Elsevier, vol. 215(1), pages 194-203, November.
    15. Seyed Saeed Hosseinian & Hamidreza Navidi & Abas Hajfathaliha, 2012. "A New Linear Programming Method for Weights Generation and Group Decision Making in the Analytic Hierarchy Process," Group Decision and Negotiation, Springer, vol. 21(3), pages 233-254, May.
    16. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    17. Vadivel Sengazhani Murugesan & A. H. Sequeira & Deeksha Sanjay Shetty & Sunil Kumar Jauhar, 2020. "Enhancement of mail operational performance of India post facility layout using AHP," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 11(2), pages 261-273, April.
    18. Lin, Ming-Ian & Lee, Yuan-Duen & Ho, Tsai-Neng, 2011. "Applying integrated DEA/AHP to evaluate the economic performance of local governments in China," European Journal of Operational Research, Elsevier, vol. 209(2), pages 129-140, March.
    19. J Mingers & W Liu & W Meng, 2009. "Using SSM to structure the identification of inputs and outputs in DEA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(2), pages 168-179, February.
    20. De Witte, Kristof & Rogge, Nicky & Cherchye, Laurens & Van Puyenbroeck, Tom, 2013. "Economies of scope in research and teaching: A non-parametric investigation," Omega, Elsevier, vol. 41(2), pages 305-314.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_s41274-016-0165-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.