IDEAS home Printed from https://ideas.repec.org/a/wly/mgtdec/v45y2024i4p2171-2188.html
   My bibliography  Save this article

Teaching, research, and third mission efficiency of universities: A data envelopment analysis and hybrid multi‐criteria decision‐making approach

Author

Listed:
  • Muammer Maral
  • Münevver Çetin

Abstract

Previous studies on the efficiency of higher education institutions have generally approached the functions of higher education from a limited perspective, and the studies have followed traditional methods. The aim of this study is to determine the teaching, research, and third mission technical efficiency of universities, to rank efficient universities, to identify potential areas for improvement, and to examine the determinants of efficiency scores and the differences in scores in terms of various variables. In this study, the efficiency of 187 universities was measured by data envelopment analysis. Efficiency criteria were weighted by both objective and subjective multi‐criteria decision‐making (MCDM) methods and ranked by different MCDM methods. Beta and Linear regression were performed to determine the factors on efficiency scores. According to the results of the study, the most efficient universities are in the fields of research, teaching, and third mission, respectively. Budget criterion is the most important input criterion. Number of graduates, number of publications, and number of social responsibility projects are the most important output criteria. Having an older history positively predicts teaching and research efficiency. The size of universities and being located in developed regions negatively predict research and third mission efficiency. There is a positive relationship between rankings in teaching, research, and third mission. This research provides more comprehensive information to universities by considering teaching, research, and third mission efficiency separately. Second, this research proposes a new methodology for higher education efficiency measurement by integrating DEA and hybrid MCDM. Finally, this research provides new insights by analyzing factors related to teaching, research, and tertiary mission efficiency.

Suggested Citation

  • Muammer Maral & Münevver Çetin, 2024. "Teaching, research, and third mission efficiency of universities: A data envelopment analysis and hybrid multi‐criteria decision‐making approach," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 45(4), pages 2171-2188, June.
    • Handle: RePEc:wly:mgtdec:v:45:y:2024:i:4:p:2171-2188
    DOI: 10.1002/mde.4131
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/mde.4131
    Download Restriction: no
    File URL: https://libkey.io/10.1002/mde.4131?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abedalqader Rababah & Natalya I. Nikitina & Veronica M. Grebennikova & Zhanna R. Gardanova & Angelina O. Zekiy & Vadim V. Ponkratov & Nadezhda N. Bashkirova & Nikolay V. Kuznetsov & Tatyana I. Volkova, 2021. "University Social Responsibility during the COVID-19 Pandemic: Universities’ Case in the BRICS Countries," Sustainability, MDPI, vol. 13(13), pages 1-29, June.
    2. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    3. Jesse M. Shapiro, 2006. "Smart Cities: Quality of Life, Productivity, and the Growth Effects of Human Capital," The Review of Economics and Statistics, MIT Press, vol. 88(2), pages 324-335, May.
    4. Rey, Elena Del, 2001. "Teaching versus Research: A Model of State University Competition," Journal of Urban Economics, Elsevier, vol. 49(2), pages 356-373, March.
    5. Ching-Fu Chen & Kwok Tong Soo, 2010. "Some university students are more equal than others: Efficiency evidence from England," Economics Bulletin, AccessEcon, vol. 30(4), pages 2697-2708.
    6. Jeremy Foltz & Bradford Barham & Jean-Paul Chavas & Kwansoo Kim, 2012. "Efficiency and technological change at US research universities," Journal of Productivity Analysis, Springer, vol. 37(2), pages 171-186, April.
    7. Tommaso Agasisti & Carsten Pohl, 2012. "Comparing German and Italian Public Universities: Convergence or Divergence in the Higher Education Landscape?," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 33, pages 71-85, March.
    8. Philip G. Altbach & Jamil Salmi, 2011. "The Road to Academic Excellence : The Making of World-Class Research Universities [El camino hacia la excelencia académica : la constitución de universidades de investigación de rango mundial]," World Bank Publications - Books, The World Bank Group, number 2357, April.
    9. Winters, John V., 2011. "Human capital, higher education institutions, and quality of life," Regional Science and Urban Economics, Elsevier, vol. 41(5), pages 446-454, September.
    10. Ariel Gustavo Letti & Mauricio Vaz Lobo Bittencourt & Luis E. Vila, 2022. "Stochastic vs. deterministic frontier distance output function: Evidence from Brazilian higher education institutions," Journal of Productivity Analysis, Springer, vol. 58(1), pages 55-74, August.
    11. Tommaso Agasisti & Carlo Salerno, 2007. "Assessing the Cost Efficiency of Italian Universities," Education Economics, Taylor & Francis Journals, vol. 15(4), pages 455-471.
    12. Michael Dummett, 1998. "The Borda count and agenda manipulation," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 15(2), pages 289-296.
    13. Kuo, Jenn-Shyong & Ho, Yi-Cheng, 2008. "The cost efficiency impact of the university operation fund on public universities in Taiwan," Economics of Education Review, Elsevier, vol. 27(5), pages 603-612, October.
    14. Nabil Amara & Réjean Landry & Norrin Halilem, 2015. "What can university administrators do to increase the publication and citation scores of their faculty members?," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 489-530, May.
    15. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Efficiency and economies of scale and specialization in European universities: A directional distance approach," Journal of Informetrics, Elsevier, vol. 9(3), pages 430-448.
    16. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    17. Joanna Wolszczak-Derlacz & Aleksandra Parteka, 2011. "Efficiency of European public higher education institutions: a two-stage multicountry approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 887-917, December.
    18. Ho, William, 2008. "Integrated analytic hierarchy process and its applications - A literature review," European Journal of Operational Research, Elsevier, vol. 186(1), pages 211-228, April.
    19. Andrea Bonaccorsi & Cinzia Daraio, 2003. "A robust nonparametric approach to the analysis of scientific productivity," Research Evaluation, Oxford University Press, vol. 12(1), pages 47-69, April.
    20. Dariush Khezrimotlagh & Wade D. Cook & Joe Zhu, 2021. "Number of performance measures versus number of decision making units in DEA," Annals of Operations Research, Springer, vol. 303(1), pages 529-562, August.
    21. Susanne Warning, 2004. "Performance Differences in German Higher Education: Empirical Analysis of Strategic Groups," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 24(4), pages 393-408, June.
    22. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    23. Frenken, Koen & Heimeriks, Gaston J. & Hoekman, Jarno, 2017. "What drives university research performance? An analysis using the CWTS Leiden Ranking data," Journal of Informetrics, Elsevier, vol. 11(3), pages 859-872.
    24. Gerhard Kempkes & Carsten Pohl, 2010. "The efficiency of German universities-some evidence from nonparametric and parametric methods," Applied Economics, Taylor & Francis Journals, vol. 42(16), pages 2063-2079.
    25. Brzezicki, Łukasz, 2020. "The Efficiency of Public and Private Higher Education Institutions in Poland," Gospodarka Narodowa-The Polish Journal of Economics, Szkoła Główna Handlowa w Warszawie / SGH Warsaw School of Economics, vol. 2020(4), December.
    26. Colin Glass, J. & McCallion, Gillian & McKillop, Donal G. & Rasaratnam, Syamarlah & Stringer, Karl S., 2006. "Implications of variant efficiency measures for policy evaluations in UK higher education," Socio-Economic Planning Sciences, Elsevier, vol. 40(2), pages 119-142, June.
    27. Carolyn–Dung T. T. Tran & Renato A. Villano, 2017. "Input Rigidities and Performance of Vietnamese Universities," Asian Economic Journal, East Asian Economic Association, vol. 31(3), pages 253-273, September.
    28. Tommaso Agasisti & Antonio Dal Bianco, 2009. "Measuring efficiency of Higher Education institutions," International Journal of Management and Decision Making, Inderscience Enterprises Ltd, vol. 10(5/6), pages 443-465.
    29. Yu-ke Chen & Yan Zou & Zhe Chen, 2014. "Preference Integration and Optimization of Multistage Weighted Voting System Based on Ordinal Preference," Abstract and Applied Analysis, Hindawi, vol. 2014, pages 1-6, May.
    30. Eric A. Hanushek, 2016. "Will more higher education improve economic growth?," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 32(4), pages 538-552.
    31. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    32. Mensah, Yaw M. & Werner, Robert, 2003. "Cost efficiency and financial flexibility in institutions of higher education," Journal of Accounting and Public Policy, Elsevier, vol. 22(4), pages 293-323.
    33. Wael Mousa & Yaseen Ghulam, 2019. "Exploring efficiency differentials between Saudi higher education institutions," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 40(2), pages 180-199, March.
    34. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    35. Dietz, James S. & Bozeman, Barry, 2005. "Academic careers, patents, and productivity: industry experience as scientific and technical human capital," Research Policy, Elsevier, vol. 34(3), pages 349-367, April.
    36. J. -P. Vandamme & N. Meskens & J. -F. Superby, 2007. "Predicting Academic Performance by Data Mining Methods," Education Economics, Taylor & Francis Journals, vol. 15(4), pages 405-419.
    37. Eva M de la Torre & Fernando Casani & Marti Sagarra, 2018. "Defining typologies of universities through a DEA-MDS analysis: An institutional characterization for formative evaluation purposes," Research Evaluation, Oxford University Press, vol. 27(4), pages 388-403.
    38. Delimiro Visbal-Cadavid & Mónica Martínez-Gómez & Francisco Guijarro, 2017. "Assessing the Efficiency of Public Universities through DEA. A Case Study," Sustainability, MDPI, vol. 9(8), pages 1-19, August.
    39. Yu-ke Chen & Yan Zou & Zhe Chen, 2014. "Preference Integration and Optimization of Multistage Weighted Voting System Based on Ordinal Preference," Abstract and Applied Analysis, John Wiley & Sons, vol. 2014(1).
    40. Johnes, Jill, 2006. "Measuring teaching efficiency in higher education: An application of data envelopment analysis to economics graduates from UK Universities 1993," European Journal of Operational Research, Elsevier, vol. 174(1), pages 443-456, October.
    41. E Thanassoulis & M Kortelainen & G Johnes & J Johnes, 2011. "Costs and efficiency of higher education institutions in England: a DEA analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(7), pages 1282-1297, July.
    42. NG, Ying Chu & LI, Sung-ko, 2009. "Efficiency and productivity growth in Chinese universities during the post-reform period," China Economic Review, Elsevier, vol. 20(2), pages 183-192, June.
    43. Tommaso Agasisti, 2011. "Performances and spending efficiency in higher education: a European comparison through non-parametric approaches," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 199-224.
    44. Domingo Docampo & Lawrence Cram, 2017. "Academic performance and institutional resources: a cross-country analysis of research universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 739-764, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    2. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    3. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    4. Fu, Tsu-Tan & See, Kok Fong, 2022. "An integrated analysis of quality and productivity growth in China’s and Taiwan’s higher education institutions," Economic Analysis and Policy, Elsevier, vol. 74(C), pages 234-249.
    5. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    6. Anis Mardiana Ahmad & Noor Saifurina Nana Khurizan, 2024. "Data Envelopment Analysis and Higher Education: A Systematic Review of the 2018–2022 Literature and Bibliometric Analysis of the Past 30 Years of Literature," SAGE Open, , vol. 14(3), pages 21582440241, September.
    7. Rella, Angela & Rubino, Michele & Raimo, Nicola & Vitolla, Filippo, 2024. "Does the digitalization of municipalities affect the efficiency of universities? An Italian case study using DEA and Malmquist index approaches," Technology in Society, Elsevier, vol. 77(C).
    8. Yaisawarng, Suthathip & Ng, Ying Chu, 2014. "The impact of higher education reform on research performance of Chinese universities," China Economic Review, Elsevier, vol. 31(C), pages 94-105.
    9. Herberholz, Lars & Wigger, Berthold U., 2021. "Efficiency of European universities: A comparison of peers," Research Policy, Elsevier, vol. 50(9).
    10. Lars Herberholz & Berthold U. Wigger, 2020. "Efficiency of European Universities: A Comparison of Peers," CESifo Working Paper Series 8044, CESifo.
    11. Erik E. Lehmann & Michele Meoli & Stefano Paleari & Sarah A. E. Stockinger, 2018. "Approaching effects of the economic crisis on university efficiency: a comparative study of Germany and Italy," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 8(1), pages 37-54, March.
    12. Daraio, Cinzia & Simar, Léopold & Wilson, Paul W., 2021. "Quality as a latent heterogeneity factor in the efficiency of universities," Economic Modelling, Elsevier, vol. 99(C).
    13. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    14. Bouzouita, Anis & Kooli, Imen, 2024. "Evaluating the performance of Tunisian higher Institutes of Technological Studies (ISETs) using a stochastic frontier analysis," Evaluation and Program Planning, Elsevier, vol. 107(C).
    15. Tommaso Agasisti & Sabine Gralka, 2019. "The transient and persistent efficiency of Italian and German universities: a stochastic frontier analysis," Applied Economics, Taylor & Francis Journals, vol. 51(46), pages 5012-5030, October.
    16. Gralka, Sabine, 2018. "Stochastic frontier analysis in higher education: A systematic review," CEPIE Working Papers 05/18, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    17. Joanna Wolszczak-Derlacz & Aleksandra Parteka, 2011. "Efficiency of European public higher education institutions: a two-stage multicountry approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 887-917, December.
    18. Lee, Boon L. & Worthington, Andrew C., 2016. "A network DEA quantity and quality-orientated production model: An application to Australian university research services," Omega, Elsevier, vol. 60(C), pages 26-33.
    19. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    20. Zofio, Jose Luis & Aparicio, Juan & Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel, 2024. "Benchmarking performance through efficiency analysis trees: Improvement strategies for colombian higher education institutions," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:mgtdec:v:45:y:2024:i:4:p:2171-2188. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/7976 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.