IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v60y2016icp26-33.html
   My bibliography  Save this article

A network DEA quantity and quality-orientated production model: An application to Australian university research services

Author

Listed:
  • Lee, Boon L.
  • Worthington, Andrew C.

Abstract

The motivation for this analysis is the recently developed Excellence in Research for Australia (ERA) program developed to assess the quality of research in Australia. The objective is to develop an appropriate empirical model that better represents the underlying production of higher education research. In general, past studies on university research performance have used standard DEA models with some quantifiable research outputs. However, these suffer from the twin maladies of an inappropriate production specification and a lack of consideration of the quality of output. By including the qualitative attributes of peer-reviewed journals, we develop a procedure that captures both quality and quantity, and apply it using a network DEA model. Our main finding is that standard DEA models tend to overstate the research efficiency of most Australian universities.

Suggested Citation

  • Lee, Boon L. & Worthington, Andrew C., 2016. "A network DEA quantity and quality-orientated production model: An application to Australian university research services," Omega, Elsevier, vol. 60(C), pages 26-33.
  • Handle: RePEc:eee:jomega:v:60:y:2016:i:c:p:26-33
    DOI: 10.1016/j.omega.2015.05.014
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048315001280
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2015.05.014?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    2. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    3. Rolf Färe & Shawna Grosskopf & Gerald Whittaker, 2014. "Network DEA II," International Series in Operations Research & Management Science, in: Wade D. Cook & Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 0, pages 307-327, Springer.
    4. Philip Andrew Stevens, 2005. "A Stochastic Frontier Analysis of English and Welsh Universities," Education Economics, Taylor & Francis Journals, vol. 13(4), pages 355-374.
    5. Simon, Jose & Simon, Clara & Arias, Alicia, 2011. "Changes in productivity of Spanish university libraries," Omega, Elsevier, vol. 39(5), pages 578-588, October.
    6. Matthews, Kent, 2013. "Risk management and managerial efficiency in Chinese banks: A network DEA framework," Omega, Elsevier, vol. 41(2), pages 207-215.
    7. Gerhard Kempkes & Carsten Pohl, 2010. "The efficiency of German universities-some evidence from nonparametric and parametric methods," Applied Economics, Taylor & Francis Journals, vol. 42(16), pages 2063-2079.
    8. Izadi, Hooshang & Johnes, Geraint & Oskrochi, Reza & Crouchley, Robert, 2002. "Stochastic frontier estimation of a CES cost function: the case of higher education in Britain," Economics of Education Review, Elsevier, vol. 21(1), pages 63-71, February.
    9. Jeremy Foltz & Bradford Barham & Jean-Paul Chavas & Kwansoo Kim, 2012. "Efficiency and technological change at US research universities," Journal of Productivity Analysis, Springer, vol. 37(2), pages 171-186, April.
    10. A. T. Flegg & D. O. Allen, 2007. "Does Expansion Cause Congestion? The Case of the Older British Universities, 1994-2004," Education Economics, Taylor & Francis Journals, vol. 15(1), pages 75-102.
    11. Boon L. Lee, 2011. "Efficiency of Research Performance of Australian Universities: A Reappraisal using a Bootstrap Truncated Regression Approach," Economic Analysis and Policy, Elsevier, vol. 41(3), pages 195-204, December.
    12. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    13. Tommaso Agasisti & Carsten Pohl, 2012. "Comparing German and Italian Public Universities: Convergence or Divergence in the Higher Education Landscape?," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 33, pages 71-85, March.
    14. Avkiran, Necmi K., 2001. "Investigating technical and scale efficiencies of Australian Universities through data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 35(1), pages 57-80, March.
    15. Chiang Kao, 2014. "Efficiency Decomposition in Network Data Envelopment Analysis," International Series in Operations Research & Management Science, in: Wade D. Cook & Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 0, pages 55-77, Springer.
    16. Tone, Kaoru & Tsutsui, Miki, 2009. "Network DEA: A slacks-based measure approach," European Journal of Operational Research, Elsevier, vol. 197(1), pages 243-252, August.
    17. Johnes, Geraint & Johnes, Jill, 2009. "Higher education institutions' costs and efficiency: Taking the decomposition a further step," Economics of Education Review, Elsevier, vol. 28(1), pages 107-113, February.
    18. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    19. Kao, Chiang & Hwang, Shiuh-Nan, 2008. "Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan," European Journal of Operational Research, Elsevier, vol. 185(1), pages 418-429, February.
    20. Adler, Nicole & Liebert, Vanessa & Yazhemsky, Ekaterina, 2013. "Benchmarking airports from a managerial perspective," Omega, Elsevier, vol. 41(2), pages 442-458.
    21. Kaoru Tone & Miki Tsutsui, 2014. "Slacks-Based Network DEA," International Series in Operations Research & Management Science, in: Wade D. Cook & Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 0, pages 231-259, Springer.
    22. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    23. Johan Bollen & Herbert Van de Sompel & Aric Hagberg & Ryan Chute, 2009. "A Principal Component Analysis of 39 Scientific Impact Measures," PLOS ONE, Public Library of Science, vol. 4(6), pages 1-11, June.
    24. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    25. Tommaso Agasisti & Geraint Johnes, 2009. "Beyond frontiers: comparing the efficiency of higher education decision-making units across more than one country," Education Economics, Taylor & Francis Journals, vol. 17(1), pages 59-79.
    26. Liu, John S. & Lu, Wen-Min, 2010. "DEA and ranking with the network-based approach: a case of R&D performance," Omega, Elsevier, vol. 38(6), pages 453-464, December.
    27. Worthington, Andrew C. & Higgs, Helen, 2014. "Economies of scale and scope in Australian urban water utilities," Utilities Policy, Elsevier, vol. 31(C), pages 52-62.
    28. Gary Madden & Scott Savage & Steven Kemp, 1997. "Measuring Public Sector Efficiency: A Study of Economics Departments at Australian Universities," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 153-168.
    29. Geraint Johnes & Astrid Schwarzenberger, 2011. "Differences in cost structure and the evaluation of efficiency: the case of German universities," Education Economics, Taylor & Francis Journals, vol. 19(5), pages 487-499, January.
    30. Kao, Chiang, 2014. "Efficiency decomposition in network data envelopment analysis with slacks-based measures," Omega, Elsevier, vol. 45(C), pages 1-6.
    31. Huang, Chin-wei & Ho, Foo Nin & Chiu, Yung-ho, 2014. "Measurement of tourist hotels׳ productive efficiency, occupancy, and catering service effectiveness using a modified two-stage DEA model in Taiwan," Omega, Elsevier, vol. 48(C), pages 49-59.
    32. Fukuyama, Hirofumi & Weber, William L., 2010. "A slacks-based inefficiency measure for a two-stage system with bad outputs," Omega, Elsevier, vol. 38(5), pages 398-409, October.
    33. Avkiran, Necmi Kemal, 2015. "An illustration of dynamic network DEA in commercial banking including robustness tests," Omega, Elsevier, vol. 55(C), pages 141-150.
    34. González-Pereira, Borja & Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2010. "A new approach to the metric of journals’ scientific prestige: The SJR indicator," Journal of Informetrics, Elsevier, vol. 4(3), pages 379-391.
    35. Yu, Ming-Miin, 2010. "Assessment of airport performance using the SBM-NDEA model," Omega, Elsevier, vol. 38(6), pages 440-452, December.
    36. Li, Yongjun & Chen, Yao & Liang, Liang & Xie, Jianhui, 2012. "DEA models for extended two-stage network structures," Omega, Elsevier, vol. 40(5), pages 611-618.
    37. A. T. Flegg & D. O. Allen & K. Field & T. W. Thurlow, 2004. "Measuring the efficiency of British universities: a multi-period data envelopment analysis," Education Economics, Taylor & Francis Journals, vol. 12(3), pages 231-249.
    38. NG, Ying Chu & LI, Sung-ko, 2009. "Efficiency and productivity growth in Chinese universities during the post-reform period," China Economic Review, Elsevier, vol. 20(2), pages 183-192, June.
    39. Melville McMillan & Wing Chan, 2006. "University Efficiency: A Comparison and Consolidation of Results from Stochastic and Non-stochastic Methods," Education Economics, Taylor & Francis Journals, vol. 14(1), pages 1-30.
    40. Wang, Ke & Huang, Wei & Wu, Jie & Liu, Ying-Nan, 2014. "Efficiency measures of the Chinese commercial banking system using an additive two-stage DEA," Omega, Elsevier, vol. 44(C), pages 5-20.
    41. Brinn, Tony & Jones, Michael John & Pendlebury, Maurice, 2000. "Measuring research quality: peer review 1, citation indices 0," Omega, Elsevier, vol. 28(2), pages 237-239, April.
    42. Liu, Wenbin & Zhou, Zhongbao & Ma, Chaoqun & Liu, Debin & Shen, Wanfang, 2015. "Two-stage DEA models with undesirable input-intermediate-outputs," Omega, Elsevier, vol. 56(C), pages 74-87.
    43. Akther, Syed & Fukuyama, Hirofumi & Weber, William L., 2013. "Estimating two-stage network Slacks-based inefficiency: An application to Bangladesh banking," Omega, Elsevier, vol. 41(1), pages 88-96.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eucabeth Majiwa & Boon L. Lee & Clevo Wilson & Hidemichi Fujii & Shunsuke Managi, 2018. "A network data envelopment analysis (NDEA) model of post-harvest handling: the case of Kenya’s rice processing industry," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 10(3), pages 631-648, June.
    2. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    3. Yaisawarng, Suthathip & Ng, Ying Chu, 2014. "The impact of higher education reform on research performance of Chinese universities," China Economic Review, Elsevier, vol. 31(C), pages 94-105.
    4. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    5. Kao, Chiang, 2014. "Network data envelopment analysis: A review," European Journal of Operational Research, Elsevier, vol. 239(1), pages 1-16.
    6. Lozano, Sebastián, 2016. "Slacks-based inefficiency approach for general networks with bad outputs: An application to the banking sector," Omega, Elsevier, vol. 60(C), pages 73-84.
    7. Vanesa D’Elia & Gustavo Ferro, 2019. "Empirical Efficiency Measurement in Higher Education: An Overview," CEMA Working Papers: Serie Documentos de Trabajo. 708, Universidad del CEMA.
    8. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    9. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    10. Chen, Ya & Li, Yongjun & Liang, Liang & Salo, Ahti & Wu, Huaqing, 2016. "Frontier projection and efficiency decomposition in two-stage processes with slacks-based measures," European Journal of Operational Research, Elsevier, vol. 250(2), pages 543-554.
    11. Duygun, Meryem & Prior, Diego & Shaban, Mohamed & Tortosa-Ausina, Emili, 2016. "Disentangling the European airlines efficiency puzzle: A network data envelopment analysis approach," Omega, Elsevier, vol. 60(C), pages 2-14.
    12. Yang, Guo-liang & Fukuyama, Hirofumi & Chen, Kun, 2019. "Investigating the regional sustainable performance of the Chinese real estate industry: A slack-based DEA approach," Omega, Elsevier, vol. 84(C), pages 141-159.
    13. Huang, Tai-Hsin & Lin, Chung-I & Chen, Kuan-Chen, 2017. "Evaluating efficiencies of Chinese commercial banks in the context of stochastic multistage technologies," Pacific-Basin Finance Journal, Elsevier, vol. 41(C), pages 93-110.
    14. Gralka, Sabine, 2018. "Stochastic frontier analysis in higher education: A systematic review," CEPIE Working Papers 05/18, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    15. Huang, Chin-wei & Ho, Foo Nin & Chiu, Yung-ho, 2014. "Measurement of tourist hotels׳ productive efficiency, occupancy, and catering service effectiveness using a modified two-stage DEA model in Taiwan," Omega, Elsevier, vol. 48(C), pages 49-59.
    16. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    17. Calogero Guccio & Marco Ferdinando Martorana & Isidoro Mazza, 2016. "Efficiency assessment and convergence in teaching and research in Italian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1063-1094, June.
    18. Shamohammadi, Mehdi & Oh, Dong-hyun, 2019. "Measuring the efficiency changes of private universities of Korea: A two-stage network data envelopment analysis," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    19. Mad Ithnin Salleh & Nurul Fadly Habidin & Abdul Halim Masnan & Nordin Mamat, 2017. "Estimating Technical Efficiency and Bootstrapping Malmquist Indices: Analysis of Malaysian Preschool Sector," International Journal of Academic Research in Business and Social Sciences, Human Resource Management Academic Research Society, International Journal of Academic Research in Business and Social Sciences, vol. 7(3), pages 440-457, March.
    20. Liu, Wenbin & Zhou, Zhongbao & Ma, Chaoqun & Liu, Debin & Shen, Wanfang, 2015. "Two-stage DEA models with undesirable input-intermediate-outputs," Omega, Elsevier, vol. 56(C), pages 74-87.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:60:y:2016:i:c:p:26-33. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.