IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v49y2025i4p678-707.html

Performance Evaluation of University-Based Scientific Research Institutions With a Non-Independent Parallel System

Author

Listed:
  • Junming Guo
  • Chuanbin Liu
  • Han Zhang
  • Dan Wang
  • Jintao Lu

Abstract

Performance management in university-based scientific research institutions is essential for driving reform, advancing education quality, and fostering innovation. However, current performance evaluation models often focus solely on research indicators, neglecting the critical interdependence between the education and research systems. This oversight leads to inefficiencies in resource allocation and an underestimation of overall institutional performance, particularly in universities with varying development levels. To address these deficiencies, this study introduces two innovative two-stage data envelopment analysis models: the group-frontier and meta-frontier evaluation models. The findings are validated using data from 144 universities across China. They demonstrate that the proposed models effectively mitigate the underestimation of efficiency in traditional models and accurately reflect the intertwined nature of university subsystems and the disparities in university development. These results offer valuable insights for improving the performance of scientific research institutions and informing the strategic decisions of university administrators and government education departments.

Suggested Citation

  • Junming Guo & Chuanbin Liu & Han Zhang & Dan Wang & Jintao Lu, 2025. "Performance Evaluation of University-Based Scientific Research Institutions With a Non-Independent Parallel System," Evaluation Review, , vol. 49(4), pages 678-707, August.
    • Handle: RePEc:sae:evarev:v:49:y:2025:i:4:p:678-707
    DOI: 10.1177/0193841X241312823
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X241312823
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X241312823?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wu, Jie & Zhu, Qingyuan & Ji, Xiang & Chu, Junfei & Liang, Liang, 2016. "Two-stage network processes with shared resources and resources recovered from undesirable outputs," European Journal of Operational Research, Elsevier, vol. 251(1), pages 182-197.
    2. Aihua Chen & Donald Patton & Martin Kenney, 2016. "University technology transfer in China: a literature review and taxonomy," The Journal of Technology Transfer, Springer, vol. 41(5), pages 891-929, October.
    3. Wu, Jie & Xu, Guangcheng & Zhu, Qingyuan & Zhang, Chaochao, 2021. "Two-stage DEA models with fairness concern: Modelling and computational aspects," Omega, Elsevier, vol. 105(C).
    4. Mohammad Nemati & Reza Kazemi Matin & Mehdi Toloo, 2020. "A two-stage DEA model with partial impacts between inputs and outputs: application in refinery industries," Annals of Operations Research, Springer, vol. 295(1), pages 285-312, December.
    5. Ding, Tao & Zhang, Yun & Zhang, Danlu & Li, Feng, 2023. "Performance evaluation of Chinese research universities: A parallel interactive network DEA approach with shared and fixed sum inputs," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    6. Chen, Yao & Cook, Wade D. & Li, Ning & Zhu, Joe, 2009. "Additive efficiency decomposition in two-stage DEA," European Journal of Operational Research, Elsevier, vol. 196(3), pages 1170-1176, August.
    7. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    8. Thomas Sexton & Herbert Lewis, 2003. "Two-Stage DEA: An Application to Major League Baseball," Journal of Productivity Analysis, Springer, vol. 19(2), pages 227-249, April.
    9. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    10. Kao, Chiang & Hwang, Shiuh-Nan, 2011. "Decomposition of technical and scale efficiencies in two-stage production systems," European Journal of Operational Research, Elsevier, vol. 211(3), pages 515-519, June.
    11. Muhammad Dimyati & Adhi Indra Hermanu, 2023. "Evaluating Research Efficiency in Indonesian Higher Education Institution," Evaluation Review, , vol. 47(2), pages 155-181, April.
    12. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fabio Pugini, 2008. "The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 225-244, August.
    13. Henk J. ter Bogt & Robert W. Scapens, 2012. "Performance Management in Universities: Effects of the Transition to More Quantitative Measurement Systems," European Accounting Review, Taylor & Francis Journals, vol. 21(3), pages 451-497, February.
    14. Liu, Xing & Wu, Xianhua & Zhang, Weipan, 2024. "A new DEA model and its application in performance evaluation of scientific research activities in the universities of China's double first-class initiative," Socio-Economic Planning Sciences, Elsevier, vol. 92(C).
    15. Oh, Dong-hyun, 2010. "A metafrontier approach for measuring an environmentally sensitive productivity growth index," Energy Economics, Elsevier, vol. 32(1), pages 146-157, January.
    16. Li, Haitao & Chen, Chialin & Cook, Wade D. & Zhang, Jinlong & Zhu, Joe, 2018. "Two-stage network DEA: Who is the leader?," Omega, Elsevier, vol. 74(C), pages 15-19.
    17. Meng, Fanyong & Xiong, Beibei, 2021. "Logical efficiency decomposition for general two-stage systems in view of cross efficiency," European Journal of Operational Research, Elsevier, vol. 294(2), pages 622-632.
    18. Wen-Chih Chen, 2021. "On performance evaluation with a dual-role factor," Annals of Operations Research, Springer, vol. 304(1), pages 63-84, September.
    19. Torben Tiedemann & Tammo Francksen & Uwe Latacz-Lohmann, 2011. "Assessing the performance of German Bundesliga football players: a non-parametric metafrontier approach," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 19(4), pages 571-587, December.
    20. Liang Liang & Feng Yang & Wade Cook & Joe Zhu, 2006. "DEA models for supply chain efficiency evaluation," Annals of Operations Research, Springer, vol. 145(1), pages 35-49, July.
    21. José Manuel Pastor & Lorenzo Serrano, 2016. "The determinants of the research output of universities: specialization, quality and inefficiencies," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1255-1281, November.
    22. Zhang, Chonghui & Jiang, Nanyue & Su, Tiantian & Chen, Ji & Streimikiene, Dalia & Balezentis, Tomas, 2022. "Spreading knowledge and technology: Research efficiency at universities based on the three-stage MCDM-NRSDEA method with bootstrapping," Technology in Society, Elsevier, vol. 68(C).
    23. Lawrence M. Seiford & Joe Zhu, 1999. "Profitability and Marketability of the Top 55 U.S. Commercial Banks," Management Science, INFORMS, vol. 45(9), pages 1270-1288, September.
    24. Compagnucci, Lorenzo & Spigarelli, Francesca, 2020. "The Third Mission of the university: A systematic literature review on potentials and constraints," Technological Forecasting and Social Change, Elsevier, vol. 161(C).
    25. Kang, Yankun & Liu, Ruiming, 2021. "Does the merger of universities promote their scientific research performance? Evidence from China," Research Policy, Elsevier, vol. 50(1).
    26. Chambers, Robert G. & Chung, Yangho & Fare, Rolf, 1996. "Benefit and Distance Functions," Journal of Economic Theory, Elsevier, vol. 70(2), pages 407-419, August.
    27. Liu, Wenbin & Zhou, Zhongbao & Ma, Chaoqun & Liu, Debin & Shen, Wanfang, 2015. "Two-stage DEA models with undesirable input-intermediate-outputs," Omega, Elsevier, vol. 56(C), pages 74-87.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dan Wang & Anh Ngoc Quang Huynh & Handong Tang, 2026. "Powering Innovation: How High-Performance Computing Platform Revolutionizes University Research," Evaluation Review, , vol. 50(1), pages 55-88, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tatiana Bencova & Andrea Bohacikova, 2022. "DEA in Performance Measurement of Two-Stage Processes: Comparative Overview of the Literature," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 5, pages 111-129.
    2. Lim, Dong-Joon & Kim, Moon-Su, 2022. "Measuring dynamic efficiency with variable time lag effects," Omega, Elsevier, vol. 108(C).
    3. Mohammad Nemati & Reza Kazemi Matin & Mehdi Toloo, 2020. "A two-stage DEA model with partial impacts between inputs and outputs: application in refinery industries," Annals of Operations Research, Springer, vol. 295(1), pages 285-312, December.
    4. Fukuyama, Hirofumi & Weber, William L., 2010. "A slacks-based inefficiency measure for a two-stage system with bad outputs," Omega, Elsevier, vol. 38(5), pages 398-409, October.
    5. An, Qingxian & Chen, Haoxun & Xiong, Beibei & Wu, Jie & Liang, Liang, 2017. "Target intermediate products setting in a two-stage system with fairness concern," Omega, Elsevier, vol. 73(C), pages 49-59.
    6. Kao, Chiang, 2014. "Network data envelopment analysis: A review," European Journal of Operational Research, Elsevier, vol. 239(1), pages 1-16.
    7. Mohammad Amirkhan & Hosein Didehkhani & Kaveh Khalili-Damghani & Ashkan Hafezalkotob, 2018. "Measuring Performance of a Three-Stage Network Structure Using Data Envelopment Analysis and Nash Bargaining Game: A Supply Chain Application," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(05), pages 1429-1467, September.
    8. Galagedera, Don U.A. & Watson, John & Premachandra, I.M. & Chen, Yao, 2016. "Modeling leakage in two-stage DEA models: An application to US mutual fund families," Omega, Elsevier, vol. 61(C), pages 62-77.
    9. Ang, Sheng & Liu, Pei & Yang, Feng, 2020. "Intra-Organizational and inter-organizational resource allocation in two-stage network systems," Omega, Elsevier, vol. 91(C).
    10. Khoveyni, Mohammad & Fukuyama, Hirofumi & Eslami, Robabeh & Yang, Guo-liang, 2019. "Variations effect of intermediate products on the second stage in two-stage processes," Omega, Elsevier, vol. 85(C), pages 35-48.
    11. Huang, Chin-wei & Ho, Foo Nin & Chiu, Yung-ho, 2014. "Measurement of tourist hotels׳ productive efficiency, occupancy, and catering service effectiveness using a modified two-stage DEA model in Taiwan," Omega, Elsevier, vol. 48(C), pages 49-59.
    12. Chih-Hai Yang & Hsuan-Yu Lin & Chiang-Ping Chen, 2014. "Measuring the efficiency of NBA teams: additive efficiency decomposition in two-stage DEA," Annals of Operations Research, Springer, vol. 217(1), pages 565-589, June.
    13. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    14. Cook, Wade D. & Liang, Liang & Zhu, Joe, 2010. "Measuring performance of two-stage network structures by DEA: A review and future perspective," Omega, Elsevier, vol. 38(6), pages 423-430, December.
    15. Halkos, George & Tzeremes, Nickolaos, 2013. "An additive two-stage DEA approach creating sustainability efficiency indexes," MPRA Paper 44231, University Library of Munich, Germany.
    16. Xie, Qiwei & Xu, Qifan & Chen, Lifan & Jin, Xi & Li, Siqi & Li, Yongjun, 2022. "Efficiency evaluation of China's listed commercial banks based on a multi-period leader-follower model," Omega, Elsevier, vol. 110(C).
    17. Zhu, Qingyuan & Xu, Shuqi & Sun, Jiasen & Li, Xingchen & Zhou, Dequn, 2022. "Energy efficiency evaluation of power supply system: A data-driven approach based on shared resources," Applied Energy, Elsevier, vol. 312(C).
    18. Li, Yongjun & Liu, Jin & Ang, Sheng & Yang, Feng, 2021. "Performance evaluation of two-stage network structures with fixed-sum outputs: An application to the 2018winter Olympic Games," Omega, Elsevier, vol. 102(C).
    19. Li, Wanghong & Li, Zhepeng & Liang, Liang & Cook, Wade D., 2017. "Evaluation of ecological systems and the recycling of undesirable outputs: An efficiency study of regions in China," Socio-Economic Planning Sciences, Elsevier, vol. 60(C), pages 77-86.
    20. Cook, Wade D. & Zhu, Joe & Bi, Gongbing & Yang, Feng, 2010. "Network DEA: Additive efficiency decomposition," European Journal of Operational Research, Elsevier, vol. 207(2), pages 1122-1129, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:49:y:2025:i:4:p:678-707. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.