IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v38y2010i6p453-464.html
   My bibliography  Save this article

DEA and ranking with the network-based approach: a case of R&D performance

Author

Listed:
  • Liu, John S.
  • Lu, Wen-Min

Abstract

This study enhances the network-based approach, which is a novel method to increase discrimination in data envelopment analysis. The enhancements include removing the bias caused by a scale difference among organizations and highlighting the approach's ability to identify the strengths and weaknesses of each organization. The former makes the approach applicable to both the constant returns of scale (CRS) and the variable returns of scale (VRS) models. The network-based approach applies the centrality concept developed in social network analysis to discriminate efficient decision making organizations as determined by standard data envelopment analysis (DEA). More specifically, the results of data envelopment analysis are transformed into a directed and weighted network in which each node represents a decision making organization and the link between a pair of node represents the referencing relationship between the pair. The centrality value for each efficient organization provides the base for discrimination and ranking. This network-based approach suggests aggregating DEA results of different input/output combinations such that the merits of each organization under various situations can be considered. The final ranking of this approach favors organizations that have their strengths evenly spread and tends to screen out specialized efficient organizations. As a real world example, the approach is applied to evaluate and rank the R&D (research and development) performance of Taiwan's government-supported research institutes. The cross-organizations and within-organization strengths for each efficient research institute are identified after applying the approach. A two-stage R&D evaluation model separates the R&D process into the technology development and technology diffusion stage. The resulting performance map differentiates the research institutes into four categories--Achievers, Marketers, Innovators, and Underdogs.

Suggested Citation

  • Liu, John S. & Lu, Wen-Min, 2010. "DEA and ranking with the network-based approach: a case of R&D performance," Omega, Elsevier, vol. 38(6), pages 453-464, December.
  • Handle: RePEc:eee:jomega:v:38:y:2010:i:6:p:453-464
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305-0483(09)00100-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Eric C. & Huang, Weichiao, 2007. "Relative efficiency of R&D activities: A cross-country study accounting for environmental factors in the DEA approach," Research Policy, Elsevier, vol. 36(2), pages 260-273, March.
    2. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    3. Rolf Färe & Shawna Grosskopf & Gerald Whittaker, 2014. "Network DEA II," International Series in Operations Research & Management Science, in: Wade D. Cook & Joe Zhu (ed.), Data Envelopment Analysis, edition 127, chapter 0, pages 307-327, Springer.
    4. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    5. Ramanathan, Ramakrishnan & Yunfeng, Jiang, 2009. "Incorporating cost and environmental factors in quality function deployment using data envelopment analysis," Omega, Elsevier, vol. 37(3), pages 711-723, June.
    6. C Serrano Cinca & C Mar Molinero, 2004. "Selecting DEA specifications and ranking units via PCA," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(5), pages 521-528, May.
    7. Lidia Angulo-Meza & Marcos Lins, 2002. "Review of Methods for Increasing Discrimination in Data Envelopment Analysis," Annals of Operations Research, Springer, vol. 116(1), pages 225-242, October.
    8. Tone, Kaoru & Tsutsui, Miki, 2009. "Network DEA: A slacks-based measure approach," European Journal of Operational Research, Elsevier, vol. 197(1), pages 243-252, August.
    9. Du, Juan & Liang, Liang & Chen, Yao & Bi, Gong-bing, 2010. "DEA-based production planning," Omega, Elsevier, vol. 38(1-2), pages 105-112, February.
    10. Necmi K. Avkiran, 2006. "Modelling knowledge production performance of research centres with a focus on triple bottom line benchmarking," International Journal of Business Performance Management, Inderscience Enterprises Ltd, vol. 8(4), pages 307-327.
    11. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    12. Thursby, Jerry G. & Kemp, Sukanya, 2002. "Growth and productive efficiency of university intellectual property licensing," Research Policy, Elsevier, vol. 31(1), pages 109-124, January.
    13. Tone, Kaoru & Tsutsui, Miki, 2010. "Dynamic DEA: A slacks-based measure approach," Omega, Elsevier, vol. 38(3-4), pages 145-156, June.
    14. Wei Meng & Zhenhua Hu & Wenbin Liu, 2006. "Efficiency evaluation of basic research in China," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 85-101, October.
    15. Tofallis, C., 1996. "Improving discernment in DEA using profiling," Omega, Elsevier, vol. 24(3), pages 361-364, June.
    16. Cordero, Rene, 1990. "The measurement of innovation performance in the firm: An overview," Research Policy, Elsevier, vol. 19(2), pages 185-192, April.
    17. Seema Sharma & V. J. Thomas, 2008. "Inter-country R&D efficiency analysis: An application of data envelopment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 483-501, September.
    18. Avkiran, Necmi K., 2009. "Opening the black box of efficiency analysis: An illustration with UAE banks," Omega, Elsevier, vol. 37(4), pages 930-941, August.
    19. Zhu, Joe, 2000. "Multi-factor performance measure model with an application to Fortune 500 companies," European Journal of Operational Research, Elsevier, vol. 123(1), pages 105-124, May.
    20. Demirbag, Mehmet & Tatoglu, Ekrem & Glaister, Keith W. & Zaim, Selim, 2010. "Measuring strategic decision making efficiency in different country contexts: A comparison of British and Turkish firms," Omega, Elsevier, vol. 38(1-2), pages 95-104, February.
    21. Joe Zhu, 2009. "Quantitative Models for Performance Evaluation and Benchmarking," International Series in Operations Research and Management Science, Springer, number 978-0-387-85982-8, December.
    22. Eilat, Harel & Golany, Boaz & Shtub, Avraham, 2008. "R&D project evaluation: An integrated DEA and balanced scorecard approach," Omega, Elsevier, vol. 36(5), pages 895-912, October.
    23. Groot, Tom & Garcia-Valderrama, Teresa, 2006. "Research quality and efficiency: An analysis of assessments and management issues in Dutch economics and business research programs," Research Policy, Elsevier, vol. 35(9), pages 1362-1376, November.
    24. Edirisinghe, N.C.P. & Zhang, X., 2007. "Generalized DEA model of fundamental analysis and its application to portfolio optimization," Journal of Banking & Finance, Elsevier, vol. 31(11), pages 3311-3335, November.
    25. J S Liu & W-M Lu & C Yang & M Chuang, 2009. "A network-based approach for increasing discrimination in data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(11), pages 1502-1510, November.
    26. Adler, Nicole & Friedman, Lea & Sinuany-Stern, Zilla, 2002. "Review of ranking methods in the data envelopment analysis context," European Journal of Operational Research, Elsevier, vol. 140(2), pages 249-265, July.
    27. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    28. William W. Cooper & Lawrence M. Seiford & Kaoru Tone, 2007. "Data Envelopment Analysis," Springer Books, Springer, edition 0, number 978-0-387-45283-8, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Seonghee & Lee, Hakyeon, 2015. "Measuring and comparing the R&D performance of government research institutes: A bottom-up data envelopment analysis approach," Journal of Informetrics, Elsevier, vol. 9(4), pages 942-953.
    2. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min, 2016. "Research fronts in data envelopment analysis," Omega, Elsevier, vol. 58(C), pages 33-45.
    3. Liu, John S. & Lu, Louis Y.Y. & Lu, Wen-Min & Lin, Bruce J.Y., 2013. "Data envelopment analysis 1978–2010: A citation-based literature survey," Omega, Elsevier, vol. 41(1), pages 3-15.
    4. Kao, Chiang, 2014. "Network data envelopment analysis: A review," European Journal of Operational Research, Elsevier, vol. 239(1), pages 1-16.
    5. Lee, Hakyeon & Shin, Juneseuk, 2014. "Measuring journal performance for multidisciplinary research: An efficiency perspective," Journal of Informetrics, Elsevier, vol. 8(1), pages 77-88.
    6. Simon de Blas, Clara & Simon Martin, Jose & Gomez Gonzalez, Daniel, 2018. "Combined social networks and data envelopment analysis for ranking," European Journal of Operational Research, Elsevier, vol. 266(3), pages 990-999.
    7. Khoshnevis, Pegah & Teirlinck, Peter, 2018. "Performance evaluation of R&D active firms," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 16-28.
    8. J S Liu & W-M Lu & C Yang & M Chuang, 2009. "A network-based approach for increasing discrimination in data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(11), pages 1502-1510, November.
    9. Ibrahim Alnafrah, 2021. "Efficiency evaluation of BRICS’s national innovation systems based on bias-corrected network data envelopment analysis," Journal of Innovation and Entrepreneurship, Springer, vol. 10(1), pages 1-28, December.
    10. Tatiana Bencova & Andrea Bohacikova, 2022. "DEA in Performance Measurement of Two-Stage Processes: Comparative Overview of the Literature," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 5, pages 111-129.
    11. Victor John M. Cantor & Kim Leng Poh, 2020. "Efficiency measurement for general network systems: a slacks-based measure model," Journal of Productivity Analysis, Springer, vol. 54(1), pages 43-57, August.
    12. Alves, André Bernardo & Wanke, Peter & Antunes, Jorge & Chen, Zhongfei, 2020. "Endogenous network efficiency, macroeconomy, and competition: Evidence from the Portuguese banking industry," The North American Journal of Economics and Finance, Elsevier, vol. 52(C).
    13. Tavakoli, Ibrahim M. & Mostafaee, Amin, 2019. "Free disposal hull efficiency scores of units with network structures," European Journal of Operational Research, Elsevier, vol. 277(3), pages 1027-1036.
    14. Lin, Tzu-Yu & Chiu, Sheng-Hsiung, 2013. "Using independent component analysis and network DEA to improve bank performance evaluation," Economic Modelling, Elsevier, vol. 32(C), pages 608-616.
    15. Kang, Hee Jay & Kim, Changhee & Choi, Kanghwa, 2024. "Combining bootstrap data envelopment analysis with social networks for rank discrimination and suitable potential benchmarks," European Journal of Operational Research, Elsevier, vol. 312(1), pages 283-297.
    16. Akther, Syed & Fukuyama, Hirofumi & Weber, William L., 2013. "Estimating two-stage network Slacks-based inefficiency: An application to Bangladesh banking," Omega, Elsevier, vol. 41(1), pages 88-96.
    17. Edelstein, Barak & Paradi, Joseph C., 2013. "Ensuring units invariant slack selection in radial data envelopment analysis models, and incorporating slacks into an overall efficiency score," Omega, Elsevier, vol. 41(1), pages 31-40.
    18. Lampe, Hannes W. & Hilgers, Dennis, 2015. "Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA," European Journal of Operational Research, Elsevier, vol. 240(1), pages 1-21.
    19. Yongqi Feng & Haolin Zhang & Yung-ho Chiu & Tzu-Han Chang, 2021. "Innovation efficiency and the impact of the institutional quality: a cross-country analysis using the two-stage meta-frontier dynamic network DEA model," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3091-3129, April.
    20. Zhicheng Lai & Lei Li & Zhuomin Tao & Tao Li & Xiaoting Shi & Jialing Li & Xin Li, 2023. "Spatio-Temporal Evolution and Influencing Factors of Ecological Well-Being Performance from the Perspective of Strong Sustainability: A Case Study of the Three Gorges Reservoir Area, China," IJERPH, MDPI, vol. 20(3), pages 1-25, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:38:y:2010:i:6:p:453-464. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.