IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v32y2009i2p178-186.html
   My bibliography  Save this article

Measuring relative efficiency of government-sponsored R&D projects: A three-stage approach

Author

Listed:
  • Hsu, Fang-Ming
  • Hsueh, Chao-Chih

Abstract

Without considering differences in operating environment, traditional methods of efficiency evaluation are suffering from external environmental influences. This study presents an alternative approach for assessing the relative efficiency of government-sponsored research and development projects (GSP). A three-stage approach employing data envelopment analysis to evaluate efficiency and Tobit regression to control external variables was applied to 110 projects over 9 years. This study finds that firm size, industry, and ratio of public subsidy on research and development (R&D) budget of recipient firm significantly influences the technical efficiency of GSP in Taiwan. After controlling these external variables, the mean value of technical efficiency in the third stage increases and becomes significantly different to that in the first stage. Most GSPs increase their returns when their projects are scaled up. Furthermore, government policy makers must establish the upper-limit ratio of subsidies on R&D budgets of recipient firms to avoid inefficient use of public funds.

Suggested Citation

  • Hsu, Fang-Ming & Hsueh, Chao-Chih, 2009. "Measuring relative efficiency of government-sponsored R&D projects: A three-stage approach," Evaluation and Program Planning, Elsevier, vol. 32(2), pages 178-186, May.
    • Handle: RePEc:eee:epplan:v:32:y:2009:i:2:p:178-186
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149-7189(08)00106-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lin, Bou-Wen & Lee, Yikuan & Hung, Shih-Chang, 2006. "R&D intensity and commercialization orientation effects on financial performance," Journal of Business Research, Elsevier, vol. 59(6), pages 679-685, June.
    2. Zoltan J. Acs & David B. Audretsch, 2008. "Innovation in Large and Small Firms: An Empirical Analysis," Chapters, in: Entrepreneurship, Growth and Public Policy, chapter 1, pages 3-15, Edward Elgar Publishing.
    3. Jaffe, Adam B, 1986. "Technological Opportunity and Spillovers of R&D: Evidence from Firms' Patents, Profits, and Market Value," American Economic Review, American Economic Association, vol. 76(5), pages 984-1001, December.
    4. Bizan, Oded, 2003. "The determinants of success of R&D projects: evidence from American-Israeli research alliances," Research Policy, Elsevier, vol. 32(9), pages 1619-1640, October.
    5. Colin Glass, J. & McCallion, Gillian & McKillop, Donal G. & Rasaratnam, Syamarlah & Stringer, Karl S., 2006. "Implications of variant efficiency measures for policy evaluations in UK higher education," Socio-Economic Planning Sciences, Elsevier, vol. 40(2), pages 119-142, June.
    6. Harold Fried & Shelton Schmidt & Suthathip Yaisawarng, 1999. "Incorporating the Operating Environment Into a Nonparametric Measure of Technical Efficiency," Journal of Productivity Analysis, Springer, vol. 12(3), pages 249-267, November.
    7. repec:fth:harver:1473 is not listed on IDEAS
    8. Mohan V. Tatikonda & Mitzi M. Montoya-Weiss, 2001. "Integrating Operations and Marketing Perspectives of Product Innovation: The Influence of Organizational Process Factors and Capabilities on Development Performance," Management Science, INFORMS, vol. 47(1), pages 151-172, January.
    9. Zvi Griliches, 1998. "Patent Statistics as Economic Indicators: A Survey," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 287-343, National Bureau of Economic Research, Inc.
    10. Hagedoorn, John & Cloodt, Myriam, 2003. "Measuring innovative performance: is there an advantage in using multiple indicators?," Research Policy, Elsevier, vol. 32(8), pages 1365-1379, September.
    11. Luukkonen, Terttu, 2000. "Additionality of EU framework programmes1," Research Policy, Elsevier, vol. 29(6), pages 711-724, June.
    12. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    13. Sohn, S.Y. & Gyu Joo, Yong & Kyu Han, Hong, 2007. "Structural equation model for the evaluation of national funding on R&D project of SMEs in consideration with MBNQA criteria," Evaluation and Program Planning, Elsevier, vol. 30(1), pages 10-20, February.
    14. Iraizoz, Belen & Rapun, Manuel & Zabaleta, Idoia, 2003. "Assessing the technical efficiency of horticultural production in Navarra, Spain," Agricultural Systems, Elsevier, vol. 78(3), pages 387-403, December.
    15. Hobday, Michael & Rush, Howard & Bessant, John, 2004. "Approaching the innovation frontier in Korea: the transition phase to leadership," Research Policy, Elsevier, vol. 33(10), pages 1433-1457, December.
    16. Drake, Leigh & Hall, Maximilian J.B. & Simper, Richard, 2006. "The impact of macroeconomic and regulatory factors on bank efficiency: A non-parametric analysis of Hong Kong's banking system," Journal of Banking & Finance, Elsevier, vol. 30(5), pages 1443-1466, May.
    17. Karine Chapelle & Patrick Plane, 2005. "Productive Efficiency In The Ivorian Manufacturing Sector: An Exploratory Study Using A Data Envelopment Analysis Approach," The Developing Economies, Institute of Developing Economies, vol. 43(4), pages 450-471, December.
    18. David J. Teece & Gary Pisano & Amy Shuen, 1997. "Dynamic capabilities and strategic management," Strategic Management Journal, Wiley Blackwell, vol. 18(7), pages 509-533, August.
    19. Robert W. Vossen & Bart Nooteboom, 1996. "Firm Size and Participation in R&D," Palgrave Macmillan Books, in: Alfred Kleinknecht (ed.), Determinants of Innovation, chapter 6, pages 155-168, Palgrave Macmillan.
    20. Corley, Elizabeth A., 2007. "A use-and-transformation model for evaluating public R&D: Illustrations from polycystic ovarian syndrome (PCOS) research," Evaluation and Program Planning, Elsevier, vol. 30(1), pages 21-35, February.
    21. Thong, J. Y. L. & Yap, C. S., 1995. "CEO characteristics, organizational characteristics and information technology adoption in small businesses," Omega, Elsevier, vol. 23(4), pages 429-442, August.
    22. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    23. Jui-Kou Shang & Wei-Ting Hung & Chang-Fang Lo & Fei-Ching Wang, 2008. "Ecommerce and hotel performance: three-stage DEA analysis," The Service Industries Journal, Taylor & Francis Journals, vol. 28(4), pages 529-540, May.
    24. Luukkonen, Terttu, 1998. "The difficulties in assessing the impact of EU framework programmes," Research Policy, Elsevier, vol. 27(6), pages 599-610, September.
    25. Richard C. Levin & Alvin K. Klevorick & Richard R. Nelson & Sidney G. Winter, 1987. "Appropriating the Returns from Industrial Research and Development," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 18(3, Specia), pages 783-832.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xuetong Wang & Wenyong Lai & Xiangnan Song & Chen Lu, 2018. "Implementation Efficiency of Corporate Social Responsibility in the Construction Industry: A China Study," IJERPH, MDPI, vol. 15(9), pages 1-21, September.
    2. Hongwei Liu & Ronglu Yang & Zhixiang Zhou & Dacheng Huang, 2020. "Regional Green Eco-Efficiency in China: Considering Energy Saving, Pollution Treatment, and External Environmental Heterogeneity," Sustainability, MDPI, vol. 12(17), pages 1-19, August.
    3. Jung Ho Park & Kwangsoo Shin, 2018. "Efficiency of Government-Sponsored R&D Projects: A Metafrontier DEA Approach," Sustainability, MDPI, vol. 10(7), pages 1-17, July.
    4. Hung, Chia-Liang, 2017. "Social networks, technology ties, and gatekeeper functionality: Implications for the performance management of R&D projects," Research Policy, Elsevier, vol. 46(1), pages 305-315.
    5. Sungmin Park, 2015. "The R&D logic model: Does it really work? An empirical verification using successive binary logistic regression models," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1399-1439, December.
    6. Feng-Jyh Lin & Yi-Hsin Lin, 2012. "The determinants of successful R&D consortia: government strategy for the servitization of manufacturing," Service Business, Springer;Pan-Pacific Business Association, vol. 6(4), pages 489-502, December.
    7. Mikhail Gershman & Galina Kitova, 2017. "Assessing Government Support for Research and Innovation in Russian Universities," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 8(3), pages 1067-1084, September.
    8. Jianping Liu & Kai Lu & Shixiong Cheng, 2018. "International R&D Spillovers and Innovation Efficiency," Sustainability, MDPI, vol. 10(11), pages 1-23, October.
    9. Chiu, Ching-Ren & Chiu, Yung-Ho & Chen, Yu-Chuan & Fang, Chen-Ling, 2016. "Exploring the source of metafrontier inefficiency for various bank types in the two-stage network system with undesirable output," Pacific-Basin Finance Journal, Elsevier, vol. 36(C), pages 1-13.
    10. Hongbo Li & Bowen Yao & Xin Yan, 2021. "Data-Driven Public R&D Project Performance Evaluation: Results from China," Sustainability, MDPI, vol. 13(13), pages 1-14, June.
    11. Xu, Jia & Wei, Jiuchang & Zhao, Dingtao, 2016. "Influence of social media on operational efficiency of national scenic spots in china based on three-stage DEA model," International Journal of Information Management, Elsevier, vol. 36(3), pages 374-388.
    12. Lee, Seonghee & Lee, Hakyeon, 2015. "Measuring and comparing the R&D performance of government research institutes: A bottom-up data envelopment analysis approach," Journal of Informetrics, Elsevier, vol. 9(4), pages 942-953.
    13. Lee, Hakyeon & Shin, Juneseuk, 2014. "Measuring journal performance for multidisciplinary research: An efficiency perspective," Journal of Informetrics, Elsevier, vol. 8(1), pages 77-88.
    14. Danyu Liu & Ke Zhang, 2022. "Analysis of Spatial Differences and the Influencing Factors in Eco-Efficiency of Urban Agglomerations in China," Sustainability, MDPI, vol. 14(19), pages 1-21, October.
    15. Jaehun Park & Joonyoung Kim & Si-Il Sung, 2017. "Performance Evaluation of Research and Business Development: A Case Study of Korean Public Organizations," Sustainability, MDPI, vol. 9(12), pages 1-16, December.
    16. Junhee Bae & Yanghon Chung & Hyesoo Ko, 2021. "Analysis of efficiency in public research activities in terms of knowledge spillover: focusing on earthquake R&D accomplishments," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 108(2), pages 2249-2264, September.
    17. Claudia Capozza & Angela Stefania Bergantino & Angela De Carlo, 2013. "The Role of Transport Infrastructures in determining Technical Efficiency in R&D activity of Italian regions. A double-bootstrapped DEA procedure," ERSA conference papers ersa13p1052, European Regional Science Association.
    18. Lu, Wen-Min & Kweh, Qian Long & Nourani, Mohammad & Huang, Feng-Wen, 2016. "Evaluating the efficiency of dual-use technology development programs from the R&D and socio-economic perspectives," Omega, Elsevier, vol. 62(C), pages 82-92.
    19. Qiang Cui, 2017. "Environmental efficiency measures for ports: an application of RAM-Tobit-RAM with undesirable outputs," Maritime Policy & Management, Taylor & Francis Journals, vol. 44(5), pages 551-564, July.
    20. Arora, Nitin & Talwar, Shubhendra Jit, 2020. "Modelling efficiency in budget allocations for Indian states using window based non-radial non-concave metafrontier data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    21. Pettas, Nikolaos & Giannikos, Ioannis, 2014. "Evaluating the delivery performance of public spending programs from an efficiency perspective," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 140-150.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wadhwa, Anu & Phelps, Corey & Kotha, Suresh, 2016. "Corporate venture capital portfolios and firm innovation," Journal of Business Venturing, Elsevier, vol. 31(1), pages 95-112.
    2. Mohnen, Pierre, 2019. "R&D, innovation and productivity," MERIT Working Papers 2019-016, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    3. Muliaman Hadad & Maximilian Hall & Karligash Kenjegalieva & Wimboh Santoso & Richard Simper, 2011. "Banking efficiency and stock market performance: an analysis of listed Indonesian banks," Review of Quantitative Finance and Accounting, Springer, vol. 37(1), pages 1-20, July.
    4. Bart Leten & Rene Belderbos & Bart Van Looy, 2016. "Entry and Technological Performance in New Technology Domains: Technological Opportunities, Technology Competition and Technological Relatedness," Journal of Management Studies, Wiley Blackwell, vol. 53(8), pages 1257-1291, December.
    5. Choi, Mincheol & Lee, Chang-Yang, 2021. "Technological diversification and R&D productivity: The moderating effects of knowledge spillovers and core-technology competence," Technovation, Elsevier, vol. 104(C).
    6. Choi, Jin-Uk & Lee, Chang-Yang, 2022. "The differential effects of basic research on firm R&D productivity: The conditioning role of technological diversification," Technovation, Elsevier, vol. 118(C).
    7. Wu, Tai-Hsi & Chen, Ming-Shiun & Yeh, Jin-Yii, 2010. "Measuring the performance of police forces in Taiwan using data envelopment analysis," Evaluation and Program Planning, Elsevier, vol. 33(3), pages 246-254, August.
    8. Franz Hahn, 2007. "Environmental determinants of banking efficiency in Austria," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 34(3), pages 231-245, July.
    9. Stuart, Graham & Higgins, Matthew, 2007. "The Impact of Patenting on New Product Introductions in the Pharmaceutical Industry," MPRA Paper 4574, University Library of Munich, Germany.
    10. Basu, Sandip & Phelps, Corey & Kotha, Suresh, 2011. "Towards understanding who makes corporate venture capital investments and why," Journal of Business Venturing, Elsevier, vol. 26(2), pages 153-171, March.
    11. Jérôme Danguy & Gaetan de Rassenfosse & Bruno van Pottelsberghe de la Potterie, 2014. "On the origins of the worldwide surge in patenting: an industry perspective on the R&D–patent relationship," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 23(2), pages 535-572.
    12. Hall, Maximilian J.B. & Kenjegalieva, Karligash A. & Simper, Richard, 2012. "Environmental factors affecting Hong Kong banking: A post-Asian financial crisis efficiency analysis," Global Finance Journal, Elsevier, vol. 23(3), pages 184-201.
    13. Gino Cattani, 2005. "Preadaptation, Firm Heterogeneity, and Technological Performance: A Study on the Evolution of Fiber Optics, 1970–1995," Organization Science, INFORMS, vol. 16(6), pages 563-580, December.
    14. Franz R. Hahn, 2004. "Measuring Performance. A Multiple-Stage Approach," WIFO Working Papers 228, WIFO.
    15. Koutroumpis, Pantelis & Leiponen, Aija & Thomas, Llewellyn D W, 2017. "The Young, the Old and the Innovative: The Impact of R&D on Firm Performance in ICT versus Other Sectors," ETLA Working Papers 51, The Research Institute of the Finnish Economy.
    16. Mingli Song & Guangshe Jia & Puwei Zhang, 2020. "An Evaluation of Air Transport Sector Operational Efficiency in China based on a Three-Stage DEA Analysis," Sustainability, MDPI, vol. 12(10), pages 1-16, May.
    17. Dushnitsky, Gary & Lenox, Michael J., 2005. "When do incumbents learn from entrepreneurial ventures?: Corporate venture capital and investing firm innovation rates," Research Policy, Elsevier, vol. 34(5), pages 615-639, June.
    18. Wang, Chun-Hsien & Lu, Yung-Hsiang & Huang, Chin-Wei & Lee, Jun-Yen, 2013. "R&D, productivity, and market value: An empirical study from high-technology firms," Omega, Elsevier, vol. 41(1), pages 143-155.
    19. Chiu, Yung-Ho & Chen, Yu-Chuan, 2009. "The analysis of Taiwanese bank efficiency: Incorporating both external environment risk and internal risk," Economic Modelling, Elsevier, vol. 26(2), pages 456-463, March.
    20. Juo, Jia-Ching & Fu, Tsu-Tan & Yu, Ming-Miin, 2012. "Non-oriented slack-based decompositions of profit change with an application to Taiwanese banking," Omega, Elsevier, vol. 40(5), pages 550-561.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:32:y:2009:i:2:p:178-186. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.