IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v53y2016icp1252-1258.html
   My bibliography  Save this article

Influencing factors on hydrogen energy R&D projects: An ex-post performance evaluation

Author

Listed:
  • Chun, Dongphil
  • Hong, Sungjun
  • Chung, Yanghon
  • Woo, Chungwon
  • Seo, Hangyeol

Abstract

To enhance its energy security, Korea made a significant R&D investment in developing hydrogen energy technology over a period of 10 years. The Hydrogen Energy R&D Center was established in 2003 with a 100 billion Korean won (KRW) government investment that would fund the initiative through 2012. This paper is a meaningful attempt to evaluate the ex-post performance of completed hydrogen energy R&D projects using data envelopment analysis (DEA). Through empirical analysis, we focus mainly on measuring ex-post performance and uncovering the influencing factors on that performance. The results of our empirical analysis reveal several interesting findings. First, overall, the ex-post performance of completed projects is relatively low. However, there are major performance gaps among projects. Second, R&D type, technology type, and private sector investment are factors influencing project performance. More specifically, projects identified as basic research, storage technology, or without private sector investment had the highest performance, with an acceptable level of statistical significance. Third, DEA can provide unique information, such as results of returns to scale and slack analysis, which cannot be gleaned from parametric methods. As time went on, the decreasing returns to scale (DRS) ratio increased, and the increasing returns to scale (IRS) ratio decreased. This means that the R&D budget was used less and less effectively as time passed. Moreover, among the three-year project period, the second year’s R&D budget was used most efficiently in each R&D project. This study can provide meaningful information to policy makers to enhance the performance of future R&D projects and to promote hydrogen R&D projects as well as advance the hydrogen economy.

Suggested Citation

  • Chun, Dongphil & Hong, Sungjun & Chung, Yanghon & Woo, Chungwon & Seo, Hangyeol, 2016. "Influencing factors on hydrogen energy R&D projects: An ex-post performance evaluation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 53(C), pages 1252-1258.
    • Handle: RePEc:eee:rensus:v:53:y:2016:i:c:p:1252-1258
    DOI: 10.1016/j.rser.2015.09.074
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032115010448
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2015.09.074?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fare, Rolf & Grosskopf, Shawna, 1996. "Productivity and intermediate products: A frontier approach," Economics Letters, Elsevier, vol. 50(1), pages 65-70, January.
    2. Norman Baker & James Freeland, 1975. "Recent Advances in R&D Benefit Measurement and Project Selection Methods," Management Science, INFORMS, vol. 21(10), pages 1164-1175, June.
    3. Barry G. Silverman, 1981. "Project Appraisal Methodology: A Multidimensional R&D Benefit/Cost Assessment Tool," Management Science, INFORMS, vol. 27(7), pages 802-821, July.
    4. Lee, Duu-Hwa & Hsu, Shih-Shun & Tso, Chun-To & Su, Ay & Lee, Duu-Jong, 2009. "An economy-wide analysis of hydrogen economy in Taiwan," Renewable Energy, Elsevier, vol. 34(8), pages 1947-1954.
    5. Lee, Seong Kon & Mogi, Gento & Kim, Jong Wook, 2009. "Energy technology roadmap for the next 10 years: The case of Korea," Energy Policy, Elsevier, vol. 37(2), pages 588-596, February.
    6. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    7. Dongphil Chun & Yanghon Chung & Chungwon Woo & Hangyeol Seo & Hyesoo Ko, 2015. "Labor Union Effects on Innovation and Commercialization Productivity: An Integrated Propensity Score Matching and Two-Stage Data Envelopment Analysis," Sustainability, MDPI, vol. 7(5), pages 1-19, April.
    8. Solomon, Barry D. & Banerjee, Abhijit, 2006. "Erratum to "A global survey of hydrogen energy research, development and policy": [Energy Policy 34 (2006) 781-792]," Energy Policy, Elsevier, vol. 34(11), pages 1318-1208, July.
    9. Lee, Hakyeon & Park, Yongtae & Choi, Hoogon, 2009. "Comparative evaluation of performance of national R&D programs with heterogeneous objectives: A DEA approach," European Journal of Operational Research, Elsevier, vol. 196(3), pages 847-855, August.
    10. Wang, Eric C. & Huang, Weichiao, 2007. "Relative efficiency of R&D activities: A cross-country study accounting for environmental factors in the DEA approach," Research Policy, Elsevier, vol. 36(2), pages 260-273, March.
    11. Hashimoto, Akihiro & Haneda, Shoko, 2008. "Measuring the change in R&D efficiency of the Japanese pharmaceutical industry," Research Policy, Elsevier, vol. 37(10), pages 1829-1836, December.
    12. Cook, Wade D. & Zhu, Joe, 2006. "Rank order data in DEA: A general framework," European Journal of Operational Research, Elsevier, vol. 174(2), pages 1021-1038, October.
    13. Wang, Eric C., 2007. "R&D efficiency and economic performance: A cross-country analysis using the stochastic frontier approach," Journal of Policy Modeling, Elsevier, vol. 29(2), pages 345-360.
    14. Lee, Seong Kon & Mogi, Gento & Kim, Jong Wook, 2008. "The competitiveness of Korea as a developer of hydrogen energy technology: The AHP approach," Energy Policy, Elsevier, vol. 36(4), pages 1284-1291, April.
    15. Chungwon Woo & Yanghon Chung & Dongphil Chun & Seunghun Han & Dukhee Lee, 2014. "Impact of Green Innovation on Labor Productivity and its Determinants: an Analysis of the Korean Manufacturing Industry," Business Strategy and the Environment, Wiley Blackwell, vol. 23(8), pages 567-576, December.
    16. J Zhu, 2000. "Setting scale efficient targets in DEA via returns to scale estimation method," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 51(3), pages 376-378, March.
    17. Halkos, George E. & Tzeremes, Nickolaos G., 2012. "Analyzing the Greek renewable energy sector: A Data Envelopment Analysis approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(5), pages 2884-2893.
    18. Eilat, Harel & Golany, Boaz & Shtub, Avraham, 2008. "R&D project evaluation: An integrated DEA and balanced scorecard approach," Omega, Elsevier, vol. 36(5), pages 895-912, October.
    19. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    20. Tseng, Phillip & Lee, John & Friley, Paul, 2005. "A hydrogen economy: opportunities and challenges," Energy, Elsevier, vol. 30(14), pages 2703-2720.
    21. Solomon, Barry D. & Banerjee, Abhijit, 2006. "A global survey of hydrogen energy research, development and policy," Energy Policy, Elsevier, vol. 34(7), pages 781-792, May.
    22. Lauro, George L. & Vepsalainen, Ari P. J., 1986. "Assessing technology portfolios for contract competition: An analytic hierarchy process approach," Socio-Economic Planning Sciences, Elsevier, vol. 20(6), pages 407-415.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sueyoshi, Toshiyuki & Yuan, Yan & Goto, Mika, 2017. "A literature study for DEA applied to energy and environment," Energy Economics, Elsevier, vol. 62(C), pages 104-124.
    2. Kun Chen & Xian-tong Ren & Guo-liang Yang & Hai-bo Qin, 2022. "The other side of the coin: The declining of Chinese social science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 127-143, January.
    3. Roberto Fazioli & Francesca Pantaleone, 2021. "Macroeconomic Factors Influencing Public Policy Strategies for Blue and Green Hydrogen," Energies, MDPI, vol. 14(23), pages 1-18, November.
    4. Junhee Bae & Yanghon Chung & Hyesoo Ko, 2021. "Analysis of efficiency in public research activities in terms of knowledge spillover: focusing on earthquake R&D accomplishments," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 108(2), pages 2249-2264, September.
    5. Muhammad Asyraf Azni & Rasyikah Md Khalid, 2021. "Hydrogen Fuel Cell Legal Framework in the United States, Germany, and South Korea—A Model for a Regulation in Malaysia," Sustainability, MDPI, vol. 13(4), pages 1-14, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Hui-hui & Yang, Guo-liang & Liu, Xiao-xiao & Song, Yao-yao, 2020. "R&D performance assessment of industrial enterprises in China: A two-stage DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 71(C).
    2. Kun Chen & Xian-tong Ren & Guo-liang Yang & Hai-bo Qin, 2022. "The other side of the coin: The declining of Chinese social science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 127-143, January.
    3. Yongqi Feng & Haolin Zhang & Yung-ho Chiu & Tzu-Han Chang, 2021. "Innovation efficiency and the impact of the institutional quality: a cross-country analysis using the two-stage meta-frontier dynamic network DEA model," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3091-3129, April.
    4. Eilat, Harel & Golany, Boaz & Shtub, Avraham, 2008. "R&D project evaluation: An integrated DEA and balanced scorecard approach," Omega, Elsevier, vol. 36(5), pages 895-912, October.
    5. Junhee Bae & Yanghon Chung & Hyesoo Ko, 2021. "Analysis of efficiency in public research activities in terms of knowledge spillover: focusing on earthquake R&D accomplishments," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 108(2), pages 2249-2264, September.
    6. Hung, Chia-Liang, 2017. "Social networks, technology ties, and gatekeeper functionality: Implications for the performance management of R&D projects," Research Policy, Elsevier, vol. 46(1), pages 305-315.
    7. Jung Ho Park & Kwangsoo Shin, 2018. "Efficiency of Government-Sponsored R&D Projects: A Metafrontier DEA Approach," Sustainability, MDPI, vol. 10(7), pages 1-17, July.
    8. Wang, Qunwei & Hang, Ye & Sun, Licheng & Zhao, Zengyao, 2016. "Two-stage innovation efficiency of new energy enterprises in China: A non-radial DEA approach," Technological Forecasting and Social Change, Elsevier, vol. 112(C), pages 254-261.
    9. Dongphil Chun & Yanghon Chung & Chungwon Woo & Hangyeol Seo & Hyesoo Ko, 2015. "Labor Union Effects on Innovation and Commercialization Productivity: An Integrated Propensity Score Matching and Two-Stage Data Envelopment Analysis," Sustainability, MDPI, vol. 7(5), pages 1-19, April.
    10. Duk Hee Lee & Il Won Seo & Ho Chull Choe & Hee Dae Kim, 2012. "Collaboration network patterns and research performance: the case of Korean public research institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 925-942, June.
    11. Liu, John S. & Lu, Wen-Min, 2010. "DEA and ranking with the network-based approach: a case of R&D performance," Omega, Elsevier, vol. 38(6), pages 453-464, December.
    12. Xiangyu Guo & Canhui Deng & Dan Wang & Xu Du & Jiali Li & Bowen Wan, 2021. "International Comparison of the Efficiency of Agricultural Science, Technology, and Innovation: A Case Study of G20 Countries," Sustainability, MDPI, vol. 13(5), pages 1-16, March.
    13. Jianping Liu & Kai Lu & Shixiong Cheng, 2018. "International R&D Spillovers and Innovation Efficiency," Sustainability, MDPI, vol. 10(11), pages 1-23, October.
    14. Suchul Lee & Jong-yi Hong, 2019. "Analyzing the change in knowledge sharing efficiency of knowledge networks: a case study," Information Technology and Management, Springer, vol. 20(1), pages 41-53, March.
    15. Jiancheng Guan & Kaihua Chen, 2010. "Modeling macro-R&D production frontier performance: an application to Chinese province-level R&D," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(1), pages 165-173, January.
    16. Halkos, George & Tzeremes, Nickolaos, 2011. "The effect of national culture on countries’ innovation efficiency," MPRA Paper 30100, University Library of Munich, Germany.
    17. Vladimír Holý & Karel Šafr, 2018. "Are economically advanced countries more efficient in basic and applied research?," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 26(4), pages 933-950, December.
    18. Lee, Seonghee & Lee, Hakyeon, 2015. "Measuring and comparing the R&D performance of government research institutes: A bottom-up data envelopment analysis approach," Journal of Informetrics, Elsevier, vol. 9(4), pages 942-953.
    19. Vassilis Kanellopoulos & Kostas Tsekouras, 2023. "Innovation efficiency and firm performance in a benchmarking context," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 44(1), pages 137-151, January.
    20. Shiping Mao & Marios Dominikos Kremantzis & Leonidas Sotirios Kyrgiakos & George Vlontzos, 2022. "R&D Performance Evaluation in the Chinese Food Manufacturing Industry Based on Dynamic DEA in the COVID-19 Era," Agriculture, MDPI, vol. 12(11), pages 1-19, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:53:y:2016:i:c:p:1252-1258. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.