IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v102y2024ics014971892300160x.html

Data-driven analysis on the performance evaluation of national R&D projects in Korea

Author

Listed:
  • Cho, Heejung
  • Ahn, Hyeongjin
  • Park, Eunil

Abstract

Research and development (R&D) is a crucial competency in both developing and developed countries. As a result, evaluating the performance of R&D programs has become a significant research topic for academic and governmental researchers. This study aims to investigate the impact of various factors, such as the characteristics of national R&D projects, research stages, technology types, and management institutions, on their performance. Specifically, we focus on identifying key factors that influence the efficiency of national R&D investments in South Korea. To achieve this, we compiled a dataset of 98,224 government-funded R&D projects conducted between 2016 and 2019. The dataset includes information on project characteristics (research stage, technology types, and management institutions) as well as outcomes (patent applications, patent registrations, publications, royalties, and sales). Through factorial Kruskal-Wallis tests, we found that the research stage and technology type significantly affected the project outcomes, while the research stage did not significantly influence royalty and sales amounts. Additionally, our analysis of South Korean research management institutions revealed variations in their overall performance, suggesting differences in management capabilities among institutions. Based on these findings, we provide insights into setting appropriate research goals for each project, considering their unique characteristics. Finally, we discuss the implications and limitations of this study.

Suggested Citation

  • Cho, Heejung & Ahn, Hyeongjin & Park, Eunil, 2024. "Data-driven analysis on the performance evaluation of national R&D projects in Korea," Evaluation and Program Planning, Elsevier, vol. 102(C).
    • Handle: RePEc:eee:epplan:v:102:y:2024:i:c:s014971892300160x
    DOI: 10.1016/j.evalprogplan.2023.102383
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S014971892300160X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2023.102383?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Eunil Park & Sang Jib Kwon & Heetae Kim & Jay Ohm & Hyun Joon Chang, 2014. "What is the Right R&D Strategy for Overcoming the Difficulties of the South Korean IT Industry?," Information Technology for Development, Taylor & Francis Journals, vol. 20(4), pages 339-352, October.
    2. Takalo, Tuomas & Tanayama, Tanja & Toivanen, Otto, 2013. "Market failures and the additionality effects of public support to private R&D: Theory and empirical implications," International Journal of Industrial Organization, Elsevier, vol. 31(5), pages 634-642.
    3. Abiodun Egbetokun & Adedayo Olofinyehun & Maruf Sanni & Aderonke Ayo-Lawal & Omolayo Oluwatope & Utieyineshola Yusuff, 2022. "The production of social science research in Nigeria: status and systemic determinants," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 9(1), pages 1-9, December.
    4. Congressional Budget Office, 2021. "Research and Development in the Pharmaceutical Industry," Reports 57025, Congressional Budget Office.
    5. Takalo, Tuomas & Tanayama, Tanja & Toivanen, Otto, 2013. "Market failures and the additionality effects of public support to private R&D: Theory and empirical implications," International Journal of Industrial Organization, Elsevier, vol. 31(5), pages 634-642.
    6. Lee, Sungho & Jo, Jingyeong, 2018. "Government R&D Support for SMEs: Policy Effects and Improvement Measures," KDI Journal of Economic Policy, Korea Development Institute (KDI), vol. 40(4), pages 47-63.
    7. Gaétan Rassenfosse, 2012. "How SMEs exploit their intellectual property assets: evidence from survey data," Small Business Economics, Springer, vol. 39(2), pages 437-452, September.
    8. Lee, Sungho, 2018. "Government R&D Support for SMEs: Policy Effects and Improvement Measures," KDI Focus 89, Korea Development Institute (KDI).
    9. Jin-Li Hu & Chih-Hai Yang & Chiang-Ping Chen, 2014. "R&D Efficiency And The National Innovation System: An International Comparison Using The Distance Function Approach," Bulletin of Economic Research, Wiley Blackwell, vol. 66(1), pages 55-71, January.
    10. Thomas, V.J. & Sharma, Seema & Jain, Sudhir K., 2011. "Using patents and publications to assess R&D efficiency in the states of the USA," World Patent Information, Elsevier, vol. 33(1), pages 4-10, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hünermund, Paul & Czarnitzki, Dirk, 2019. "Estimating the causal effect of R&D subsidies in a pan-European program," Research Policy, Elsevier, vol. 48(1), pages 115-124.
    2. Onder Belgin, 2024. "Efficiency Analysis of EU and Non-EU R&D Investor Firms on Matched Samples," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(3), pages 13601-13621, September.
    3. Paul Hünermund & Dirk Czarnitzki, 2016. "Estimating the local average treatment effect of R&D subsidies in a pan-European program," Working Papers of Department of Management, Strategy and Innovation, Leuven 541177, KU Leuven, Faculty of Economics and Business (FEB), Department of Management, Strategy and Innovation, Leuven.
    4. Esteban Pelayo Villarejo & Antoni Pastor Juste & Jakub Kruszelnicki, 2019. "Segmentation Techniques For Innovation Support Services," Review of Economic and Business Studies, Alexandru Ioan Cuza University, Faculty of Economics and Business Administration, issue 24, pages 207-237, December.
    5. Cristiano Antonelli, 2020. "Knowledge exhaustibility public support to business R&D and the additionality constraint," The Journal of Technology Transfer, Springer, vol. 45(3), pages 649-663, June.
    6. Montmartin, B. & Herrera, M. & Massard, N., 2015. "R&D policies in France: New evidence from a NUTS3 spatial analysis," Working Papers 2015-11, Grenoble Applied Economics Laboratory (GAEL).
    7. Hottenrott, Hanna & Lopes-Bento, Cindy & Veugelers, Reinhilde, 2017. "Direct and cross scheme effects in a research and development," Research Policy, Elsevier, vol. 46(6), pages 1118-1132.
    8. Ivana Blažková, 2016. "The Impact of the Public Support for R & D on the Economic Performance of SMEs," Acta Universitatis Agriculturae et Silviculturae Mendelianae Brunensis, Mendel University Press, vol. 64(1), pages 213-222.
    9. Bajgar, Matěj & Srholec, Martin, 2025. "Crowding in or crowding out? Evidence from discontinuity in the assignment of business R&D subsidies," Journal of Public Economics, Elsevier, vol. 245(C).
    10. Simona Mateut, 2018. "Subsidies, financial constraints and firm innovative activities in emerging economies," Small Business Economics, Springer, vol. 50(1), pages 131-162, January.
    11. Zhang, Chao & Guan, Jiancheng, 2021. "Returnee policies in China: Does a strategy of alleviating the financing difficulty of returnee firms promote innovation?," Technological Forecasting and Social Change, Elsevier, vol. 164(C).
    12. Sarah Demeulemeester & Hanna Hottenrott, 2015. "R&D subsidies and firms' cost of debt," Working Papers of Department of Management, Strategy and Innovation, Leuven 516028, KU Leuven, Faculty of Economics and Business (FEB), Department of Management, Strategy and Innovation, Leuven.
    13. Huergo, Elena & Trenado, Mayte & Ubierna, Andrés, 2016. "The impact of public support on firm propensity to engage in R&D: Spanish experience," Technological Forecasting and Social Change, Elsevier, vol. 113(PB), pages 206-219.
    14. María Engracia Rochina Barrachina & Jorge Antonio Rodríguez Moreno, 2024. "A possible mechanism for partial crowding‐out of R&D subsidies in developing countries," Review of Development Economics, Wiley Blackwell, vol. 28(1), pages 71-96, February.
    15. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    16. Francesco Decarolis & Gaétan de Rassenfosse & Leonardo M. Giuffrida & Elisabetta Iossa & Vincenzo Mollisi & Emilio Raiteri & Giancarlo Spagnolo, 2021. "Buyers' role in innovation procurement: Evidence from US military R&D contracts," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(4), pages 697-720, November.
    17. Takalo, Tuomas & Tanayama, Tanja & Toivanen, Otto, 2017. "Welfare effects of R&D support policies," Bank of Finland Research Discussion Papers 30/2017, Bank of Finland.
    18. Hünermund, Paul & Czarnitzki, Dirk, 2015. "Estimating the Local Average Treatment Effect of R&D Subsidies in a Virtual Common Pot," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112869, Verein für Socialpolitik / German Economic Association.
    19. Widmann, Rainer, 2024. "The behavioral additionality of government research grants," International Journal of Industrial Organization, Elsevier, vol. 93(C).
    20. Anna D’Ambrosio & Roberto Gabriele & Francesco Schiavone & Manuel Villasalero, 2017. "The role of openness in explaining innovation performance in a regional context," The Journal of Technology Transfer, Springer, vol. 42(2), pages 389-408, April.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:102:y:2024:i:c:s014971892300160x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.