IDEAS home Printed from https://ideas.repec.org/a/spr/jknowl/v16y2025i1d10.1007_s13132-024-01947-4.html
   My bibliography  Save this article

Efficiency of Innovation Policy with Different Types of R&D Planning: Evidence from South Korea’s Information and Communication Technology Sector

Author

Listed:
  • Jeongwon Lee

    (ICT R&D Planning Division, Institute of Information & Communication Technology Planning & Evaluation)

  • Kiyoon Shin

    (Science and Technology Policy Institute)

  • Hongbum Kim

    (Gachon University)

  • Junseok Hwang

    (Seoul National University)

Abstract

Two major approaches in national research and development (R&D) planning, top-down and bottom-up, have been compared in academic research, and their differences and respective advantages have been ascertained. However, studies on which planning method is best for improving R&D efficiency are insufficient. South Korea, a country that spends a high portion of its budget on R&D, has changed the direction of its R&D planning from top-down to bottom-up to improve R&D efficiency. However, few studies have analyzed the impact of this change on R&D efficiency in an empirical way. This study analyzed the efficiency of the R&D planning method, which has yet to be evaluated ex post facto, using a two-stage data envelopment analysis with a focus on the South Korea’s information and communication technology sector. The results showed that government-led planning projects in the research stage, which requires systematic planning due to high uncertainty, can be more efficient than in the development stage, where uncertainty is low. This implies that systematic planning support for research subjects is required to effectively promote the bottom-up R&D method, while the prerequisites of the bottom-up approach must be ensured for it to have its advantages over the top-down approach.

Suggested Citation

  • Jeongwon Lee & Kiyoon Shin & Hongbum Kim & Junseok Hwang, 2025. "Efficiency of Innovation Policy with Different Types of R&D Planning: Evidence from South Korea’s Information and Communication Technology Sector," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 16(1), pages 630-662, March.
  • Handle: RePEc:spr:jknowl:v:16:y:2025:i:1:d:10.1007_s13132-024-01947-4
    DOI: 10.1007/s13132-024-01947-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13132-024-01947-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s13132-024-01947-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. William W. Cooper & Lawrence M. Seiford & Joe Zhu (ed.), 2011. "Handbook on Data Envelopment Analysis," International Series in Operations Research and Management Science, Springer, number 978-1-4419-6151-8, December.
    2. Bronwyn Hall & Alessandro Maffioli, 2008. "Evaluating the impact of technology development funds in emerging economies: evidence from Latin America," The European Journal of Development Research, Taylor and Francis Journals, vol. 20(2), pages 172-198.
    3. Mariana Mazzucato, 2018. "Mission-oriented innovation policies: challenges and opportunities," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(5), pages 803-815.
    4. Lee, Keun & Lim, Chaisung, 2001. "Technological regimes, catching-up and leapfrogging: findings from the Korean industries," Research Policy, Elsevier, vol. 30(3), pages 459-483, March.
    5. Dvir, Dov & Lechler, Thomas, 2004. "Plans are nothing, changing plans is everything: the impact of changes on project success," Research Policy, Elsevier, vol. 33(1), pages 1-15, January.
    6. Guan, Jiancheng & Chen, Kaihua, 2012. "Modeling the relative efficiency of national innovation systems," Research Policy, Elsevier, vol. 41(1), pages 102-115.
    7. Jin-Li Hu & Chih-Hai Yang & Chiang-Ping Chen, 2014. "R&D Efficiency And The National Innovation System: An International Comparison Using The Distance Function Approach," Bulletin of Economic Research, Wiley Blackwell, vol. 66(1), pages 55-71, January.
    8. Li, Dongkun & Chen, Yufeng & Miao, Jiafeng, 2022. "Does ICT create a new driving force for manufacturing?—Evidence from Chinese manufacturing firms," Telecommunications Policy, Elsevier, vol. 46(1).
    9. Pankaj Dutta & Aayush Jain & Asish Gupta, 2020. "Performance analysis of non-banking finance companies using two-stage data envelopment analysis," Annals of Operations Research, Springer, vol. 295(1), pages 91-116, December.
    10. Mark C. Anderson & Rajiv D. Banker & Sury Ravindran, 2000. "Executive Compensation in the Information Technology Industry," Management Science, INFORMS, vol. 46(4), pages 530-547, April.
    11. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    12. Alfonso Gambardella & Claudio Panico & Giovanni Valentini, 2015. "Strategic incentives to human capital," Strategic Management Journal, Wiley Blackwell, vol. 36(1), pages 37-52, January.
    13. Chia-Liang Hung & Pei-Jen Shiu, 2014. "Evaluating project performance by removing external effects: Implications to the efficiency of research and development resource allocation," Research Evaluation, Oxford University Press, vol. 23(4), pages 366-380.
    14. Chishti, Muhammad Zubair & Sinha, Avik, 2022. "Do the shocks in technological and financial innovation influence the environmental quality? Evidence from BRICS economies," Technology in Society, Elsevier, vol. 68(C).
    15. Marino, Marianna & Lhuillery, Stephane & Parrotta, Pierpaolo & Sala, Davide, 2016. "Additionality or crowding-out? An overall evaluation of public R&D subsidy on private R&D expenditure," Research Policy, Elsevier, vol. 45(9), pages 1715-1730.
    16. Canarella, Giorgio & Miller, Stephen M., 2018. "The determinants of growth in the U.S. information and communication technology (ICT) industry: A firm-level analysis," Economic Modelling, Elsevier, vol. 70(C), pages 259-271.
    17. Liu, John S. & Lu, Wen-Min, 2010. "DEA and ranking with the network-based approach: a case of R&D performance," Omega, Elsevier, vol. 38(6), pages 453-464, December.
    18. Seung Chul Baek & Duk Hee Lee, 2022. "Role of professional autonomy and project commitment in the Korean government–funded R&D projects [R&D Work Climate and Innovation in Semiconductors]," Science and Public Policy, Oxford University Press, vol. 49(1), pages 1-17.
    19. Kiyoon Shin & Yeongjun Yeo & Jeong-Dong Lee, 2020. "Revitalizing the Concept of Public Procurement for Innovation (PPI) from a Systemic Perspective: Objectives, Policy Types, and Impact Mechanisms," Systemic Practice and Action Research, Springer, vol. 33(2), pages 187-211, April.
    20. Charles I. Jones & John C. Williams, 1998. "Measuring the Social Return to R&D," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 113(4), pages 1119-1135.
    21. Scherer, F. M., 1983. "The propensity to patent," International Journal of Industrial Organization, Elsevier, vol. 1(1), pages 107-128, March.
    22. Lee, Jeongwon & Hwang, Junseok & Kim, Hana, 2022. "Different government support effects on emerging and mature ICT sectors," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    23. Enrico Vanino & Stephen Roper & Bettina Becker, 2020. "Knowledge to Money: Assessing the Business Performance Effects of Publicly Funded R&D Grants," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 17(04), pages 20-24, January.
    24. Natalia Petelski & Darío Milesi & Vladimiro Verre, 2020. "Public support to innovation: impact on technological efforts in Argentine manufacturing firms," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 29(1), pages 66-88, January.
    25. Hoff, Ayoe, 2007. "Second stage DEA: Comparison of approaches for modelling the DEA score," European Journal of Operational Research, Elsevier, vol. 181(1), pages 425-435, August.
    26. Jeongwon Lee & Junseok Hwang & Hana Kim, 2022. "Does diversity make collaborative subsidies effective? ICT sector in Korea," Industry and Innovation, Taylor & Francis Journals, vol. 29(1), pages 1-24, January.
    27. Girma, Sourafel & Gorg, Holger & Strobl, Eric, 2007. "The effect of government grants on plant level productivity," Economics Letters, Elsevier, vol. 94(3), pages 439-444, March.
    28. Lee, Hakyeon & Park, Yongtae & Choi, Hoogon, 2009. "Comparative evaluation of performance of national R&D programs with heterogeneous objectives: A DEA approach," European Journal of Operational Research, Elsevier, vol. 196(3), pages 847-855, August.
    29. Christopher Palmberg, 2004. "The sources of innovations - looking beyond technological opportunities," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 13(2), pages 183-197.
    30. Girma, Sourafel & Gorg, Holger & Strobl, Eric, 2007. "The effects of government grants on plant survival: A micro-econometric analysis," International Journal of Industrial Organization, Elsevier, vol. 25(4), pages 701-720, August.
    31. E Revilla & J Sarkis & A Modrego, 2003. "Evaluating performance of public–private research collaborations: A DEA analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(2), pages 165-174, February.
    32. Andrea Bassanini & Ekkehard Ernst, 2002. "Labour market regulation, industrial relations and technological regimes: a tale of comparative advantage," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 11(3), pages 391-426, June.
    33. Chishti, Muhammad Zubair & Patel, Ritesh, 2023. "Breaking the climate deadlock: Leveraging the effects of natural resources on climate technologies to achieve COP26 targets," Resources Policy, Elsevier, vol. 82(C).
    34. Bronwyn Hall & Alessandro Maffioli, 2008. "Evaluating the impact of technology development funds in emerging economies: evidence from Latin America," The European Journal of Development Research, Taylor and Francis Journals, vol. 20(2), pages 172-198.
    35. Raffaele Oriani & Maurizio Sobrero, 2008. "Uncertainty and the market valuation of R&D within a real options logic," Strategic Management Journal, Wiley Blackwell, vol. 29(4), pages 343-361, April.
    36. Fromhold-Eisebith, Martina & Eisebith, Gunter, 2005. "How to institutionalize innovative clusters? Comparing explicit top-down and implicit bottom-up approaches," Research Policy, Elsevier, vol. 34(8), pages 1250-1268, October.
    37. Pavitt, Keith, 1984. "Sectoral patterns of technical change: Towards a taxonomy and a theory," Research Policy, Elsevier, vol. 13(6), pages 343-373, December.
    38. Goldfarb, Brent & Henrekson, Magnus, 2003. "Bottom-up versus top-down policies towards the commercialization of university intellectual property," Research Policy, Elsevier, vol. 32(4), pages 639-658, April.
    39. Ahmer Bilal & Xiaoping Li & Nanli Zhu & Ridhima Sharma & Atif Jahanger, 2021. "Green Technology Innovation, Globalization, and CO 2 Emissions: Recent Insights from the OBOR Economies," Sustainability, MDPI, vol. 14(1), pages 1-17, December.
    40. Heinze, Thomas & Shapira, Philip & Rogers, Juan D. & Senker, Jacqueline M., 2009. "Organizational and institutional influences on creativity in scientific research," Research Policy, Elsevier, vol. 38(4), pages 610-623, May.
    41. Min, Sujin & Kim, Juseong & Sawng, Yeong-Wha, 2020. "The effect of innovation network size and public R&D investment on regional innovation efficiency," Technological Forecasting and Social Change, Elsevier, vol. 155(C).
    42. McLaughlin, John A. & Jordan, Gretchen B., 1999. "Logic models: a tool for telling your programs performance story," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 65-72.
    43. Lee, Hakyeon & Shin, Juneseuk, 2014. "Measuring journal performance for multidisciplinary research: An efficiency perspective," Journal of Informetrics, Elsevier, vol. 8(1), pages 77-88.
    44. Charles Edquist, 2001. "Innovation Policy in the Systems of Innovation Approach: Some Basic Principles," Advances in Spatial Science, in: Manfred M. Fischer & Josef Fröhlich (ed.), Knowledge, Complexity and Innovation Systems, chapter 3, pages 46-57, Springer.
    45. Kiyoon Shin & Yeongjun Yeo & Jeong-Dong Lee, 2020. "Correction to: Revitalizing the Concept of Public Procurement for Innovation (PPI) from a Systemic Perspective: Objectives, Policy Types, and Impact Mechanisms," Systemic Practice and Action Research, Springer, vol. 33(2), pages 213-214, April.
    46. Nilsen, Øivind A. & Raknerud, Arvid & Iancu, Diana-Cristina, 2020. "Public R&D support and firm performance: A multivariate dose-response analysis," Research Policy, Elsevier, vol. 49(7).
    47. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    48. E. Conesa, 1998. "Organizational Dynamics and the Evolutionary Dilemma between Diversity and Standardization in Mission-Oriented Research Programmes: An Illustration," Working Papers ir98023, International Institute for Applied Systems Analysis.
    49. Rainer Kattel & Mariana Mazzucato, 2018. "Mission-oriented innovation policy and dynamic capabilities in the public sector," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(5), pages 787-801.
    50. Hottenrott, Hanna & Lopes-Bento, Cindy & Veugelers, Reinhilde, 2017. "Direct and cross scheme effects in a research and development," Research Policy, Elsevier, vol. 46(6), pages 1118-1132.
    51. Wan Park & Sang-Gook Kim, 2022. "Integrating quantitative and qualitative methodologies to build a national R&D plan using data envelopment analysis based on R&D stakeholders’ perspectives," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-20, March.
    52. Nicoletta Corrocher & Camilla Lenzi, 2022. "Exploring the sources of knowledge diversity in founding teams and its impact on new firms’ innovation," Journal of Evolutionary Economics, Springer, vol. 32(4), pages 1091-1118, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Seonghee & Lee, Hakyeon, 2015. "Measuring and comparing the R&D performance of government research institutes: A bottom-up data envelopment analysis approach," Journal of Informetrics, Elsevier, vol. 9(4), pages 942-953.
    2. Bresciani, Stefano & Puertas, Rosa & Ferraris, Alberto & Santoro, Gabriele, 2021. "Innovation, environmental sustainability and economic development: DEA-Bootstrap and multilevel analysis to compare two regions," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    3. Zabala-Iturriagagoitia, Jon Mikel & Aparicio, Juan & Ortiz, Lidia & Carayannis, Elias G. & Grigoroudis, Evangelos, 2021. "The productivity of national innovation systems in Europe: Catching up or falling behind?," Technovation, Elsevier, vol. 102(C).
    4. Hung, Chia-Liang, 2017. "Social networks, technology ties, and gatekeeper functionality: Implications for the performance management of R&D projects," Research Policy, Elsevier, vol. 46(1), pages 305-315.
    5. Khoshnevis, Pegah & Teirlinck, Peter, 2018. "Performance evaluation of R&D active firms," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 16-28.
    6. Junhee Bae & Yanghon Chung & Hyesoo Ko, 2021. "Analysis of efficiency in public research activities in terms of knowledge spillover: focusing on earthquake R&D accomplishments," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 108(2), pages 2249-2264, September.
    7. Stjepan Srhoj & Michael Lapinski & Janette Walde, 2019. "Size matters? Impact evaluation of business development grants on SME performance," Working Papers 2019-14, Faculty of Economics and Statistics, Universität Innsbruck.
    8. Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel & Zofío, José L., 2021. "Is more always better? On the relevance of decreasing returns to scale on innovation," Technovation, Elsevier, vol. 107(C).
    9. Cosmin Eugen ENACHE, 2012. "The efficiency of expenditure-related redistributive policies in the European countries," Timisoara Journal of Economics, West University of Timisoara, Romania, Faculty of Economics and Business Administration, vol. 5(18), pages 380-394.
    10. Yang Li & An-Chi Liu & Shu-Mei Wang & Yiting Zhan & Jingran Chen & Hsiao-Fen Hsiao, 2022. "A Study of Total-Factor Energy Efficiency for Regional Sustainable Development in China: An Application of Bootstrapped DEA and Clustering Approach," Energies, MDPI, vol. 15(9), pages 1-13, April.
    11. Tsolas, Ioannis E., 2014. "Precious metal mutual fund performance appraisal using DEA modeling," Resources Policy, Elsevier, vol. 39(C), pages 54-60.
    12. Jaehun Park & Joonyoung Kim & Si-Il Sung, 2017. "Performance Evaluation of Research and Business Development: A Case Study of Korean Public Organizations," Sustainability, MDPI, vol. 9(12), pages 1-16, December.
    13. Puertas, Rosa & Marti, Luisa & Guaita-Martinez, José M., 2020. "Innovation, lifestyle, policy and socioeconomic factors: An analysis of European quality of life," Technological Forecasting and Social Change, Elsevier, vol. 160(C).
    14. Kao, Chiang, 2014. "Network data envelopment analysis: A review," European Journal of Operational Research, Elsevier, vol. 239(1), pages 1-16.
    15. Stjepan Srhoj & Michal Lapinski & Janette Walde, 2021. "Impact evaluation of business development grants on SME performance," Small Business Economics, Springer, vol. 57(3), pages 1285-1301, October.
    16. Jaeho Shin & Yeongjun Kim & Changhee Kim, 2021. "The Perception of Occupational Safety and Health (OSH) Regulation and Innovation Efficiency in the Construction Industry: Evidence from South Korea," IJERPH, MDPI, vol. 18(5), pages 1-14, February.
    17. Alessandro Fiorini, 2016. "Technical efficiency in a technological innovation system perspective: The case of bioenergy technologies R&D resources mobilisation in a sample from EU-28," ECONOMICS AND POLICY OF ENERGY AND THE ENVIRONMENT, FrancoAngeli Editore, vol. 2016(2), pages 107-127.
    18. Jiawei Yang & Lei Fang, 2022. "Average lexicographic efficiency decomposition in two-stage data envelopment analysis: an application to China’s regional high-tech innovation systems," Annals of Operations Research, Springer, vol. 312(2), pages 1051-1093, May.
    19. Barnabé Walheer, 2020. "Output, input, and undesirable output interconnections in data envelopment analysis: convexity and returns-to-scale," Annals of Operations Research, Springer, vol. 284(1), pages 447-467, January.
    20. Duk Hee Lee & Il Won Seo & Ho Chull Choe & Hee Dae Kim, 2012. "Collaboration network patterns and research performance: the case of Korean public research institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 925-942, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jknowl:v:16:y:2025:i:1:d:10.1007_s13132-024-01947-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.