IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2021i1p311-d713092.html
   My bibliography  Save this article

Empirical Analysis of Evidence-Based Policymaking in R&D Programmes

Author

Listed:
  • Hyensup Shim

    (Technology Management, Economics and Policy Program, Seoul National University, 1, Gwanak-ro, Gwanak-gu, Seoul 08826, Korea)

  • Kiyoon Shin

    (Research Institute of Basic Sciences, Seoul National University, 1, Gwanak-ro, Gwanak-gu, Seoul 08826, Korea)

Abstract

This study explores evidence-based policymaking (EBP) in public research and development (R&D) programmes. Governments develop and implement R&D programmes to promote innovation, the key driver of sustainable economic growth. For effective management, public policies should be planned, executed, and terminated based on their impact evaluation and feedback. Although many studies have investigated the impact of R&D support, few have analysed whether it evolves on the basis of evidence. Using a dataset of Korean programmes, this study adopted the propensity score matching with a difference-in-differences method. We distinguished four determinants of performance evidence: R&D intensity, assets, sales, and profits growth. The following are the main results: (1) while R&D intensity, sales, and profits growth reveal the efficiency of the EBP mechanism, the performance of assets do not differ across the abolished and continued programmes; (2) the EBP process classified by subsidy amount reveals no statistically significant differences in terms of R&D intensity and profits. This suggests that policymakers need to consider the amount of subsidy granted under the budget limitation. This study contributes to the empirical research on EBP using heterogeneous evidence indicators and describes how policymakers exploit policy evaluation to implement and monitor policies for sustainable development.

Suggested Citation

  • Hyensup Shim & Kiyoon Shin, 2021. "Empirical Analysis of Evidence-Based Policymaking in R&D Programmes," Sustainability, MDPI, vol. 14(1), pages 1-15, December.
  • Handle: RePEc:gam:jsusta:v:14:y:2021:i:1:p:311-:d:713092
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/1/311/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/14/1/311/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wouter Boon & Jakob Edler, 2018. "Demand, challenges, and innovation. Making sense of new trends in innovation policy," Science and Public Policy, Oxford University Press, vol. 45(4), pages 435-447.
    2. José Ángel Zúñiga-Vicente & César Alonso-Borrego & Francisco J. Forcadell & José I. Galán, 2014. "Assessing The Effect Of Public Subsidies On Firm R&D Investment: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 36-67, February.
    3. Caliendo, Marco & Tübbicke, Stefan, 2021. "Design and effectiveness of start-up subsidies: Evidence from a policy reform in Germany," Economic Analysis and Policy, Elsevier, vol. 70(C), pages 333-340.
    4. Czarnitzki, Dirk & Hanel, Petr & Rosa, Julio Miguel, 2011. "Evaluating the impact of R&D tax credits on innovation: A microeconometric study on Canadian firms," Research Policy, Elsevier, vol. 40(2), pages 217-229, March.
    5. Jun, Seung-Pyo & Kim, Sang-Gook & Park, Hyun-Woo, 2017. "The mismatch between demand and beneficiaries of R&D support programs for SMEs: Evidence from Korean R&D planning programs," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 286-298.
    6. Liu, Shasha & Yin, Shanshan & Yin, Chuan & Sheng, Yan, 2021. "Does the price of natural resources affect firms’ total factor productivity? Evidence from a natural experiment in China," Economic Analysis and Policy, Elsevier, vol. 70(C), pages 37-50.
    7. Andrea Bellucci & Luca Pennacchio & Alberto Zazzaro, 2019. "Public R&D subsidies: collaborative versus individual place-based programs for SMEs," Small Business Economics, Springer, vol. 52(1), pages 213-240, January.
    8. Andrea Conte & Marco Vivarelli, 2014. "Succeeding in innovation: key insights on the role of R&D and technological acquisition drawn from company data," Empirical Economics, Springer, vol. 47(4), pages 1317-1340, December.
    9. Katrin Hussinger, 2008. "R&D and subsidies at the firm level: an application of parametric and semiparametric two-step selection models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(6), pages 729-747.
    10. Joshua Newman & Adrian Cherney & Brian W. Head, 2017. "Policy capacity and evidence-based policy in the public service," Public Management Review, Taylor & Francis Journals, vol. 19(2), pages 157-174, February.
    11. Bronzini, Raffaello & Piselli, Paolo, 2016. "The impact of R&D subsidies on firm innovation," Research Policy, Elsevier, vol. 45(2), pages 442-457.
    12. Beom Cheol Cin & Young Jun Kim & Nicholas S. Vonortas, 2017. "The impact of public R&D subsidy on small firm productivity: evidence from Korean SMEs," Small Business Economics, Springer, vol. 48(2), pages 345-360, February.
    13. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    14. Christian Adam & Yves Steinebach & Christoph Knill, 2018. "Neglected challenges to evidence-based policy-making: the problem of policy accumulation," Policy Sciences, Springer;Society of Policy Sciences, vol. 51(3), pages 269-290, September.
    15. Lawrence Mead, 2015. "Only connect: Why government often ignores research," Policy Sciences, Springer;Society of Policy Sciences, vol. 48(2), pages 257-272, June.
    16. Enrico Vanino & Stephen Roper & Bettina Becker, 2020. "Knowledge to Money: Assessing the Business Performance Effects of Publicly Funded R&D Grants," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 17(04), pages 20-24, January.
    17. Natalia Petelski & Darío Milesi & Vladimiro Verre, 2020. "Public support to innovation: impact on technological efforts in Argentine manufacturing firms," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 29(1), pages 66-88, January.
    18. Tuomas Takalo & Tanja Tanayama & Otto Toivanen, 2013. "Estimating the Benefits of Targeted R&D Subsidies," The Review of Economics and Statistics, MIT Press, vol. 95(1), pages 255-272, March.
    19. José Martí & Anita Quas, 2018. "A beacon in the night: government certification of SMEs towards banks," Small Business Economics, Springer, vol. 50(2), pages 397-413, February.
    20. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    21. Saul Lach, 2002. "Do R&D Subsidies Stimulate or Displace Private R&D? Evidence from Israel," Journal of Industrial Economics, Wiley Blackwell, vol. 50(4), pages 369-390, December.
    22. Klette, Tor Jakob & Moen, Jarle & Griliches, Zvi, 2000. "Do subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies1," Research Policy, Elsevier, vol. 29(4-5), pages 471-495, April.
    23. Quintas, Paul & Guy, Ken, 1995. "Collaborative, pre-competitive R&D and the firm," Research Policy, Elsevier, vol. 24(3), pages 325-348, May.
    24. Michael Rosholm & Mai Bjørnskov Mikkelsen & Michael Svarer, 2019. "Bridging the gap from welfare to education: Propensity score matching evaluation of a bridging intervention," PLOS ONE, Public Library of Science, vol. 14(5), pages 1-20, May.
    25. Zhao, Shukuan & Xu, Baoda & Zhang, Weiyong, 2018. "Government R&D subsidy policy in China: An empirical examination of effect, priority, and specifics," Technological Forecasting and Social Change, Elsevier, vol. 135(C), pages 75-82.
    26. Huergo, Elena & Moreno, Lourdes, 2017. "Subsidies or loans? Evaluating the impact of R&D support programmes," Research Policy, Elsevier, vol. 46(7), pages 1198-1214.
    27. Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297-297.
    28. Duch, Néstor & Montolio, Daniel & Mediavilla , Mauro, 2009. "Evaluating the impact of public subsidies on a firm’s performance: a two-stage quasi-experimental approach," INVESTIGACIONES REGIONALES - Journal of REGIONAL RESEARCH, Asociación Española de Ciencia Regional, issue 16, pages 143-165.
    29. Nilsen, Øivind A. & Raknerud, Arvid & Iancu, Diana-Cristina, 2020. "Public R&D support and firm performance: A multivariate dose-response analysis," Research Policy, Elsevier, vol. 49(7).
    30. Stjepan Srhoj & Michal Lapinski & Janette Walde, 2021. "Impact evaluation of business development grants on SME performance," Small Business Economics, Springer, vol. 57(3), pages 1285-1301, October.
    31. Hong, Jae-pyo, 2017. "Causal relationship between ICT R&D investment and economic growth in Korea," Technological Forecasting and Social Change, Elsevier, vol. 116(C), pages 70-75.
    32. Dirk Czarnitzki & Katrin Hussinger, 2018. "Input and output additionality of R&D subsidies," Applied Economics, Taylor & Francis Journals, vol. 50(12), pages 1324-1341, March.
    33. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    34. Weijiang Liu & Yue Bai, 2021. "An Analysis on the Influence of R&D Fiscal and Tax Subsidies on Regional Innovation Efficiency: Empirical Evidence from China," Sustainability, MDPI, vol. 13(22), pages 1-24, November.
    35. Belinda McFadgen & Dave Huitema, 2018. "Experimentation at the interface of science and policy: a multi-case analysis of how policy experiments influence political decision-makers," Policy Sciences, Springer;Society of Policy Sciences, vol. 51(2), pages 161-187, June.
    36. Mei Ho & John Liu & Wen-Min Lu & Chien-Cheng Huang, 2014. "A new perspective to explore the technology transfer efficiencies in US universities," The Journal of Technology Transfer, Springer, vol. 39(2), pages 247-275, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    2. Beck, Mathias & Junge, Martin & Kaiser, Ulrich, 2017. "Public Funding and Corporate Innovation," IZA Discussion Papers 11196, Institute of Labor Economics (IZA).
    3. Shiyuan Liu & Jiang Du & Weike Zhang & Xiaoli Tian, 2021. "Opening the box of subsidies: which is more effective for innovation?," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 11(3), pages 421-449, September.
    4. Dirk Czarnitzki & Julie Delanote, 2017. "Incorporating innovation subsidies in the CDM framework: empirical evidence from Belgium," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 26(1-2), pages 78-92, February.
    5. Ugur, Mehmet & Trushin, Eshref, 2018. "Asymmetric information and heterogeneous effects of R&D subsidies: evidence on R&D investment and employment of R&D personel," Greenwich Papers in Political Economy 21943, University of Greenwich, Greenwich Political Economy Research Centre.
    6. Czarnitzki, Dirk & Lopes-Bento, Cindy, 2013. "Value for money? New microeconometric evidence on public R&D grants in Flanders," Research Policy, Elsevier, vol. 42(1), pages 76-89.
    7. Mehmet Ugur & Eshref Trushin, 2023. "Information asymmetry, risk aversion and R&D subsidies: effect-size heterogeneity and policy conundrums," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 32(8), pages 1190-1215, November.
    8. Bronzini, Raffaello & Piselli, Paolo, 2016. "The impact of R&D subsidies on firm innovation," Research Policy, Elsevier, vol. 45(2), pages 442-457.
    9. Kou, Mingting & Yang, Yuanqi & Chen, Kaihua, 2020. "The impact of external R&D financing on innovation process from a supply-demand perspective," Economic Modelling, Elsevier, vol. 92(C), pages 375-387.
    10. LOPES BENTO Cindy & CZARNITZKI Dirk, 2012. "Value for money? New microeconomic evidence on public R&D grants in Flanders," LISER Working Paper Series 2012-19, Luxembourg Institute of Socio-Economic Research (LISER).
    11. Carboni, Oliviero A., 2017. "The effect of public support on investment and R&D: An empirical evaluation on European manufacturing firms," Technological Forecasting and Social Change, Elsevier, vol. 117(C), pages 282-295.
    12. Wang, Yanbo & Li, Jizhen & Furman, Jeffrey L., 2017. "Firm performance and state innovation funding: Evidence from China’s innofund program," Research Policy, Elsevier, vol. 46(6), pages 1142-1161.
    13. Zhao, Bo & Ziedonis, Rosemarie, 2020. "State governments as financiers of technology startups: Evidence from Michigan's R&D loan program," Research Policy, Elsevier, vol. 49(4).
    14. Hottenrott, Hanna & Lopes-Bento, Cindy, 2014. "(International) R&D collaboration and SMEs: The effectiveness of targeted public R&D support schemes," Research Policy, Elsevier, vol. 43(6), pages 1055-1066.
    15. Ugur, Mehmet & Trushin, Eshref & Solomon, Edna, 2015. "UK and EU subsidies and private R&D investment: Is there input additionality?," MPRA Paper 68009, University Library of Munich, Germany, revised 16 Nov 2015.
    16. Liliana Gelabert & Martín Pereyra & Flavia Roldán, 2021. "Public support prevalence and innovation behavior. Uruguay 2007-2015," Documentos de Investigación 127, Universidad ORT Uruguay. Facultad de Administración y Ciencias Sociales.
    17. Takalo, Tuomas & Tanayama, Tanja & Toivanen, Otto, 2013. "Market failures and the additionality effects of public support to private R&D: Theory and empirical implications," International Journal of Industrial Organization, Elsevier, vol. 31(5), pages 634-642.
    18. Aalto, Eero & Gustafsson, Robin, 2020. "Innovation Promotion Rationales and Impacts – A Review," ETLA Reports 99, The Research Institute of the Finnish Economy.
    19. Haiyan Wang & Yasinjan Sawur, 2022. "The Relationships between Government Subsidies, Innovation Input, and Innovation Output: Evidence from the New Generation of Information Technology Industry in China," Sustainability, MDPI, vol. 14(21), pages 1-22, October.
    20. Kärnä, Anders & Karlsson, Johan & Engberg, Erik & Svensson, Peter, 2020. "Political Failure: A Missing Piece in Innovation Policy Analysis," Working Paper Series 1334, Research Institute of Industrial Economics, revised 21 Apr 2022.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2021:i:1:p:311-:d:713092. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.