IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v45y2016i4p797-815.html
   My bibliography  Save this article

The effectiveness of R&D subsidies: A meta-regression analysis of the evaluation literature

Author

Listed:
  • Dimos, Christos
  • Pugh, Geoff

Abstract

Widespread and increasing public subsidy for research and development (R&D) has given rise to a large and growing number of evaluation studies. While economic theory identifies market failures that justify public support, theory also suggests reasons why returns might be disappointing. Similarly, the empirical literature investigated – 52 micro-level studies published since 2000 on either input or output R&D – reports a wide range of findings. The lack of conclusiveness both of theory and of the evaluation literature motivate this Meta-Regression Analysis (MRA). This study contributes to policy debate by identifying a representative subsidy effect: after controlling for publication selection bias and for a wide range of sample and study heterogeneities, MRA findings reject crowding out of private investment by public subsidy but reveal no evidence of substantial additionality. In addition, among the research practices explaining the heterogeneous effects reported in this literature, those related to the treatment of unobservable firm heterogeneity are particularly important.

Suggested Citation

  • Dimos, Christos & Pugh, Geoff, 2016. "The effectiveness of R&D subsidies: A meta-regression analysis of the evaluation literature," Research Policy, Elsevier, vol. 45(4), pages 797-815.
  • Handle: RePEc:eee:respol:v:45:y:2016:i:4:p:797-815
    DOI: 10.1016/j.respol.2016.01.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733316000032
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2016.01.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. T.D. Stanley & Hristos Doucouliagos, 2010. "Picture This: A Simple Graph That Reveals Much Ado About Research," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 170-191, February.
    2. Dirk Czarnitzki & Hanna Hottenrott & Susanne Thorwarth, 2011. "Industrial research versus development investment: the implications of financial constraints," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 35(3), pages 527-544.
    3. José Ángel Zúñiga-Vicente & César Alonso-Borrego & Francisco J. Forcadell & José I. Galán, 2014. "Assessing The Effect Of Public Subsidies On Firm R&D Investment: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 36-67, February.
    4. Robert M. Solow, 1956. "A Contribution to the Theory of Economic Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 70(1), pages 65-94.
    5. Dirk Czarnitzki, 2006. "Research And Development In Small And Medium‐Sized Enterprises: The Role Of Financial Constraints And Public Funding," Scottish Journal of Political Economy, Scottish Economic Society, vol. 53(3), pages 335-357, July.
    6. Nicholas Bloom & Mark Schankerman & John Van Reenen, 2013. "Identifying Technology Spillovers and Product Market Rivalry," Econometrica, Econometric Society, vol. 81(4), pages 1347-1393, July.
    7. Stanley, T. D. & Doucouliagos, Chris, 2007. "Identifying and correcting publication selection bias in the efficiency-wage literature: Heckman Meta-Regression," Working Papers eco_2007_11, Deakin University, Department of Economics.
    8. Reinhard Hujer & Dubravko Radić, 2005. "Evaluating The Impacts Of Subsidies On Innovation Activities In Germany," Scottish Journal of Political Economy, Scottish Economic Society, vol. 52(4), pages 565-586, September.
    9. Stanley, T. D. & Jarrell, Stephen B. & Doucouliagos, Hristos, 2010. "Could It Be Better to Discard 90% of the Data? A Statistical Paradox," The American Statistician, American Statistical Association, vol. 64(1), pages 70-77.
    10. Hud, Martin & Hussinger, Katrin, 2015. "The impact of R&D subsidies during the crisis," Research Policy, Elsevier, vol. 44(10), pages 1844-1855.
    11. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    12. Bronwyn H. Hall, 2002. "The Assessment: Technology Policy," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 18(1), pages 1-9, Spring.
    13. David, Paul A. & Hall, Bronwyn H. & Toole, Andrew A., 2000. "Is public R&D a complement or substitute for private R&D? A review of the econometric evidence," Research Policy, Elsevier, vol. 29(4-5), pages 497-529, April.
    14. Aschhoff, Birgit, 2009. "The effect of subsidies on R&D investment and success: do subsidy history and size matter?," ZEW Discussion Papers 09-032, ZEW - Leibniz Centre for European Economic Research.
    15. Hottenrott, Hanna & Lopes-Bento, Cindy, 2014. "(International) R&D collaboration and SMEs: The effectiveness of targeted public R&D support schemes," Research Policy, Elsevier, vol. 43(6), pages 1055-1066.
    16. Doucouliagos, Hristos (Chris), 2011. "How large is large? Preliminary and relative guidelines for interpreting partial correlations in economics," Working Papers eco_2011_5, Deakin University, Department of Economics.
    17. Hristos Doucouliagos & T. D. Stanley, 2009. "Publication Selection Bias in Minimum‐Wage Research? A Meta‐Regression Analysis," British Journal of Industrial Relations, London School of Economics, vol. 47(2), pages 406-428, June.
    18. T. D. Stanley, 2008. "Meta‐Regression Methods for Detecting and Estimating Empirical Effects in the Presence of Publication Selection," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(1), pages 103-127, February.
    19. Bronwyn Hall, 2004. "The financing of research and development," Chapters, in: Anthony Bartzokas & Sunil Mani (ed.), Financial Systems, Corporate Investment in Innovation, and Venture Capital, chapter 2, Edward Elgar Publishing.
    20. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost H. Heckemeyer & Robert J. Johnston & Patrice Laroche & Jon P. Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall S. Rosenberger & , 2013. "Meta-Analysis Of Economics Research Reporting Guidelines," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 390-394, April.
    21. Mark Koetse & Raymond Florax & Henri Groot, 2010. "Consequences of effect size heterogeneity for meta-analysis: a Monte Carlo study," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 19(2), pages 217-236, June.
    22. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    23. Klette, Tor Jakob & Moen, Jarle & Griliches, Zvi, 2000. "Do subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies1," Research Policy, Elsevier, vol. 29(4-5), pages 471-495, April.
    24. Stanley, T. D. & Doucouliagos, Hristos, 2011. "Meta-regression approximations to reduce publication selection bias," Working Papers eco_2011_4, Deakin University, Department of Economics.
    25. Clausen, Tommy H., 2009. "Do subsidies have positive impacts on R&D and innovation activities at the firm level?," Structural Change and Economic Dynamics, Elsevier, vol. 20(4), pages 239-253, December.
    26. Hujer, Reinhard & Radić, Dubravko, 2005. "Evaluating the Impacts of Subsidies on Innovation Activities in Germany," ZEW Discussion Papers 05-43, ZEW - Leibniz Centre for European Economic Research.
    27. Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297-297.
    28. T.D. Stanley & Hristos Doucouliagos & Margaret Giles & Jost Heckemeyer & Robert Johnston & Patrice Laroche & Jon Nelson & Martin Paldam & Jacques Poot & Geoff Pugh & Randall Rosenberger & Katja Rost, 2013. "Meta-analysis of economics research reporting guidelines," Post-Print hal-02137661, HAL.
    29. Giovanni Cerulli, 2010. "Modelling and Measuring the Effect of Public Subsidies on Business R&D: A Critical Review of the Econometric Literature," The Economic Record, The Economic Society of Australia, vol. 86(274), pages 421-449, September.
    30. Clarysse, Bart & Wright, Mike & Mustar, Philippe, 2009. "Behavioural additionality of R&D subsidies: A learning perspective," Research Policy, Elsevier, vol. 38(10), pages 1517-1533, December.
    31. Özçelik, Emre & Taymaz, Erol, 2008. "R&D support programs in developing countries: The Turkish experience," Research Policy, Elsevier, vol. 37(2), pages 258-275, March.
    32. Chris Doucouliagos & T.D. Stanley, 2013. "Are All Economic Facts Greatly Exaggerated? Theory Competition And Selectivity," Journal of Economic Surveys, Wiley Blackwell, vol. 27(2), pages 316-339, April.
    33. Wintjes, R. & Douglas, D. & Fairburn, J. & Hollanders, H. & Pugh, G., 2014. "The impact of innovation support programmes on SME innovation in traditional manufacturing industries: an evaluation for seven EU regions," MERIT Working Papers 2014-033, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dimos, Christos & Pugh, Geoff & Hisarciklilar, Mehtap & Talam, Ema & Jackson, Ian, 2022. "The relative effectiveness of R&D tax credits and R&D subsidies: A comparative meta-regression analysis," Technovation, Elsevier, vol. 115(C).
    2. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    3. Carboni, Oliviero A., 2017. "The effect of public support on investment and R&D: An empirical evaluation on European manufacturing firms," Technological Forecasting and Social Change, Elsevier, vol. 117(C), pages 282-295.
    4. Ugur, Mehmet & Trushin, Eshref & Solomon, Edna & Guidi, Francesco, 2016. "R&D and productivity in OECD firms and industries: A hierarchical meta-regression analysis," Research Policy, Elsevier, vol. 45(10), pages 2069-2086.
    5. Silva Filipe & Carreira Carlos, 2017. "Financial Constraints: Do They Matter to Allocate R&D Subsidies?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 17(4), pages 1-26, October.
    6. José Ángel Zúñiga-Vicente & César Alonso-Borrego & Francisco J. Forcadell & José I. Galán, 2014. "Assessing The Effect Of Public Subsidies On Firm R&D Investment: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 36-67, February.
    7. Havranek, Tomas & Kokes, Ondrej, 2015. "Income elasticity of gasoline demand: A meta-analysis," Energy Economics, Elsevier, vol. 47(C), pages 77-86.
    8. Tommy Clausen, 2008. "Do subsidies have positive impacts on R&D and innovation activities at the firm level?," Working Papers on Innovation Studies 20070615, Centre for Technology, Innovation and Culture, University of Oslo.
    9. Clausen, Tommy H., 2009. "Do subsidies have positive impacts on R&D and innovation activities at the firm level?," Structural Change and Economic Dynamics, Elsevier, vol. 20(4), pages 239-253, December.
    10. Beck, Mathias & Junge, Martin & Kaiser, Ulrich, 2017. "Public Funding and Corporate Innovation," IZA Discussion Papers 11196, Institute of Labor Economics (IZA).
    11. Ivano D'Antonio & Alessandro De Iudicibus & Giuseppe Piroli & Francesco Savoia, 2014. "Ricerca e innovazione in campania: una valutazione controfattuale della politica di coesione," STUDI ECONOMICI, FrancoAngeli Editore, vol. 2014(113), pages 61-87.
    12. Liu, Xiaolu & Li, Xiaoyu & Li, Honglin, 2016. "R&D subsidies and business R&D: Evidence from high-tech manufacturing firms in Jiangsu," China Economic Review, Elsevier, vol. 41(C), pages 1-22.
    13. Stéphane Goutte & David Guerreiro & Bilel Sanhaji & Sophie Saglio & Julien Chevallier, 2019. "International Financial Markets," Post-Print halshs-02183053, HAL.
    14. Andrea Bellucci & Luca Pennacchio & Alberto Zazzaro, 2019. "R&D Subsidies and Firms’ Debt Financing," CSEF Working Papers 527, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    15. Petra Valickova & Tomas Havranek & Roman Horvath, 2015. "Financial Development And Economic Growth: A Meta-Analysis," Journal of Economic Surveys, Wiley Blackwell, vol. 29(3), pages 506-526, July.
    16. Brüggemann, Julia & Proeger, Till, 2017. "The effectiveness of public subsidies for private innovations: An experimental approach," University of Göttingen Working Papers in Economics 266, University of Goettingen, Department of Economics, revised 2017.
    17. Marco Mariani & Fabrizia Mealli, 2018. "The Effects of R&D Subsidies to Small and Medium-Sized Enterprises. Evidence from a Regional Program," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 4(2), pages 249-281, July.
    18. Dragana Radicic & Geoffrey Pugh & Hugo Hollanders & René Wintjes & Jon Fairburn, 2016. "The impact of innovation support programs on small and medium enterprises innovation in traditional manufacturing industries: An evaluation for seven European Union regions," Environment and Planning C, , vol. 34(8), pages 1425-1452, December.
    19. Boeing, Philipp, 2016. "The allocation and effectiveness of China’s R&D subsidies - Evidence from listed firms," Research Policy, Elsevier, vol. 45(9), pages 1774-1789.
    20. Czarnitzki, Dirk & Lopes-Bento, Cindy, 2013. "Value for money? New microeconometric evidence on public R&D grants in Flanders," Research Policy, Elsevier, vol. 42(1), pages 76-89.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:45:y:2016:i:4:p:797-815. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.