IDEAS home Printed from https://ideas.repec.org/h/elg/eechap/14384_3.html
   My bibliography  Save this book chapter

Micro-econometric approaches to the evaluation of technology-oriented public programmes: a non-technical review of the state of the art

In: Handbook on the Theory and Practice of Program Evaluation

Author

Listed:
  • Spyros Arvanitis

Abstract

As this volume demonstrates, a wide variety of methodologies exist to evaluate particularly the objectives and outcomes of research and development programs. These include surveys, statistical and econometric estimations, patent analyses, bibliometrics, scientometrics, network analyses, case studies, and historical tracings. Contributors divide these and other methods and applications into four categories – economic, non-economic, hybrid and data-driven – in order to discuss the many factors that affect the utility of each technique and how that impacts the technological, economic and societal forecasts of the programs in question.

Suggested Citation

  • Spyros Arvanitis, 2013. "Micro-econometric approaches to the evaluation of technology-oriented public programmes: a non-technical review of the state of the art," Chapters, in: Albert N. Link & Nicholas S. Vonortas (ed.), Handbook on the Theory and Practice of Program Evaluation, chapter 3, pages 56-88, Edward Elgar Publishing.
  • Handle: RePEc:elg:eechap:14384_3
    as

    Download full text from publisher

    File URL: https://www.elgaronline.com/view/9780857932396.00008.xml
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Girma, Sourafel & Gorg, Holger & Strobl, Eric, 2007. "The effects of government grants on plant survival: A micro-econometric analysis," International Journal of Industrial Organization, Elsevier, vol. 25(4), pages 701-720, August.
    2. Rufin Baghana & Pierre Mohnen, 2009. "Effectiveness of R&D Tax Incentives in Small and Large Enterprises in Québec," CIRANO Working Papers 2009s-01, CIRANO.
    3. Charles Bérubé & Pierre Mohnen, 2009. "Are firms that receive R&D subsidies more innovative?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 42(1), pages 206-225, February.
    4. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    5. Bloom, Nick & Griffith, Rachel & Van Reenen, John, 2002. "Do R&D tax credits work? Evidence from a panel of countries 1979-1997," Journal of Public Economics, Elsevier, vol. 85(1), pages 1-31, July.
    6. Bronwyn Hall, 2004. "The financing of research and development," Chapters, in: Anthony Bartzokas & Sunil Mani (ed.), Financial Systems, Corporate Investment in Innovation, and Venture Capital, chapter 2, Edward Elgar Publishing.
    7. Baghana, Rufin, 2010. "Public R&D Subsidies and Productivity: Evidence from Firm-Level Data in Quebec," MERIT Working Papers 2010-055, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    8. Daniel J. Wilson, 2009. "Beggar Thy Neighbor? The In-State, Out-of-State, and Aggregate Effects of R&D Tax Credits," The Review of Economics and Statistics, MIT Press, vol. 91(2), pages 431-436, May.
    9. Czarnitzki, Dirk & Hanel, Petr & Rosa, Julio Miguel, 2011. "Evaluating the impact of R&D tax credits on innovation: A microeconometric study on Canadian firms," Research Policy, Elsevier, vol. 40(2), pages 217-229, March.
    10. González, Xulia & Pazó, Consuelo, 2008. "Do public subsidies stimulate private R&D spending?," Research Policy, Elsevier, vol. 37(3), pages 371-389, April.
    11. Kaiser, Ulrich & Kuhn, Johan M., 2012. "Long-run effects of public–private research joint ventures: The case of the Danish Innovation Consortia support scheme," Research Policy, Elsevier, vol. 41(5), pages 913-927.
    12. Emmanuel Duguet, 2004. "Are RαD subsidies a substitute or a complement to privately funded RαD ?. An econometric analysis at the firm level," Revue d'économie politique, Dalloz, vol. 114(2), pages 245-274.
    13. Dirk Czarnitzki & Bernd Ebersberger & Andreas Fier, 2007. "The relationship between R&D collaboration, subsidies and R&D performance: Empirical evidence from Finland and Germany," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(7), pages 1347-1366.
    14. CZARNITZKI Dirk & LOPES BENTO Cindy, 2010. "Evaluation of public R&D policies: A cross-country comparison," LISER Working Paper Series 2010-31, Luxembourg Institute of Socio-Economic Research (LISER).
    15. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    16. Klette, Tor Jakob & Moen, Jarle & Griliches, Zvi, 2000. "Do subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies1," Research Policy, Elsevier, vol. 29(4-5), pages 471-495, April.
    17. Lee G. Branstetter & Mariko Sakakibara, 2002. "When Do Research Consortia Work Well and Why? Evidence from Japanese Panel Data," American Economic Review, American Economic Association, vol. 92(1), pages 143-159, March.
    18. Maarten Cornet & Björn Vroomen & Marc van der Steeg, 2006. "Do innovation vouchers help SMEs to cross the bridge towards science?," CPB Discussion Paper 58, CPB Netherlands Bureau for Economic Policy Analysis.
    19. Aerts, Kris & Schmidt, Tobias, 2008. "Two for the price of one?: Additionality effects of R&D subsidies: A comparison between Flanders and Germany," Research Policy, Elsevier, vol. 37(5), pages 806-822, June.
    20. Czarnitzki, Dirk & Fier, Andreas, 2002. "Do Innovation Subsidies Crowd Out Private Investment? Evidence from the German Service Sector," ZEW Discussion Papers 02-04, ZEW - Leibniz Centre for European Economic Research.
    21. Giovanni Cerulli, 2008. "Modelling and measuring the effects of public subsidies on business R&D: theoretical and econometric issues," CERIS Working Paper 200803, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    22. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    23. Benfratello, Luigi & Sembenelli, Alessandro, 2002. "Research joint ventures and firm level performance," Research Policy, Elsevier, vol. 31(4), pages 493-507, May.
    24. Giovanni Cerulli & Bianca Poti', 2008. "Evaluating the Effect of Public Subsidies on firm R&D activity: an Application to Italy Using the Community Innovation Survey," CERIS Working Paper 200809, CNR-IRCrES Research Institute on Sustainable Economic Growth - Torino (TO) ITALY - former Institute for Economic Research on Firms and Growth - Moncalieri (TO) ITALY.
    25. Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297-297.
    26. Adam B. Jaffe, 2002. "Building Programme Evaluation into the Design of Public Research-Support Programmes," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 18(1), pages 22-34, Spring.
    27. Almus, Matthias & Czarnitzki, Dirk, 2003. "The Effects of Public R&D Subsidies on Firms' Innovation Activities: The Case of Eastern Germany," Journal of Business & Economic Statistics, American Statistical Association, vol. 21(2), pages 226-236, April.
    28. Martin, Stephen & Scott, John T., 2000. "The nature of innovation market failure and the design of public support for private innovation," Research Policy, Elsevier, vol. 29(4-5), pages 437-447, April.
    29. Giovanni Cerulli, 2010. "Modelling and Measuring the Effect of Public Subsidies on Business R&D: A Critical Review of the Econometric Literature," The Economic Record, The Economic Society of Australia, vol. 86(274), pages 421-449, September.
    30. Zvi Griliches, 1998. "Issues in Assessing the Contribution of Research and Development to Productivity Growth," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 17-45, National Bureau of Economic Research, Inc.
    31. Rufin Baghana & Pierre Mohnen, 2009. "Effectiveness of R&D tax incentives in small and large enterprises in Québec," Small Business Economics, Springer, vol. 33(1), pages 91-107, June.
    32. Falk, Rahel, 2007. "Measuring the effects of public support schemes on firms' innovation activities: Survey evidence from Austria," Research Policy, Elsevier, vol. 36(5), pages 665-679, June.
    33. Arvanitis, Spyros & Hollenstein, Heinz & Lenz, Stephan, 2002. "The Effectiveness of Government Promotion of Advanced Manufacturing Technologies (AMT): An Economic Analysis Based on Swiss Micro Data," Small Business Economics, Springer, vol. 19(4), pages 321-340, December.
    34. Dominique Guellec & Bruno Van Pottelsberghe De La Potterie, 2003. "The impact of public R&D expenditure on business R&D," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 12(3), pages 225-243.
    35. Mohnen, Pierre & Lokshin, Boris, 2009. "What does it take for an R&D tax incentive policy to be effective?," MERIT Working Papers 2009-014, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    36. Cappelen, Ådne & Raknerud, Arvid & Rybalka, Marina, 2012. "The effects of R&D tax credits on patenting and innovations," Research Policy, Elsevier, vol. 41(2), pages 334-345.
    37. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    38. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    39. Spyros Arvanitis & Laurent Donzé & Nora Sydow, 2010. "Impact of Swiss technology policy on firm innovation performance: an evaluation based on a matching approach," Science and Public Policy, Oxford University Press, vol. 37(1), pages 63-78, February.
    40. Oliviero Carboni, 2011. "R&D subsidies and private R&D expenditures: evidence from Italian manufacturing data," International Review of Applied Economics, Taylor & Francis Journals, vol. 25(4), pages 419-439.
    41. Bayona-Sáez, Cristina & García-Marco, Teresa, 2010. "Assessing the effectiveness of the Eureka Program," Research Policy, Elsevier, vol. 39(10), pages 1375-1386, December.
    42. Girma, Sourafel & Gorg, Holger & Strobl, Eric, 2007. "The effect of government grants on plant level productivity," Economics Letters, Elsevier, vol. 94(3), pages 439-444, March.
    43. Roberto Gabriele & Marco Zamarian & Enrico Zaninotto, 2006. "Assessing the economic impact of public industrial policies: an empirical investigation on subsidies," ROCK Working Papers 039, Department of Computer and Management Sciences, University of Trento, Italy, revised 12 Jun 2008.
    44. Mohnen, Pierre & Lokshin, Boris, 2009. "What does it take for an R&D tax incentive policy to be effective?," MERIT Working Papers 014, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    45. Scott J. Wallsten, 2000. "The Effects of Government-Industry R&D Programs on Private R&D: The Case of the Small Business Innovation Research Program," RAND Journal of Economics, The RAND Corporation, vol. 31(1), pages 82-100, Spring.
    46. Holger Görg & Eric Strobl, 2007. "The Effect of R&D Subsidies on Private R&D," Economica, London School of Economics and Political Science, vol. 74(294), pages 215-234, May.
    47. Hall, Bronwyn & Van Reenen, John, 2000. "How effective are fiscal incentives for R&D? A review of the evidence," Research Policy, Elsevier, vol. 29(4-5), pages 449-469, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bodas Freitas, Isabel & Castellacci, Fulvio & Fontana, Roberto & Malerba, Franco & Vezzulli, Andrea, 2017. "Sectors and the additionality effects of R&D tax credits: A cross-country microeconometric analysis," Research Policy, Elsevier, vol. 46(1), pages 57-72.
    2. Huergo, Elena & Trenado, Mayte & Ubierna, Andrés, 2016. "The impact of public support on firm propensity to engage in R&D: Spanish experience," Technological Forecasting and Social Change, Elsevier, vol. 113(PB), pages 206-219.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bettina Becker, 2013. "The Determinants of R&D Investment: A Survey of the Empirical Research," Discussion Paper Series 2013_09, Department of Economics, Loughborough University, revised Sep 2013.
    2. Syoum Negassi & Jean-Francois Sattin, 2014. "Evaluation of Public R&D Policy: A Meta-Regression Analysis," Working Papers 14-09, University of Delaware, Department of Economics.
    3. Beck, Mathias & Junge, Martin & Kaiser, Ulrich, 2017. "Public Funding and Corporate Innovation," IZA Discussion Papers 11196, Institute of Labor Economics (IZA).
    4. Emmanuel Chavez, 2020. "The Effects of R&D Tax Credits and Subsidies onPrivate R&D in Mexico (Chapter 2)," PSE Working Papers halshs-02652063, HAL.
    5. Thomas H. W. Ziesemer, 2021. "The Effects of R&D Subsidies and Publicly Performed R&D on Business R&D: A Survey," Hacienda Pública Española / Review of Public Economics, IEF, vol. 236(1), pages 171-205, March.
    6. Bettina Becker, 2015. "Public R&D Policies And Private R&D Investment: A Survey Of The Empirical Evidence," Journal of Economic Surveys, Wiley Blackwell, vol. 29(5), pages 917-942, December.
    7. Özçelik, Emre & Taymaz, Erol, 2008. "R&D support programs in developing countries: The Turkish experience," Research Policy, Elsevier, vol. 37(2), pages 258-275, March.
    8. Hottenrott, Hanna & Lopes-Bento, Cindy, 2014. "(International) R&D collaboration and SMEs: The effectiveness of targeted public R&D support schemes," Research Policy, Elsevier, vol. 43(6), pages 1055-1066.
    9. Hud, Martin & Hussinger, Katrin, 2015. "The impact of R&D subsidies during the crisis," Research Policy, Elsevier, vol. 44(10), pages 1844-1855.
    10. Beck, Mathias & Lopes-Bento, Cindy & Schenker-Wicki, Andrea, 2016. "Radical or incremental: Where does R&D policy hit?," Research Policy, Elsevier, vol. 45(4), pages 869-883.
    11. José Ángel Zúñiga-Vicente & César Alonso-Borrego & Francisco J. Forcadell & José I. Galán, 2014. "Assessing The Effect Of Public Subsidies On Firm R&D Investment: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 28(1), pages 36-67, February.
    12. Becker, Lasse, 2015. "Effectiveness of public innovation support in Europe: Does public support foster turnover, employment and labour productivity?," University of Göttingen Working Papers in Economics 236, University of Goettingen, Department of Economics.
    13. Chudnovsky, Daniel & López, Andrés & Rossi, Martín & Ubfal, Diego, 2006. "Evaluating a Program of Public Funding of Private Innovation Activities: An Econometric Study of FONTAR in Argentina," IDB Publications (Working Papers) 2829, Inter-American Development Bank.
    14. Becker, Lasse & Bizer, Kilian, 2015. "Federalism and innovation support for small and medium-sized enterprises: Empirical evidence in Europe," University of Göttingen Working Papers in Economics 245, University of Goettingen, Department of Economics.
    15. Carboni, Oliviero A., 2017. "The effect of public support on investment and R&D: An empirical evaluation on European manufacturing firms," Technological Forecasting and Social Change, Elsevier, vol. 117(C), pages 282-295.
    16. Wang, Yanbo & Li, Jizhen & Furman, Jeffrey L., 2017. "Firm performance and state innovation funding: Evidence from China’s innofund program," Research Policy, Elsevier, vol. 46(6), pages 1142-1161.
    17. Dimos, Christos & Pugh, Geoff & Hisarciklilar, Mehtap & Talam, Ema & Jackson, Ian, 2022. "The relative effectiveness of R&D tax credits and R&D subsidies: A comparative meta-regression analysis," Technovation, Elsevier, vol. 115(C).
    18. Czarnitzki, Dirk & Lopes-Bento, Cindy, 2013. "Value for money? New microeconometric evidence on public R&D grants in Flanders," Research Policy, Elsevier, vol. 42(1), pages 76-89.
    19. Michel Dumont, 2015. "Working Paper 05-15 - Evaluation of federal tax incentives for private R&D in Belgium: An update," Working Papers 1505, Federal Planning Bureau, Belgium.
    20. Ugur, Mehmet & Trushin, Eshref & Solomon, Edna, 2015. "UK and EU subsidies and private R&D investment: Is there input additionality?," MPRA Paper 68009, University Library of Munich, Germany, revised 16 Nov 2015.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:elg:eechap:14384_3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Darrel McCalla (email available below). General contact details of provider: http://www.e-elgar.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.