IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_5442.html
   My bibliography  Save this paper

Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy

Author

Listed:
  • David Popp

Abstract

The mix of public and private research funding investments in alternative energy presents a challenge for isolating the effect of government R&D funding. Factors such as energy prices and environmental policy influence both private and public R&D decisions. Moreover, because government R&D is further upstream from the final commercialized product, it may take several years for its effect on technology to be realized. Combining data on scientific publications for alternative energy technologies with data on government R&D support for these technologies, we address these challenges. First, we ask how long it takes for energy R&D to provide successful research outcomes. We both provide information on the lags between research funding and new publication and link these articles to citations in U.S. energy patents. One million dollars in additional government R&D funding leads to 1-2 additional publications, but with lags as long as ten years between initial funding and publication. Second, we ask whether adjustment costs associated with large increases in research funding result in diminishing returns to government R&D. There is no evidence of diminishing returns on the level of publication output, but some evidence that additional funding leads to lower quality publications, using citations as a measure of publication quality.

Suggested Citation

  • David Popp, 2015. "Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy," CESifo Working Paper Series 5442, CESifo.
  • Handle: RePEc:ces:ceswps:_5442
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp5442.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Verdolini, Elena & Galeotti, Marzio, 2011. "At home and abroad: An empirical analysis of innovation and diffusion in energy technologies," Journal of Environmental Economics and Management, Elsevier, vol. 61(2), pages 119-134, March.
    2. James D. Adams & J. Roger Clemmons & Paula E. Stephan, 2010. "Standing on Academic Shoulders: Measuring Scientific Influence in Universities," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 61-90, National Bureau of Economic Research, Inc.
    3. Nesta, Lionel & Vona, Francesco & Nicolli, Francesco, 2014. "Environmental policies, competition and innovation in renewable energy," Journal of Environmental Economics and Management, Elsevier, vol. 67(3), pages 396-411.
    4. Ek, Kristina & Söderholm, Patrik, 2010. "Technology learning in the presence of public R&D: The case of European wind power," Ecological Economics, Elsevier, vol. 69(12), pages 2356-2362, October.
    5. Joshua L Rosenbloom & Donna K Ginther & Ted Juhl & Joseph A Heppert, 2015. "The Effects of Research & Development Funding on Scientific Productivity: Academic Chemistry, 1990-2009," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-23, September.
    6. James D. Adams & J. Roger Clemmons & Paula E. Stephan, 2006. "How Rapidly Does Science Leak Out?," NBER Working Papers 11997, National Bureau of Economic Research, Inc.
    7. Nesta, Lionel & Vona, Francesco & Nicolli, Francesco, 2014. "Environmental policies, competition and innovation in renewable energy," Journal of Environmental Economics and Management, Elsevier, vol. 67(3), pages 396-411.
    8. Bhattacharya, Jay & Packalen, Mikko, 2011. "Opportunities and benefits as determinants of the direction of scientific research," Journal of Health Economics, Elsevier, vol. 30(4), pages 603-615, July.
    9. Richard Freeman & John Van Reenen, 2009. "What If Congress Doubled R&D Spending on the Physical Sciences?," NBER Chapters, in: Innovation Policy and the Economy, Volume 9, pages 1-38, National Bureau of Economic Research, Inc.
    10. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    11. James Adams & J. Roger Clemmons, 2008. "Science And Industry: Tracing The Flow Of Basic Research Through Manufacturing And Trade," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 17(5), pages 473-495.
    12. Baccini, Leonardo & Urpelainen, Johannes, 2012. "Legislative fractionalization and partisan shifts to the left increase the volatility of public energy R&D expenditures," Energy Policy, Elsevier, vol. 46(C), pages 49-57.
    13. Goolsbee, Austan, 1998. "Does Government R&D Policy Mainly Benefit Scientists and Engineers?," American Economic Review, American Economic Association, vol. 88(2), pages 298-302, May.
    14. Antoine Dechezleprêtre & Matthieu Glachant, 2014. "Does Foreign Environmental Policy Influence Domestic Innovation? Evidence from the Wind Industry," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 58(3), pages 391-413, July.
    15. Nick Johnstone & Ivan Haščič & David Popp, 2010. "Renewable Energy Policies and Technological Innovation: Evidence Based on Patent Counts," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(1), pages 133-155, January.
    16. David Popp, 2002. "Induced Innovation and Energy Prices," American Economic Review, American Economic Association, vol. 92(1), pages 160-180, March.
    17. Baccini, Leonardo & Urpelainen, Johannes, 2012. "Legislative fractionalization and partisan shifts to the left increase the volatility of public energy R&D expenditures," LSE Research Online Documents on Economics 45571, London School of Economics and Political Science, LSE Library.
    18. Toole, Andrew A., 2012. "The impact of public basic research on industrial innovation: Evidence from the pharmaceutical industry," Research Policy, Elsevier, vol. 41(1), pages 1-12.
    19. Crespi, Gustavo A. & Geuna, Aldo, 2008. "An empirical study of scientific production: A cross country analysis, 1981-2002," Research Policy, Elsevier, vol. 37(4), pages 565-579, May.
    20. Klaassen, Ger & Miketa, Asami & Larsen, Katarina & Sundqvist, Thomas, 2005. "The impact of R&D on innovation for wind energy in Denmark, Germany and the United Kingdom," Ecological Economics, Elsevier, vol. 54(2-3), pages 227-240, August.
    21. Popp, David & Hascic, Ivan & Medhi, Neelakshi, 2011. "Technology and the diffusion of renewable energy," Energy Economics, Elsevier, vol. 33(4), pages 648-662, July.
    22. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    23. Pierre Azoulay & Joshua S. Graff Zivin & Jialan Wang, 2010. "Superstar Extinction," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 549-589.
    24. Zucker, Lynne G. & Darby, Michael R. & Furner, Jonathan & Liu, Robert C. & Ma, Hongyan, 2007. "Minerva unbound: Knowledge stocks, knowledge flows and new knowledge production," Research Policy, Elsevier, vol. 36(6), pages 850-863, July.
    25. Im, Kyung So & Pesaran, M. Hashem & Shin, Yongcheol, 2003. "Testing for unit roots in heterogeneous panels," Journal of Econometrics, Elsevier, vol. 115(1), pages 53-74, July.
    26. Margaret E. Blume-Kohout, 2012. "Does Targeted, Disease‐Specific Public Research Funding Influence Pharmaceutical Innovation?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 641-660, June.
    27. Schuelke-Leech, Beth-Anne, 2014. "Volatility in federal funding of energy R&D," Energy Policy, Elsevier, vol. 67(C), pages 943-950.
    28. Jeffrey L. Furman & Fiona Murray & Scott Stern, 2012. "Growing Stem Cells: The Impact of Federal Funding Policy on the U.S. Scientific Frontier," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 661-705, June.
    29. Söderholm, Patrik & Sundqvist, Thomas, 2007. "Empirical challenges in the use of learning curves for assessing the economic prospects of renewable energy technologies," Renewable Energy, Elsevier, vol. 32(15), pages 2559-2578.
    30. Michael Roach & Wesley M. Cohen, 2013. "Lens or Prism? Patent Citations as a Measure of Knowledge Flows from Public Research," Management Science, INFORMS, vol. 59(2), pages 504-525, October.
    31. Antoine Dechezleprêtre & David Popp, 2015. "Fiscal and Regulatory Instruments for Clean Technology Development in the European Union," CESifo Working Paper Series 5361, CESifo.
    32. David Popp, 2006. "They Don'T Invent Them Like They Used To: An Examination Of Energy Patent Citations Over Time," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 15(8), pages 753-776.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:hal:spmain:info:hdl:2441/2qaasbmk6u8cj8maoa30ls1roi is not listed on IDEAS
    2. Lionel Nesta & Elena Verdolini & Francesco Vona, 2018. "Threshold Policy Effects and Directed Technical Change in Energy Innovation," Documents de Travail de l'OFCE 2018-05, Observatoire Francais des Conjonctures Economiques (OFCE).
    3. Kristoffer Palage & Robert Lundmark & Patrik Söderholm, 2019. "The innovation effects of renewable energy policies and their interaction: the case of solar photovoltaics," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 21(2), pages 217-254, April.
    4. Rosenbloom, Joshua L. & Ginther, Donna K., 2017. "Show me the Money: Federal R&D Support for Academic Chemistry, 1990–2009," Research Policy, Elsevier, vol. 46(8), pages 1454-1464.
    5. Palage, Kristoffer & Lundmark, Robert & Söderholm, Patrik, 2019. "The impact of pilot and demonstration plants on innovation: The case of advanced biofuel patenting in the European Union," International Journal of Production Economics, Elsevier, vol. 210(C), pages 42-55.
    6. Nicolli, Francesco & Vona, Francesco, 2016. "Heterogeneous policies, heterogeneous technologies: The case of renewable energy," Energy Economics, Elsevier, vol. 56(C), pages 190-204.
    7. Grafström, Jonas & Söderholm, Patrik & Gawel, Erik & Lehmann, Paul & Strunz, Sebastian, 2017. "Knowledge Accumulation from Public Renewable Energy R&D in the European Union: Converging or Diverging Trends?," Ratio Working Papers 292, The Ratio Institute.
    8. Christos Karydas, 2017. "The inter-temporal dimension to knowledge spillovers: any non-environmental reason to support clean innovation?," CER-ETH Economics working paper series 17/267, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    9. Albrizio, Silvia & Kozluk, Tomasz & Zipperer, Vera, 2017. "Environmental policies and productivity growth: Evidence across industries and firms," Journal of Environmental Economics and Management, Elsevier, vol. 81(C), pages 209-226.
    10. Elina Bryngemark & Patrik Söderholm, 2022. "Green industrial policies and domestic production of biofuels: an econometric analysis of OECD countries," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 24(2), pages 225-261, April.
    11. Lionel Nesta & Elena Verdolini & Francesco Vona, 2018. "Threshold Policy Effects and Directed Technical Change in Energy Innovation," GREDEG Working Papers 2018-01, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), University of Nice Sophia Antipolis.
    12. repec:hal:spmain:info:hdl:2441/4b9o704lm99vm9u7s9e6fdpp6r is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Popp, 2015. "Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy," NBER Working Papers 21415, National Bureau of Economic Research, Inc.
    2. Grafström, Jonas & Poudineh, Rahmat, 2023. "No evidence of counteracting policy effects on European solar power invention and diffusion," Energy Policy, Elsevier, vol. 172(C).
    3. Popp, David, 2017. "From science to technology: The value of knowledge from different energy research institutions," Research Policy, Elsevier, vol. 46(9), pages 1580-1594.
    4. Kristoffer Palage & Robert Lundmark & Patrik Söderholm, 2019. "The innovation effects of renewable energy policies and their interaction: the case of solar photovoltaics," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 21(2), pages 217-254, April.
    5. Grafström, Jonas & Poudineh, Rahmat, 2023. "Invention and Diffusion in the Solar Power Sector," Ratio Working Papers 364, The Ratio Institute.
    6. Hille, Erik & Althammer, Wilhelm & Diederich, Henning, 2020. "Environmental regulation and innovation in renewable energy technologies: Does the policy instrument matter?," Technological Forecasting and Social Change, Elsevier, vol. 153(C).
    7. Herman, Kyle S. & Xiang, Jun, 2019. "Induced innovation in clean energy technologies from foreign environmental policy stringency?," Technological Forecasting and Social Change, Elsevier, vol. 147(C), pages 198-207.
    8. Palage, Kristoffer & Lundmark, Robert & Söderholm, Patrik, 2019. "The impact of pilot and demonstration plants on innovation: The case of advanced biofuel patenting in the European Union," International Journal of Production Economics, Elsevier, vol. 210(C), pages 42-55.
    9. David Popp, 2016. "From Science to Technology: The Value of Knowledge From Different Energy Research Institutions," NBER Working Papers 22573, National Bureau of Economic Research, Inc.
    10. Lionel Nesta & Elena Verdolini & Francesco Vona, 2018. "Threshold Policy Effects and Directed Technical Change in Energy Innovation," Documents de Travail de l'OFCE 2018-05, Observatoire Francais des Conjonctures Economiques (OFCE).
    11. Maximilian Gasser & Simon Pezzutto & Wolfram Sparber & Eric Wilczynski, 2022. "Public Research and Development Funding for Renewable Energy Technologies in Europe: A Cross-Country Analysis," Sustainability, MDPI, vol. 14(9), pages 1-28, May.
    12. Lee, Chien-Chiang & He, Zhi-Wen & Xiao, Fu, 2022. "How does information and communication technology affect renewable energy technology innovation? International evidence," Renewable Energy, Elsevier, vol. 200(C), pages 546-557.
    13. Popp, David, 2012. "The role of technological change in green growth," Policy Research Working Paper Series 6239, The World Bank.
    14. Gianluca ORSATTI, 2019. "Public R&D and green knowledge diffusion:\r\nEvidence from patent citation data," Cahiers du GREThA (2007-2019) 2019-17, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    15. Odam, Neil & de Vries, Frans P., 2020. "Innovation modelling and multi-factor learning in wind energy technology," Energy Economics, Elsevier, vol. 85(C).
    16. Rexhäuser, Sascha & Löschel, Andreas, 2015. "Invention in energy technologies: Comparing energy efficiency and renewable energy inventions at the firm level," Energy Policy, Elsevier, vol. 83(C), pages 206-217.
    17. Lindman, Åsa & Söderholm, Patrik, 2016. "Wind energy and green economy in Europe: Measuring policy-induced innovation using patent data," Applied Energy, Elsevier, vol. 179(C), pages 1351-1359.
    18. Li, Ke & Lin, Boqiang, 2016. "Impact of energy technology patents in China: Evidence from a panel cointegration and error correction model," Energy Policy, Elsevier, vol. 89(C), pages 214-223.
    19. Popp, David & Newell, Richard G. & Jaffe, Adam B., 2010. "Energy, the Environment, and Technological Change," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 2, chapter 0, pages 873-937, Elsevier.
    20. Chakraborty, Saptorshee Kanto & Mazzanti, Massimiliano, 2020. "Energy intensity and green energy innovation: Checking heterogeneous country effects in the OECD," Structural Change and Economic Dynamics, Elsevier, vol. 52(C), pages 328-343.

    More about this item

    Keywords

    public R&D; publication data; solar energy; wind energy; biofuels; energy efficiency;
    All these keywords.

    JEL classification:

    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy
    • Q42 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Alternative Energy Sources
    • Q48 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Government Policy
    • Q55 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Environmental Economics: Technological Innovation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_5442. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.