IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/21415.html
   My bibliography  Save this paper

Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy

Author

Listed:
  • David Popp

Abstract

The mix of public and private research funding investments in alternative energy presents a challenge for isolating the effect of government R&D funding. Factors such as energy prices and environmental policy influence both private and public R&D decisions. Moreover, because government R&D is further upstream from the final commercialized product, it may take several years for its effect on technology to be realized. Combining data on scientific publications for alternative energy technologies with data on government R&D support for these technologies, we address these challenges. First, we ask how long it takes for energy R&D to provide successful research outcomes. We both provide information on the lags between research funding and new publication and link these articles to citations in U.S. energy patents. One million dollars in additional government R&D funding leads to 1-2 additional publications, but with lags as long as ten years between initial funding and publication. Second, we ask whether adjustment costs associated with large increases in research funding result in diminishing returns to government R&D. There is no evidence of diminishing returns on the level of publication output, but some evidence that additional funding leads to lower quality publications, using citations as a measure of publication quality.

Suggested Citation

  • David Popp, 2015. "Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy," NBER Working Papers 21415, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:21415
    Note: EEE PR
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w21415.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nesta, Lionel & Vona, Francesco & Nicolli, Francesco, 2014. "Environmental policies, competition and innovation in renewable energy," Journal of Environmental Economics and Management, Elsevier, vol. 67(3), pages 396-411.
    2. Bhattacharya, Jay & Packalen, Mikko, 2011. "Opportunities and benefits as determinants of the direction of scientific research," Journal of Health Economics, Elsevier, vol. 30(4), pages 603-615, July.
    3. Richard Freeman & John Van Reenen, 2009. "What If Congress Doubled R&D Spending on the Physical Sciences?," NBER Chapters, in: Innovation Policy and the Economy, Volume 9, pages 1-38, National Bureau of Economic Research, Inc.
    4. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    5. Antoine Dechezleprêtre & Matthieu Glachant, 2014. "Does Foreign Environmental Policy Influence Domestic Innovation? Evidence from the Wind Industry," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 58(3), pages 391-413, July.
    6. Nick Johnstone & Ivan Haščič & David Popp, 2010. "Renewable Energy Policies and Technological Innovation: Evidence Based on Patent Counts," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 45(1), pages 133-155, January.
    7. Joshua L Rosenbloom & Donna K Ginther & Ted Juhl & Joseph A Heppert, 2015. "The Effects of Research & Development Funding on Scientific Productivity: Academic Chemistry, 1990-2009," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-23, September.
    8. Im, Kyung So & Pesaran, M. Hashem & Shin, Yongcheol, 2003. "Testing for unit roots in heterogeneous panels," Journal of Econometrics, Elsevier, vol. 115(1), pages 53-74, July.
    9. Schuelke-Leech, Beth-Anne, 2014. "Volatility in federal funding of energy R&D," Energy Policy, Elsevier, vol. 67(C), pages 943-950.
    10. Jeffrey L. Furman & Fiona Murray & Scott Stern, 2012. "Growing Stem Cells: The Impact of Federal Funding Policy on the U.S. Scientific Frontier," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 661-705, June.
    11. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    12. Elena Verdolini & Marzio Galeotti, 2009. "At Home and Abroad: An Empirical Analysis of Innovation and Diffusion in Energy-Efficient Technologies," Working Papers 2009.123, Fondazione Eni Enrico Mattei.
    13. Zucker, Lynne G. & Darby, Michael R. & Furner, Jonathan & Liu, Robert C. & Ma, Hongyan, 2007. "Minerva unbound: Knowledge stocks, knowledge flows and new knowledge production," Research Policy, Elsevier, vol. 36(6), pages 850-863, July.
    14. David Popp, 2006. "They Don'T Invent Them Like They Used To: An Examination Of Energy Patent Citations Over Time," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 15(8), pages 753-776.
    15. Ek, Kristina & Söderholm, Patrik, 2010. "Technology learning in the presence of public R&D: The case of European wind power," Ecological Economics, Elsevier, vol. 69(12), pages 2356-2362, October.
    16. James D. Adams & J. Roger Clemmons & Paula E. Stephan, 2010. "Standing on Academic Shoulders: Measuring Scientific Influence in Universities," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 61-90, National Bureau of Economic Research, Inc.
    17. Crespi, Gustavo A. & Geuna, Aldo, 2008. "An empirical study of scientific production: A cross country analysis, 1981-2002," Research Policy, Elsevier, vol. 37(4), pages 565-579, May.
    18. Pierre Azoulay & Joshua S. Graff Zivin & Jialan Wang, 2010. "Superstar Extinction," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 549-589.
    19. Nesta, Lionel & Vona, Francesco & Nicolli, Francesco, 2014. "Environmental policies, competition and innovation in renewable energy," Journal of Environmental Economics and Management, Elsevier, vol. 67(3), pages 396-411.
    20. Goolsbee, Austan, 1998. "Does Government R&D Policy Mainly Benefit Scientists and Engineers?," American Economic Review, American Economic Association, vol. 88(2), pages 298-302, May.
    21. Baccini, Leonardo & Urpelainen, Johannes, 2012. "Legislative fractionalization and partisan shifts to the left increase the volatility of public energy R&D expenditures," LSE Research Online Documents on Economics 45571, London School of Economics and Political Science, LSE Library.
    22. Söderholm, Patrik & Sundqvist, Thomas, 2007. "Empirical challenges in the use of learning curves for assessing the economic prospects of renewable energy technologies," Renewable Energy, Elsevier, vol. 32(15), pages 2559-2578.
    23. Michael Roach & Wesley M. Cohen, 2013. "Lens or Prism? Patent Citations as a Measure of Knowledge Flows from Public Research," Management Science, INFORMS, vol. 59(2), pages 504-525, October.
    24. James D. Adams & J. Roger Clemmons & Paula E. Stephan, 2006. "How Rapidly Does Science Leak Out?," NBER Working Papers 11997, National Bureau of Economic Research, Inc.
    25. James Adams & J. Roger Clemmons, 2008. "Science And Industry: Tracing The Flow Of Basic Research Through Manufacturing And Trade," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 17(5), pages 473-495.
    26. Baccini, Leonardo & Urpelainen, Johannes, 2012. "Legislative fractionalization and partisan shifts to the left increase the volatility of public energy R&D expenditures," Energy Policy, Elsevier, vol. 46(C), pages 49-57.
    27. David Popp, 2002. "Induced Innovation and Energy Prices," American Economic Review, American Economic Association, vol. 92(1), pages 160-180, March.
    28. Toole, Andrew A., 2012. "The impact of public basic research on industrial innovation: Evidence from the pharmaceutical industry," Research Policy, Elsevier, vol. 41(1), pages 1-12.
    29. Verdolini, Elena & Galeotti, Marzio, 2011. "At home and abroad: An empirical analysis of innovation and diffusion in energy technologies," Journal of Environmental Economics and Management, Elsevier, vol. 61(2), pages 119-134, March.
    30. Klaassen, Ger & Miketa, Asami & Larsen, Katarina & Sundqvist, Thomas, 2005. "The impact of R&D on innovation for wind energy in Denmark, Germany and the United Kingdom," Ecological Economics, Elsevier, vol. 54(2-3), pages 227-240, August.
    31. Popp, David & Hascic, Ivan & Medhi, Neelakshi, 2011. "Technology and the diffusion of renewable energy," Energy Economics, Elsevier, vol. 33(4), pages 648-662, July.
    32. Margaret E. Blume-Kohout, 2012. "Does Targeted, Disease‐Specific Public Research Funding Influence Pharmaceutical Innovation?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 641-660, June.
    33. Antoine Dechezleprêtre & David Popp, 2015. "Fiscal and Regulatory Instruments for Clean Technology Development in the European Union," CESifo Working Paper Series 5361, CESifo.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rosenbloom, Joshua L. & Ginther, Donna K., 2017. "Show me the Money: Federal R&D Support for Academic Chemistry, 1990–2009," Research Policy, Elsevier, vol. 46(8), pages 1454-1464.
    2. Lionel Nesta & Elena Verdolini & Francesco Vona, 2018. "Threshold Policy Effects and Directed Technical Change in Energy Innovation," Documents de Travail de l'OFCE 2018-05, Observatoire Francais des Conjonctures Economiques (OFCE).
    3. Albrizio, Silvia & Kozluk, Tomasz & Zipperer, Vera, 2017. "Environmental policies and productivity growth: Evidence across industries and firms," Journal of Environmental Economics and Management, Elsevier, vol. 81(C), pages 209-226.
    4. repec:hal:spmain:info:hdl:2441/4b9o704lm99vm9u7s9e6fdpp6r is not listed on IDEAS
    5. Nicolli, Francesco & Vona, Francesco, 2016. "Heterogeneous policies, heterogeneous technologies: The case of renewable energy," Energy Economics, Elsevier, vol. 56(C), pages 190-204.
    6. repec:hal:spmain:info:hdl:2441/2qaasbmk6u8cj8maoa30ls1roi is not listed on IDEAS
    7. Palage, Kristoffer & Lundmark, Robert & Söderholm, Patrik, 2019. "The impact of pilot and demonstration plants on innovation: The case of advanced biofuel patenting in the European Union," International Journal of Production Economics, Elsevier, vol. 210(C), pages 42-55.
    8. Christos Karydas, 2017. "The inter-temporal dimension to knowledge spillovers: any non-environmental reason to support clean innovation?," CER-ETH Economics working paper series 17/267, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    9. Kristoffer Palage & Robert Lundmark & Patrik Söderholm, 2019. "The innovation effects of renewable energy policies and their interaction: the case of solar photovoltaics," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 21(2), pages 217-254, April.
    10. Grafström, Jonas & Söderholm, Patrik & Gawel, Erik & Lehmann, Paul & Strunz, Sebastian, 2017. "Knowledge Accumulation from Public Renewable Energy R&D in the European Union: Converging or Diverging Trends?," Ratio Working Papers 292, The Ratio Institute.
    11. Elina Bryngemark & Patrik Söderholm, 2022. "Green industrial policies and domestic production of biofuels: an econometric analysis of OECD countries," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 24(2), pages 225-261, April.
    12. Lionel Nesta & Elena Verdolini & Francesco Vona, 2018. "Threshold Policy Effects and Directed Technical Change in Energy Innovation," GREDEG Working Papers 2018-01, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), University of Nice Sophia Antipolis.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Popp, 2015. "Using Scientific Publications to Evaluate Government R&D Spending: The Case of Energy," CESifo Working Paper Series 5442, CESifo.
    2. Kristoffer Palage & Robert Lundmark & Patrik Söderholm, 2019. "The innovation effects of renewable energy policies and their interaction: the case of solar photovoltaics," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 21(2), pages 217-254, April.
    3. Popp, David, 2017. "From science to technology: The value of knowledge from different energy research institutions," Research Policy, Elsevier, vol. 46(9), pages 1580-1594.
    4. Grafström, Jonas & Poudineh, Rahmat, 2023. "No evidence of counteracting policy effects on European solar power invention and diffusion," Energy Policy, Elsevier, vol. 172(C).
    5. Palage, Kristoffer & Lundmark, Robert & Söderholm, Patrik, 2019. "The impact of pilot and demonstration plants on innovation: The case of advanced biofuel patenting in the European Union," International Journal of Production Economics, Elsevier, vol. 210(C), pages 42-55.
    6. David Popp, 2016. "From Science to Technology: The Value of Knowledge From Different Energy Research Institutions," NBER Working Papers 22573, National Bureau of Economic Research, Inc.
    7. Hille, Erik & Althammer, Wilhelm & Diederich, Henning, 2020. "Environmental regulation and innovation in renewable energy technologies: Does the policy instrument matter?," Technological Forecasting and Social Change, Elsevier, vol. 153(C).
    8. Herman, Kyle S. & Xiang, Jun, 2019. "Induced innovation in clean energy technologies from foreign environmental policy stringency?," Technological Forecasting and Social Change, Elsevier, vol. 147(C), pages 198-207.
    9. Grafström, Jonas & Poudineh, Rahmat, 2023. "Invention and Diffusion in the Solar Power Sector," Ratio Working Papers 364, The Ratio Institute.
    10. Lionel Nesta & Elena Verdolini & Francesco Vona, 2018. "Threshold Policy Effects and Directed Technical Change in Energy Innovation," Documents de Travail de l'OFCE 2018-05, Observatoire Francais des Conjonctures Economiques (OFCE).
    11. Popp, David, 2012. "The role of technological change in green growth," Policy Research Working Paper Series 6239, The World Bank.
    12. Lee, Chien-Chiang & He, Zhi-Wen & Xiao, Fu, 2022. "How does information and communication technology affect renewable energy technology innovation? International evidence," Renewable Energy, Elsevier, vol. 200(C), pages 546-557.
    13. Rexhäuser, Sascha & Löschel, Andreas, 2015. "Invention in energy technologies: Comparing energy efficiency and renewable energy inventions at the firm level," Energy Policy, Elsevier, vol. 83(C), pages 206-217.
    14. Lindman, Åsa & Söderholm, Patrik, 2016. "Wind energy and green economy in Europe: Measuring policy-induced innovation using patent data," Applied Energy, Elsevier, vol. 179(C), pages 1351-1359.
    15. Chakraborty, Saptorshee Kanto & Mazzanti, Massimiliano, 2020. "Energy intensity and green energy innovation: Checking heterogeneous country effects in the OECD," Structural Change and Economic Dynamics, Elsevier, vol. 52(C), pages 328-343.
    16. repec:hal:spmain:info:hdl:2441/2qaasbmk6u8cj8maoa30ls1roi is not listed on IDEAS
    17. Maximilian Gasser & Simon Pezzutto & Wolfram Sparber & Eric Wilczynski, 2022. "Public Research and Development Funding for Renewable Energy Technologies in Europe: A Cross-Country Analysis," Sustainability, MDPI, vol. 14(9), pages 1-28, May.
    18. repec:hal:spmain:info:hdl:2441/f6h8764enu2lskk9p4oq2cqb0 is not listed on IDEAS
    19. Valentina Bosetti & Elena Verdolini, 2013. "Clean and Dirty International Technology Diffusion," Working Papers 2013.43, Fondazione Eni Enrico Mattei.
    20. Nesta, Lionel & Vona, Francesco & Nicolli, Francesco, 2014. "Environmental policies, competition and innovation in renewable energy," Journal of Environmental Economics and Management, Elsevier, vol. 67(3), pages 396-411.
    21. Wurlod, Jules-Daniel & Noailly, Joëlle, 2018. "The impact of green innovation on energy intensity: An empirical analysis for 14 industrial sectors in OECD countries," Energy Economics, Elsevier, vol. 71(C), pages 47-61.
    22. Verdolini, Elena & Vona, Francesco & Popp, David, 2018. "Bridging the gap: Do fast-reacting fossil technologies facilitate renewable energy diffusion?," Energy Policy, Elsevier, vol. 116(C), pages 242-256.

    More about this item

    JEL classification:

    • O21 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Planning Models; Planning Policy
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy
    • Q42 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Alternative Energy Sources
    • Q48 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Government Policy
    • Q55 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Environmental Economics - - - Environmental Economics: Technological Innovation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:21415. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.