IDEAS home Printed from https://ideas.repec.org/p/ecl/harjfk/rwp14-054.html
   My bibliography  Save this paper

Energy Technology Expert Elicitations for Policy: Workshops, Modeling, and Meta-analysis

Author

Listed:
  • Diaz Anadon, Laura

    (Harvard University)

  • Bosetti, Valentina

    (Harvard University)

  • Chan, Gabriel

    (Harvard University)

  • Nemet, Gregory

    (Harvard University)

  • Verdolini, Elena

    (Harvard University)

Abstract

Characterizing the future performance of energy technologies can improve the development of energy policies that have net benefits under a broad set of future conditions. In particular, decisions about public investments in research, development, and demonstration (RD&D) that promote technological change can benefit from (1) an explicit consideration of the uncertainty inherent in the innovation process and (2) a systematic evaluation of the tradeoffs in investment allocations across different technologies. To shed light on these questions, over the past five years several groups in the United States and Europe have conducted expert elicitations and modeled the resulting societal benefits. In this paper, we discuss the lessons learned from the design and implementation of these initiatives in four respects. First, we discuss lessons from the development of ten energy-technology expert elicitation protocols, highlighting the challenge of matching elicitation design with a particular modeling tool. Second, we report insights from the use of expert elicitations to optimize RD&D investment portfolios. These include a discussion of the rate of decreasing marginal returns to research, the optimal level of overall investments, and the sensitivity of results to policy scenarios and selected metrics for evaluation. Third, we discuss the effect of combining online elicitation tools with in-person group discussions on the usefulness of the results. Fourth, we summarize the results of a meta-analysis of elicited data across research groups to identify the association between expert characteristics and elicitation results.

Suggested Citation

  • Diaz Anadon, Laura & Bosetti, Valentina & Chan, Gabriel & Nemet, Gregory & Verdolini, Elena, 2014. "Energy Technology Expert Elicitations for Policy: Workshops, Modeling, and Meta-analysis," Working Paper Series rwp14-054, Harvard University, John F. Kennedy School of Government.
  • Handle: RePEc:ecl:harjfk:rwp14-054
    as

    Download full text from publisher

    File URL: https://research.hks.harvard.edu/publications/workingpapers/citation.aspx?PubId=9509&type=WPN
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Catenacci, Michela & Verdolini, Elena & Bosetti, Valentina & Fiorese, Giulia, 2013. "Going electric: Expert survey on the future of battery technologies for electric vehicles," Energy Policy, Elsevier, vol. 61(C), pages 403-413.
    2. Luca Zamparini & Aura Reggiani, 2007. "Meta-Analysis and the Value of Travel Time Savings: A Transatlantic Perspective in Passenger Transport," Networks and Spatial Economics, Springer, vol. 7(4), pages 377-396, December.
    3. Davis, Graham A. & Owens, Brandon, 2003. "Optimizing the level of renewable electric R&D expenditures using real options analysis," Energy Policy, Elsevier, vol. 31(15), pages 1589-1608, December.
    4. Fiorese, Giulia & Catenacci, Michela & Verdolini, Elena & Bosetti, Valentina, 2013. "Advanced biofuels: Future perspectives from an expert elicitation survey," Energy Policy, Elsevier, vol. 56(C), pages 293-311.
    5. Bosetti, Valentina & Catenacci, Michela & Fiorese, Giulia & Verdolini, Elena, 2012. "The future prospect of PV and CSP solar technologies: An expert elicitation survey," Energy Policy, Elsevier, vol. 49(C), pages 308-317.
    6. Terry Barker and Katie Jenkins, 2007. "The Costs of Avoiding Dangerous Climate Change: Estimates Derived from a Meta-Analysis of the Literature," Human Development Occasional Papers (1992-2007) HDOCPA-2007-02, Human Development Report Office (HDRO), United Nations Development Programme (UNDP).
    7. Sampat, Bhaven N., 2012. "Mission-oriented biomedical research at the NIH," Research Policy, Elsevier, vol. 41(10), pages 1729-1741.
    8. Hall, Bronwyn H. & Mairesse, Jacques & Mohnen, Pierre, 2010. "Measuring the Returns to R&D," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 2, chapter 0, pages 1033-1082, Elsevier.
    9. Diaz Anadon, Laura & Nemet, Gregory & Verdolini, Elena, 2013. "The Future Costs of Nuclear Power Using Multiple Expert Elicitations: Effects of RD&D and Elicitation Design," Climate Change and Sustainable Development 158747, Fondazione Eni Enrico Mattei (FEEM).
    10. Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.
    11. Pugh, Graham & Clarke, Leon & Marlay, Robert & Kyle, Page & Wise, Marshall & McJeon, Haewon & Chan, Gabriel, 2011. "Energy R&D portfolio analysis based on climate change mitigation," Energy Economics, Elsevier, vol. 33(4), pages 634-643, July.
    12. Anadón, Laura Díaz, 2012. "Missions-oriented RD&D institutions in energy between 2000 and 2010: A comparative analysis of China, the United Kingdom, and the United States," Research Policy, Elsevier, vol. 41(10), pages 1742-1756.
    13. Nemet, Gregory F., 2012. "Inter-technology knowledge spillovers for energy technologies," Energy Economics, Elsevier, vol. 34(5), pages 1259-1270.
    14. Kelly Sims Gallagher & Laura Diaz Anadon & Ruud Kempener & Charlie Wilson, 2011. "Trends in investments in global energy research, development, and demonstration," Wiley Interdisciplinary Reviews: Climate Change, John Wiley & Sons, vol. 2(3), pages 373-396, May.
    15. Blanford, Geoffrey J., 2009. "R&D investment strategy for climate change," Energy Economics, Elsevier, vol. 31(Supplemen), pages 27-36.
    16. Adam Rose & Noah Dormady, 2011. "A Meta-Analysis of the Economic Impacts of Climate Change Policy in the United States," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2), pages 143-166.
    17. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    18. David Popp, 2002. "Induced Innovation and Energy Prices," American Economic Review, American Economic Association, vol. 92(1), pages 160-180, March.
    19. Evenson, Robert E & Kislev, Yoav, 1976. "A Stochastic Model of Applied Research," Journal of Political Economy, University of Chicago Press, vol. 84(2), pages 265-281, April.
    20. Baker, Erin & Solak, Senay, 2011. "Climate change and optimal energy technology R&D policy," European Journal of Operational Research, Elsevier, vol. 213(2), pages 442-454, September.
    21. -, 2009. "The economics of climate change," Sede Subregional de la CEPAL para el Caribe (Estudios e Investigaciones) 38679, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gregory F. Nemet & Laura Diaz Anadon & Elena Verdolini, 2017. "Quantifying the Effects of Expert Selection and Elicitation Design on Experts’ Confidence in Their Judgments About Future Energy Technologies," Risk Analysis, John Wiley & Sons, vol. 37(2), pages 315-330, February.
    2. Erin Baker & Olaitan Olaleye & Lara Aleluia Reis, 2015. "Decision Frameworks and the Investment in R&D," Working Papers 2015.42, Fondazione Eni Enrico Mattei.
    3. Nidhi R. Santen & Mort D. Webster & David Popp & Ignacio Pérez-Arriaga, 2017. "Inter-temporal R&D and capital investment portfolios for the electricity industrys low carbon future," The Energy Journal, International Association for Energy Economics, vol. 0(Number 6).
    4. Santen, Nidhi R. & Anadon, Laura Diaz, 2016. "Balancing solar PV deployment and RD&D: A comprehensive framework for managing innovation uncertainty in electricity technology investment planning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 560-569.
    5. Aalbers, Rob & Shestalova, Victoria & Kocsis, Viktória, 2013. "Innovation policy for directing technical change in the power sector," Energy Policy, Elsevier, vol. 63(C), pages 1240-1250.
    6. Elena Verdolini & Laura Díaz Anadón & Erin Baker & Valentina Bosetti & Lara Aleluia Reis, 2018. "Future Prospects for Energy Technologies: Insights from Expert Elicitations," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 12(1), pages 133-153.
    7. Milford, James & Henrion, Max & Hunter, Chad & Newes, Emily & Hughes, Caroline & Baldwin, Samuel F., 2022. "Energy sector portfolio analysis with uncertainty," Applied Energy, Elsevier, vol. 306(PA).
    8. Popp, David & Santen, Nidhi & Fisher-Vanden, Karen & Webster, Mort, 2013. "Technology variation vs. R&D uncertainty: What matters most for energy patent success?," Resource and Energy Economics, Elsevier, vol. 35(4), pages 505-533.
    9. Kim, Yeong Jae & Cho, Seong-Hoon & Sharma, Bijay P., 2021. "Constructing efficient portfolios of low-carbon technologies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 150(C).
    10. Baker, Erin & Olaleye, Olaitan & Aleluia Reis, Lara, 2015. "Decision frameworks and the investment in R&D," Energy Policy, Elsevier, vol. 80(C), pages 275-285.
    11. Bosetti, Valentina & Carraro, Carlo & Duval, Romain & Tavoni, Massimo, 2011. "What should we expect from innovation? A model-based assessment of the environmental and mitigation cost implications of climate-related R&D," Energy Economics, Elsevier, vol. 33(6), pages 1313-1320.
    12. Baker, Erin & Bosetti, Valentina & Salo, Ahti, 2016. "Finding Common Ground when Experts Disagree: Belief Dominance over Portfolios of Alternatives," MITP: Mitigation, Innovation and Transformation Pathways 243147, Fondazione Eni Enrico Mattei (FEEM).
    13. Mort Webster & Karen Fisher-Vanden & David Popp & Nidhi Santen, 2017. "Should We Give Up after Solyndra? Optimal Technology R&D Portfolios under Uncertainty," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 4(S1), pages 123-151.
    14. Giacomo Marangoni & Massimo Tavoni, 2014. "The Clean Energy R&D Strategy For 2°C," Climate Change Economics (CCE), World Scientific Publishing Co. Pte. Ltd., vol. 5(01), pages 1-23.
    15. Enrica De Cian & Fabio Sferra & Massimo Tavoni, 2013. "The Influence of Economic Growth, Population, and Fossil Fuel Scarcity on Energy Investments," Working Papers 2013.59, Fondazione Eni Enrico Mattei.
    16. Laura Diaz Anadon & Erin Baker & Valentina Bosetti & Lara Aleluia Reis, 2016. "Expert views - and disagreements - about the potential of energy technology R&D," Climatic Change, Springer, vol. 136(3), pages 677-691, June.
    17. Kurth, Margaret & Keisler, Jeffrey M. & Bates, Matthew E. & Bridges, Todd S. & Summers, Jeffrey & Linkov, Igor, 2017. "A portfolio decision analysis approach to support energy research and development resource allocation," Energy Policy, Elsevier, vol. 105(C), pages 128-135.
    18. Cameron Hepburn & Jacquelyn Pless & David Popp, 2018. "Policy Brief—Encouraging Innovation that Protects Environmental Systems: Five Policy Proposals," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 12(1), pages 154-169.
    19. Bistline, John E., 2016. "Energy technology R&D portfolio management: Modeling uncertain returns and market diffusion," Applied Energy, Elsevier, vol. 183(C), pages 1181-1196.
    20. Bosetti, Valentina & Longden, Thomas, 2013. "Light duty vehicle transportation and global climate policy: The importance of electric drive vehicles," Energy Policy, Elsevier, vol. 58(C), pages 209-219.

    More about this item

    JEL classification:

    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • Q40 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecl:harjfk:rwp14-054. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/ksharus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.