IDEAS home Printed from https://ideas.repec.org/p/rff/dpaper/dp-22-10.html
   My bibliography  Save this paper

Between Two Worlds: Methodological and Subjective Differences in Climate Impact Meta-Analyses

Author

Listed:
  • Howard, Peter H.
  • Sterner, Thomas

    (Resources for the Future)

Abstract

In his 2019 Nobel Prize acceptance paper, William Nordhaus (2019) highlighted the uncertainty over climate damages by using two completely different damage functions: Nordhaus and Moffat (2017) and Howard and Sterner (2017). Despite their vastly different implications for climate policies, both were estimated using the meta-analysis technique, a method long considered the objective and scientifically rigorous way for combining results from multiple studies to develop a consensus estimate. This paper demonstrates that this disparity stems from differences in both methodological decisions (addressing methodological impacts and heteroskedasticity) and subjective decisions (about data search, selection, and weighting). Combining the two data sets, applying Nordhaus’s quality weights, and applying the best methodological practices, we find damages of approximately 7 to 10 percent of gross domestic product (GDP) for a 3°C increase in global average surface temperature, depending on the inclusion of catastrophic and productivity impacts; the result is relatively robust to alternative data selection, weighting, and methodological assumptions. However, subjective differences between the weighting assumptions of the two earlier studies are still unresolved. To address subjectivity, this paper makes transparent existing weighting rules, develops new weighting rules, and applies a recently developed quality effects estimator from the medical literature (Doi et al. 2015). Operationalizing these rules, we demonstrate that damages are approximately 7 to 16 percent of GDP for a 3°C increase, though the upper end of this range, which includes catastrophic and productivity impacts, is sensitive to the selected model and weight specification.

Suggested Citation

  • Howard, Peter H. & Sterner, Thomas, 2022. "Between Two Worlds: Methodological and Subjective Differences in Climate Impact Meta-Analyses," RFF Working Paper Series 22-10, Resources for the Future.
  • Handle: RePEc:rff:dpaper:dp-22-10
    as

    Download full text from publisher

    File URL: https://www.rff.org/documents/3438/WP_22-10.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christoph Hambel & Holger Kraft & Eduardo Schwartz, 2015. "Optimal Carbon Abatement in a Stochastic Equilibrium Model with Climate Change," NBER Working Papers 21044, National Bureau of Economic Research, Inc.
    2. Martin L. Weitzman, 2012. "GHG Targets as Insurance Against Catastrophic Climate Damages," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 14(2), pages 221-244, March.
    3. Valentinyi, Akos & Bluedorn, John & Vlassopoulos, Michael, 2009. "The Long-Lived Effects of Historic Climate on the Wealth of Nations," CEPR Discussion Papers 7572, C.E.P.R. Discussion Papers.
    4. Richard S. J. Tol, 2014. "Correction and Update: The Economic Effects of Climate Change," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 221-226, Spring.
    5. Maddison, David, 2003. "The amenity value of the climate: the household production function approach," Resource and Energy Economics, Elsevier, vol. 25(2), pages 155-175, May.
    6. Manne, Alan & Mendelsohn, Robert & Richels, Richard, 1995. "MERGE : A model for evaluating regional and global effects of GHG reduction policies," Energy Policy, Elsevier, vol. 23(1), pages 17-34, January.
    7. Ng, Pin & Zhao, Xiaobing, 2011. "No matter how it is measured, income declines with global warming," Ecological Economics, Elsevier, vol. 70(5), pages 963-970, March.
    8. Richard S. J. Tol, 2009. "The Economic Effects of Climate Change," Journal of Economic Perspectives, American Economic Association, vol. 23(2), pages 29-51, Spring.
    9. Rehdanz, Katrin & Maddison, David, 2005. "Climate and happiness," Ecological Economics, Elsevier, vol. 52(1), pages 111-125, January.
      • Katrin Rehdanz & David J. Maddison, 2003. "Climate and Happiness," Working Papers FNU-20, Research unit Sustainability and Global Change, Hamburg University, revised Apr 2003.
    10. Richard S J Tol, 2018. "The Economic Impacts of Climate Change," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 12(1), pages 4-25.
    11. Jon Nelson & Peter Kennedy, 2009. "The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 42(3), pages 345-377, March.
    12. Rob Dellink & Elisa Lanzi & Jean Château & Francesco Bosello & Ramiro Parrado & Kelly de Bruin, 2014. "Consequences of Climate Change Damages for Economic Growth: A Dynamic Quantitative Assessment," OECD Economics Department Working Papers 1135, OECD Publishing.
    13. Emily Ho & David V. Budescu & Valentina Bosetti & Detlef P. Vuuren & Klaus Keller, 2019. "Not all carbon dioxide emission scenarios are equally likely: a subjective expert assessment," Climatic Change, Springer, vol. 155(4), pages 545-561, August.
    14. Richard Tol, 2013. "The economic impact of climate change in the 20th and 21st centuries," Climatic Change, Springer, vol. 117(4), pages 795-808, April.
    15. Francesco Bosello & Ramiro Parrado, 2014. "Climate Change Impacts and Limited Market-driven Adaptation," Review of Environment, Energy and Economics - Re3, Fondazione Eni Enrico Mattei, September.
    16. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2012. "Temperature Shocks and Economic Growth: Evidence from the Last Half Century," American Economic Journal: Macroeconomics, American Economic Association, vol. 4(3), pages 66-95, July.
    17. Pindyck, Robert S., 2019. "The social cost of carbon revisited," Journal of Environmental Economics and Management, Elsevier, vol. 94(C), pages 140-160.
    18. Cooke, Roger M. & Marti, Deniz & Mazzuchi, Thomas, 2021. "Expert forecasting with and without uncertainty quantification and weighting: What do the data say?," International Journal of Forecasting, Elsevier, vol. 37(1), pages 378-387.
    19. Hanemann, W. Michael, 2008. "What is the Economic Cost of Climate Change?," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt9g11z5cc, Department of Agricultural & Resource Economics, UC Berkeley.
    20. Tamma Carleton & Amir Jina & Michael Delgado & Michael Greenstone & Trevor Houser & Solomon Hsiang & Andrew Hultgren & Robert E Kopp & Kelly E McCusker & Ishan Nath & James Rising & Ashwin Rode & Hee , 2023. "Valuing the Global Mortality Consequences of Climate Change Accounting for Adaptation Costs and Benefits," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(4), pages 2037-2105.
    21. William D. Nordhaus & Andrew Moffat, 2017. "A Survey of Global Impacts of Climate Change: Replication, Survey Methods, and a Statistical Analysis," NBER Working Papers 23646, National Bureau of Economic Research, Inc.
    22. Soyeon Ahn & Betsy Jane Becker, 2011. "Incorporating Quality Scores in Meta-Analysis," Journal of Educational and Behavioral Statistics, , vol. 36(5), pages 555-585, October.
    23. Peter H. Howard & Thomas Sterner, 2017. "Few and Not So Far Between: A Meta-analysis of Climate Damage Estimates," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(1), pages 197-225, September.
    24. Peter Harrison Howard & Derek Sylvan, 2020. "Wisdom of the experts: Using survey responses to address positive and normative uncertainties in climate-economic models," Climatic Change, Springer, vol. 162(2), pages 213-232, September.
    25. Cooke, Roger M. & ElSaadany, Susie & Huang, Xinzheng, 2008. "On the performance of social network and likelihood-based expert weighting schemes," Reliability Engineering and System Safety, Elsevier, vol. 93(5), pages 745-756.
    26. Li, Qingran & Pizer, William A., 2021. "Use of the consumption discount rate for public policy over the distant future," Journal of Environmental Economics and Management, Elsevier, vol. 107(C).
    27. Michael Schauer, 1995. "Estimation of the greenhouse gas externality with uncertainty," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 5(1), pages 71-82, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peter H. Howard & Thomas Sterner, 2017. "Few and Not So Far Between: A Meta-analysis of Climate Damage Estimates," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(1), pages 197-225, September.
    2. Tol, Richard S.J., 2019. "A social cost of carbon for (almost) every country," Energy Economics, Elsevier, vol. 83(C), pages 555-566.
    3. Howard, Peter & Sterner, Thomas, 2014. "Loaded DICE: Refining the Meta-analysis Approach to Calibrating Climate Damage Functions," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 169952, Agricultural and Applied Economics Association.
    4. Tol, Richard S.J., 2013. "Targets for global climate policy: An overview," Journal of Economic Dynamics and Control, Elsevier, vol. 37(5), pages 911-928.
    5. Gerard Meijden & Frederick Ploeg & Cees Withagen, 2017. "Frontiers of Climate Change Economics," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 68(1), pages 1-14, September.
    6. Stephen Keen & Timothy M. Lenton & Antoine Godin & Devrim Yilmaz & Matheus Grasselli & Timothy J. Garrett, 2021. "Economists' erroneous estimates of damages from climate change," Papers 2108.07847, arXiv.org.
    7. Richard S.J. Tol, 2021. "Estimates of the social cost of carbon have not changed over time," Working Paper Series 0821, Department of Economics, University of Sussex Business School.
    8. Richard S. J. Tol, 2021. "Estimates of the social cost of carbon have increased over time," Papers 2105.03656, arXiv.org, revised Aug 2022.
    9. Peter Harrison Howard & Derek Sylvan, 2020. "Wisdom of the experts: Using survey responses to address positive and normative uncertainties in climate-economic models," Climatic Change, Springer, vol. 162(2), pages 213-232, September.
    10. Richard S J Tol, 2018. "The Economic Impacts of Climate Change," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 12(1), pages 4-25.
    11. Newell, Richard G. & Prest, Brian C. & Sexton, Steven E., 2021. "The GDP-Temperature relationship: Implications for climate change damages," Journal of Environmental Economics and Management, Elsevier, vol. 108(C).
    12. Richard S.J. Tol, 2018. "The impact of climate change and the social cost of carbon," Working Paper Series 1318, Department of Economics, University of Sussex Business School.
    13. Joaquín Bernal-Ramírez & Jair Ojeda-Joya & Camila Agudelo-Rivera & Felipe Clavijo-Ramírez & Carolina Durana-Ángel & Clark Granger-Castaño & Daniel Osorio-Rodríguez & Daniel Parra-Amado & José Pulido &, 2022. "Impacto macroeconómico del cambio climático en Colombia," Revista ESPE - Ensayos sobre Política Económica, Banco de la Republica de Colombia, issue 102, pages 1-62, July.
    14. Kahn, Matthew E. & Mohaddes, Kamiar & Ng, Ryan N.C. & Pesaran, M. Hashem & Raissi, Mehdi & Yang, Jui-Chung, 2021. "Long-term macroeconomic effects of climate change: A cross-country analysis," Energy Economics, Elsevier, vol. 104(C).
    15. Richard Tol, 2015. "Bootstraps for Meta-Analysis with an Application to the Impact of Climate Change," Computational Economics, Springer;Society for Computational Economics, vol. 46(2), pages 287-303, August.
    16. Lamperti, F. & Dosi, G. & Napoletano, M. & Roventini, A. & Sapio, A., 2018. "Faraway, So Close: Coupled Climate and Economic Dynamics in an Agent-based Integrated Assessment Model," Ecological Economics, Elsevier, vol. 150(C), pages 315-339.
    17. Tsigaris, Panagiotis & Wood, Joel, 2019. "The potential impacts of climate change on capital in the 21st century," Ecological Economics, Elsevier, vol. 162(C), pages 74-86.
    18. repec:hal:spmain:info:hdl:2441/4hs7liq1f49gh9chdf7r17gam6 is not listed on IDEAS
    19. Mongelli, Francesco Paolo & Pointner, Wolfgang & van den End, Jan Willem, 2022. "The effects of climate change on the natural rate of interest: a critical survey," Working Paper Series 2744, European Central Bank.
    20. Richard Tol, 2012. "On the Uncertainty About the Total Economic Impact of Climate Change," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 53(1), pages 97-116, September.
    21. Howard, Peter & Sterner, Thomas, 2014. "Raising the Temperature on Food Prices: Climate Change, Food Security, and the Social Cost of Carbon," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 170648, Agricultural and Applied Economics Association.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rff:dpaper:dp-22-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Resources for the Future (email available below). General contact details of provider: https://edirc.repec.org/data/rffffus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.