IDEAS home Printed from https://ideas.repec.org/a/eee/ecolec/v226y2024ics0921800924002490.html

Comparing advice on climate policy between academic experts and ChatGPT

Author

Listed:
  • Salekpay, Foroogh
  • van den Bergh, Jeroen
  • Savin, Ivan

Abstract

We compare the results from a recent global expert survey on climate policy with answers to the same survey by the online artificial-intelligence chatbot ChatGPT. Such a study is timely and relevant as many people around the world are likely to use ChatGPT and similar language models to inquire about climate solutions, which in turn might influence public opinion. The comparison provides insights about performance criteria, policy instruments, and use of information from distinct academic disciplines. With a few exceptions, responses by ChatGPT are informative and of high quality. We find that ChatGPT answers questions with less bias than experts from various scientific disciplines. The latter may also be a disadvantage as it seems to weight all the information available equally without accounting well for relevance, which arguably may require human rather than artificial intelligence. On the other hand, experts from distinct disciplines show difference in average responses, with some even expressing opinions inconsistent with objective evidence, meaning there is no consistent and unbiased expert opinion on climate policy. As a new way of synthesizing large amounts of academic and grey literature, ChatGPT can serve policymaking. However, since the procedure that it follows for collecting and summarizing information remains a black box, it is best regarded as a complement rather than a substitute to traditional literature reviews and expert surveys.

Suggested Citation

  • Salekpay, Foroogh & van den Bergh, Jeroen & Savin, Ivan, 2024. "Comparing advice on climate policy between academic experts and ChatGPT," Ecological Economics, Elsevier, vol. 226(C).
    • Handle: RePEc:eee:ecolec:v:226:y:2024:i:c:s0921800924002490
    DOI: 10.1016/j.ecolecon.2024.108352
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0921800924002490
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ecolecon.2024.108352?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Antoine Dechezleprêtre & Adrien Fabre & Tobias Kruse & Bluebery Planterose & Ana Sanchez Chico & Stefanie Stantcheva, 2025. "Fighting Climate Change: International Attitudes toward Climate Policies," American Economic Review, American Economic Association, vol. 115(4), pages 1258-1300, April.
    2. Lüdering Jochen & Winker Peter, 2016. "Forward or Backward Looking? The Economic Discourse and the Observed Reality," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(4), pages 483-515, August.
    3. Lewis C. King & Ivan Savin & Stefan Drews, 2023. "Shades of green growth scepticism among climate policy researchers," Nature Sustainability, Nature, vol. 6(11), pages 1316-1320, November.
    4. Gugler, Klaus & Haxhimusa, Adhurim & Liebensteiner, Mario, 2021. "Effectiveness of climate policies: Carbon pricing vs. subsidizing renewables," Journal of Environmental Economics and Management, Elsevier, vol. 106(C).
    5. Andrea Baranzini & Jeroen C. J. M. van den Bergh & Stefano Carattini & Richard B. Howarth & Emilio Padilla & Jordi Roca, 2017. "Carbon pricing in climate policy: seven reasons, complementary instruments, and political economy considerations," Wiley Interdisciplinary Reviews: Climate Change, John Wiley & Sons, vol. 8(4), July.
    6. Drews, Stefan & Savin, Ivan & van den Bergh, Jeroen, 2024. "A Global Survey of Scientific Consensus and Controversy on Instruments of Climate Policy," Ecological Economics, Elsevier, vol. 218(C).
    7. Peter Andre & Teodora Boneva & Felix Chopra & Armin Falk, 2024. "Globally representative evidence on the actual and perceived support for climate action," Nature Climate Change, Nature, vol. 14(3), pages 253-259, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bretter, Christian & Schulz, Felix, 2025. "Public support for climate policies and its ideological predictors across countries of the Global North and Global South," Ecological Economics, Elsevier, vol. 233(C).
    2. Goerg, Sebastian & Pondorfer, Andreas & Stöhr, Valentina, 2025. "Public support for more ambitious climate policies: Empirical evidence from Germany," Ecological Economics, Elsevier, vol. 231(C).
    3. Till Köveker & Fernanda Ballesteros & Franziska Klaucke & Antonia Kurz & Karsten Neuhoff & Paula Niemöller & Sangeeth Selvaraju, 2025. "Industry Transition to Climate Neutrality: Comparing Policy Approaches in Times of Geopolitical Fragmentation," Discussion Papers of DIW Berlin 2114, DIW Berlin, German Institute for Economic Research.
    4. Georgarakos, Dimitris & Kenny, Geoff & Meyer, Justus & van Rooij, Maarten, 2025. "How do rising temperatures affect inflation expectations?," Working Paper Series 3132, European Central Bank.
    5. Landon Yoder & Alora Cain & Ananya Rao & Nathaniel Geiger & Ben Kravitz & Mack Mercer & Deidra Miniard & Sangeet Nepal & Thomas Nunn & Mary Sluder & Grace Weiler & Shahzeen Z. Attari, 2024. "Muddling through Climate Change: A Qualitative Exploration of India and U.S. Climate Experts’ Perspectives on Solutions, Pathways, and Barriers," Sustainability, MDPI, vol. 16(13), pages 1-20, June.
    6. repec:ces:ceswps:_12258 is not listed on IDEAS
    7. Jakub Sokołowski & Piotr Lewandowski & Jan Frankowski, 2023. "How to Prevent Yellow Vests? Evaluating Preferences for a Carbon Tax with a Discrete Choice Experiment," IBS Working Papers 03/2023, Instytut Badan Strukturalnych.
    8. Zwetelina Iliewa & Elisabeth Kempf & Oliver Spalt, 2025. "Corporate Actions as Moral Issues," CESifo Working Paper Series 11854, CESifo.
    9. Wu, Huihuang & Zhou, Yuhan & Wang, Xian & Hu, Xiurong & Zhang, Shihui & Ren, Yang & Liu, Junfeng & Liu, Ying & Tao, Shu, 2024. "The climate, health, and economic outcomes across different carbon pricing policies to achieve China's climate goals," Applied Energy, Elsevier, vol. 368(C).
    10. Nauro Campos & Flavia Ginefra & Angelo Martelli & Alessio Terzi & Nauro F. Campos, 2026. "Institutions and Climate Change," CESifo Working Paper Series 12490, CESifo.
    11. Tello, Witson Peña, 2025. "Policy interactions and electricity generation sector CO2 emissions: A quasi-experimental analysis," Energy Policy, Elsevier, vol. 198(C).
    12. Zwetelina Iliewa & Elisabeth Kempf & Oliver Spalt, 2025. "Corporate Actions as Moral Issues," CRC TR 224 Discussion Paper Series crctr224_2025_649v2, University of Bonn and University of Mannheim, Germany, revised Apr 2025.
    13. Jiang, Pansong & Zha, Donglan & Yang, Guanglei & Xia, Dan, 2024. "Which decarbonization policy mixes are better for China's power sector? A simulation balancing aggregate abatement effects and economic impacts," Energy Economics, Elsevier, vol. 139(C).
    14. Fong, Joelle H. & Ba, Yuhao & Chen, Zhe, 2025. "Who supports carbon pricing? Older adults’ financial literacy and attitudes toward carbon taxation," The Journal of the Economics of Ageing, Elsevier, vol. 32(C).
    15. Andreassen, Gøril L. & Kallbekken, Steffen & Rosendahl, Knut Einar, 2024. "Can policy packaging help overcome Pigouvian tax aversion? A lab experiment on combining taxes and subsidies," Journal of Environmental Economics and Management, Elsevier, vol. 127(C).
    16. Frikk Nesje & Robert C. Schmidt & Moritz A. Drupp, 2025. "Designing Carbon Pricing Policies Across the Globe," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 88(12), pages 3585-3616, December.
    17. Hoyle, Aaron & Rhodes, Ekaterina, 2025. "Explaining public support for net-zero climate policy instruments: Perceptions of distributive fairness under competing frames," Energy Policy, Elsevier, vol. 203(C).
    18. Drews, Stefan, 2025. "Towards systems-oriented behavioral ecological economics," Ecological Economics, Elsevier, vol. 227(C).
    19. Eckert, Linus & Stagl, Sigrid & Schemel, Benjamin, 2025. "Social acceptance of climate policies: Insights from Austria," Ecological Economics, Elsevier, vol. 237(C).
    20. Adrien Fabre & Thomas Douenne & Linus Mattauch, 2025. "Majority support for global redistributive and climate policies," Nature Human Behaviour, Nature, vol. 9(8), pages 1583-1594, August.
    21. Silvi, Mariateresa & Padilla Rosa, Emilio, 2023. "A tragedy of the horizons? An intertemporal perspective on public support for carbon taxes," Energy Economics, Elsevier, vol. 125(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolec:v:226:y:2024:i:c:s0921800924002490. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolecon .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.