IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.05383.html

Can AI Refute Economic Theory? Evidence from Beyond the Knowledge Cutoff

Author

Listed:
  • Alexis Akira Toda

Abstract

Can artificial intelligence (AI) refute economic theory? I document experiments in which I asked several AI models (Gemini, Refine, Claude, and ChatGPT) to check the correctness of four published papers in economic theory, each containing an error that I helped identify or correct. ChatGPT Pro performed best, occasionally constructing counterexamples and corrected proofs, while other models fared worse. However, no model located a true error without substantial human guidance, and data contamination complicates interpretation. I argue that a competent human paired with a frontier model can outperform current peer review, but AI cannot yet refute economic theory on its own.

Suggested Citation

  • Alexis Akira Toda, 2026. "Can AI Refute Economic Theory? Evidence from Beyond the Knowledge Cutoff," Papers 2606.05383, arXiv.org.
    • Handle: RePEc:arx:papers:2606.05383
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.05383
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jianjun Miao & Pengfei Wang, 2018. "Asset Bubbles and Credit Constraints," American Economic Review, American Economic Association, vol. 108(9), pages 2590-2628, September.
    2. Christoph Siemroth, 2024. "Economics Peer-Review: Problems, Recent Developments, and Reform Proposals," The American Economist, Sage Publications, vol. 69(2), pages 241-258, October.
    3. Kocherlakota, Narayana R., 1992. "Bubbles and constraints on debt accumulation," Journal of Economic Theory, Elsevier, vol. 57(1), pages 245-256.
    4. Stachurski, John & Toda, Alexis Akira, 2019. "An impossibility theorem for wealth in heterogeneous-agent models with limited heterogeneity," Journal of Economic Theory, Elsevier, vol. 182(C), pages 1-24.
    5. Ofer H. Azar, 2006. "The Academic Review Process: How Can We Make it More Efficient?," The American Economist, Sage Publications, vol. 50(1), pages 37-50, March.
    6. Tirole, Jean, 1985. "Asset Bubbles and Overlapping Generations," Econometrica, Econometric Society, vol. 53(6), pages 1499-1528, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raurich, Xavier & Seegmuller, Thomas, 2019. "On the interplay between speculative bubbles and productive investment," European Economic Review, Elsevier, vol. 111(C), pages 400-420.
    2. Hirano, Tomohiro & Toda, Alexis Akira, 2024. "Bubble economics," Journal of Mathematical Economics, Elsevier, vol. 111(C).
    3. Nina Biljanovska & Alexandros Vardoulakis & Lucyna Gornicka, 2019. "Optimal Macroprudential Policy and Asset Price Bubbles," 2019 Meeting Papers 663, Society for Economic Dynamics.
    4. Guimaraes, Bernardo & Pannella, Pierluca, 2024. "Short-covering bubbles," Journal of Economic Theory, Elsevier, vol. 219(C).
    5. Pham, Ngoc Sang & Le Van, Cuong & Bosi, Stefano, 2025. "To Bubble or Not to Bubble: Asset Price Dynamics and Optimality in OLG Economies," MPRA Paper 125605, University Library of Munich, Germany.
    6. Stefano Bosi & Cuong Le Van & Ngoc-Sang Pham, 2025. "To Bubble or Not to Bubble: Asset Price Dynamics and Optimality in OLG Economies," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-05199274, HAL.
    7. Bonchi, Jacopo & Nisticò, Salvatore, 2024. "Optimal monetary policy and rational asset bubbles," European Economic Review, Elsevier, vol. 170(C).
    8. Jianjun Miao & Pengfei Wang & Jing Zhou, 2022. "Asset Bubbles and Foreign Interest Rate Shocks," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 44, pages 315-348, April.
    9. Michau, Jean-Baptiste & Ono, Yoshiyasu & Schlegl, Matthias, 2023. "Wealth preference and rational bubbles," European Economic Review, Elsevier, vol. 156(C).
    10. Bosi, Stefano & Le Van, Cuong & Pham, Ngoc-Sang, 2022. "Real indeterminacy and dynamics of asset price bubbles in general equilibrium," Journal of Mathematical Economics, Elsevier, vol. 100(C).
    11. repec:ejw:journl:v:22:y:2025:i:1:p:1-17 is not listed on IDEAS
    12. Jacopo Bonchi & Salvatore Nisticò, 2022. "Heterogeneity, Bubbles and Monetary Policy," Working Papers 5/22, Sapienza University of Rome, DISS.
    13. Raurich, Xavier & Seegmuller, Thomas, 2022. "Income Distribution By Age Group And Productive Bubbles," Macroeconomic Dynamics, Cambridge University Press, vol. 26(3), pages 769-799, April.
    14. Feng Dong & Yang Jiao & Haoning Sun, 2024. "Bubbly Booms and Welfare," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 53, pages 71-122, July.
    15. Hori, Takeo & Im, Ryonghun, 2023. "Asset bubbles, entrepreneurial risks, and economic growth," Journal of Economic Theory, Elsevier, vol. 210(C).
    16. repec:hal:wpaper:halshs-02993656 is not listed on IDEAS
    17. Hirano, Tomohiro & Inaba, Masaru & Yanagawa, Noriyuki, 2015. "Asset bubbles and bailouts," Journal of Monetary Economics, Elsevier, vol. 76(S), pages 71-89.
    18. Bosi, Stefano & Van, Cuong Le & Pham, Ngoc-Sang, 2018. "Intertemporal equilibrium with heterogeneous agents, endogenous dividends and collateral constraints," Journal of Mathematical Economics, Elsevier, vol. 76(C), pages 1-20.
    19. Robert Becker & Stefano Bosi & Cuong Van & Thomas Seegmuller, 2015. "On existence and bubbles of Ramsey equilibrium with borrowing constraints," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 58(2), pages 329-353, February.
    20. Stefano Bosi & Cuong Le Van & Ngoc-Sang Pham, 2017. "Rational Land and Housing Bubbles in Infinite-Horizon Economies," Studies in Economic Theory, in: Kazuo Nishimura & Alain Venditti & Nicholas C. Yannelis (ed.), Sunspots and Non-Linear Dynamics, chapter 0, pages 203-230, Springer.
    21. Han, Jungsuk & Wang, Yenan, 2025. "All that glitters: A theory of multiple bubbles with implications for cryptocurrencies," Journal of Monetary Economics, Elsevier, vol. 152(C).
    22. Marco Airaudo, 2017. "Complex stock price dynamics under Max Weber’s spirit of capitalism hypothesis," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 64(1), pages 47-73, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.05383. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.