IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2110.02474.html
   My bibliography  Save this paper

Can an AI agent hit a moving target?

Author

Listed:
  • Rui

    (Aruhan)

  • Shi

Abstract

I model the belief formation and decision making processes of economic agents during a monetary policy regime change (an acceleration in the money supply) with a deep reinforcement learning algorithm in the AI literature. I show that when the money supply accelerates, the learning agents only adjust their actions, which include consumption and demand for real balance, after gathering learning experience for many periods. This delayed adjustments leads to low returns during transition periods. Once they start adjusting to the new environment, their welfare improves. Their changes in beliefs and actions lead to temporary inflation volatility. I also show that, 1. the AI agents who explores their environment more adapt to the policy regime change quicker, which leads to welfare improvements and less inflation volatility, and 2. the AI agents who have experienced a structural change adjust their beliefs and behaviours quicker than an inexperienced learning agent.

Suggested Citation

  • Rui & Shi, 2021. "Can an AI agent hit a moving target?," Papers 2110.02474, arXiv.org, revised Oct 2022.
  • Handle: RePEc:arx:papers:2110.02474
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2110.02474
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    2. Ball, Laurence & Gregory Mankiw, N. & Reis, Ricardo, 2005. "Monetary policy for inattentive economies," Journal of Monetary Economics, Elsevier, vol. 52(4), pages 703-725, May.
    3. Ulrike Malmendier & Stefan Nagel, 2016. "Learning from Inflation Experiences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(1), pages 53-87.
    4. Michael Woodford, 2001. "Imperfect Common Knowledge and the Effects of Monetary Policy," NBER Working Papers 8673, National Bureau of Economic Research, Inc.
    5. Lucas, Robert Jr., 1972. "Expectations and the neutrality of money," Journal of Economic Theory, Elsevier, vol. 4(2), pages 103-124, April.
    6. Milton Friedman, 1957. "Introduction to "A Theory of the Consumption Function"," NBER Chapters, in: A Theory of the Consumption Function, pages 1-6, National Bureau of Economic Research, Inc.
    7. Sargent, Thomas J, 1971. "A Note on the 'Accelerationist' Controversy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 3(3), pages 721-725, August.
    8. Mingli Chen & Andreas Joseph & Michael Kumhof & Xinlei Pan & Xuan Zhou, 2021. "Deep Reinforcement Learning in a Monetary Model," Papers 2104.09368, arXiv.org, revised Jan 2023.
    9. Marco Airaudo & Ina Hajdini, 2021. "Consistent Expectations Equilibria In Markov Regime Switching Models And Inflation Dynamics," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 62(4), pages 1401-1430, November.
    10. Milton Friedman, 1957. "A Theory of the Consumption Function," NBER Books, National Bureau of Economic Research, Inc, number frie57-1, May.
    11. Rui (Aruhan) Shi, 2021. "Learning from Zero: How to Make Consumption-Saving Decisions in a Stochastic Environment with an AI Algorithm," CESifo Working Paper Series 9255, CESifo.
    12. Frank Schorfheide, 2005. "Learning and Monetary Policy Shifts," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 392-419, April.
    13. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    14. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    15. J. B. Taylor & M. Woodford (ed.), 1999. "Handbook of Macroeconomics," Handbook of Macroeconomics, Elsevier, edition 1, volume 1, number 1.
    16. Sargent, Thomas J & Wallace, Neil, 1973. "Rational Expectations and the Dynamics of Hyperinflation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 14(2), pages 328-350, June.
    17. Alberto Cavallo & Guillermo Cruces & Ricardo Perez-Truglia, 2017. "Inflation Expectations, Learning, and Supermarket Prices: Evidence from Survey Experiments," American Economic Journal: Macroeconomics, American Economic Association, vol. 9(3), pages 1-35, July.
    18. Sargent, Thomas J., 1993. "Bounded Rationality in Macroeconomics: The Arne Ryde Memorial Lectures," OUP Catalogue, Oxford University Press, number 9780198288695.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kuehnlenz, Sophia & Orsi, Bianca & Kaltenbrunner, Annina, 2023. "Central bank digital currencies and the international payment system: The demise of the US dollar?," Research in International Business and Finance, Elsevier, vol. 64(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerunov, Anton, 2014. "Критичен Преглед На Основните Подходи За Моделиране На Икономическите Очаквания [A Critical Review of Major Approaches for Modeling Economic Expectations]," MPRA Paper 68797, University Library of Munich, Germany.
    2. Thorvardur Tjörvi Ólafsson, 2006. "The New Keynesian Phillips Curve: In Search of Improvements and Adaptation to the Open Economy," Economics wp31_tjorvi, Department of Economics, Central bank of Iceland.
    3. Gbaguidi, David, 2012. "La courbe de Phillips : temps d’arbitrage et/ou arbitrage de temps," L'Actualité Economique, Société Canadienne de Science Economique, vol. 88(1), pages 87-119, mars.
    4. Link, Sebastian & Peichl, Andreas & Roth, Christopher & Wohlfart, Johannes, 2023. "Information frictions among firms and households," Journal of Monetary Economics, Elsevier, vol. 135(C), pages 99-115.
    5. Aurélien Goutsmedt & Erich Pinzon-Fuchs & Matthieu Renault & Francesco Sergi, 2015. "Criticizing the Lucas Critique: Macroeconometricians' Response to Robert Lucas," Post-Print halshs-01179114, HAL.
    6. Kenza Benhima & Isabella Blengini, 2020. "Optimal Monetary Policy when Information is Market-Generated," The Economic Journal, Royal Economic Society, vol. 130(628), pages 956-975.
    7. Andrew G. Haldane & Arthur E. Turrell, 2019. "Drawing on different disciplines: macroeconomic agent-based models," Journal of Evolutionary Economics, Springer, vol. 29(1), pages 39-66, March.
    8. Ou, Shengliang & Zhang, Donghai & Zhang, Renbin, 2021. "Information frictions, monetary policy, and the paradox of price flexibility," Journal of Monetary Economics, Elsevier, vol. 120(C), pages 70-82.
    9. Andreas Fuster & Ricardo Perez-Truglia & Mirko Wiederholt & Basit Zafar, 2022. "Expectations with Endogenous Information Acquisition: An Experimental Investigation," The Review of Economics and Statistics, MIT Press, vol. 104(5), pages 1059-1078, December.
    10. Fabio Milani, 2012. "The Modeling of Expectations in Empirical DSGE Models: A Survey," Advances in Econometrics, in: DSGE Models in Macroeconomics: Estimation, Evaluation, and New Developments, pages 3-38, Emerald Group Publishing Limited.
    11. Ricardo Reis, 2006. "Inattentive Producers," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(3), pages 793-821.
    12. Lena Draeger & Michael J. Lamla, 2013. "Imperfect information and inflation expectations," KOF Working papers 13-329, KOF Swiss Economic Institute, ETH Zurich.
    13. Yulei Luo, 2008. "Consumption Dynamics under Information Processing Constraints," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 11(2), pages 366-385, April.
    14. Christian Hellwig, "undated". "Monetary Business Cycle Models: Imperfect Information (Review Article, March 2006)," UCLA Economics Online Papers 377, UCLA Department of Economics.
    15. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    16. Jess Diamond & Kota Watanabe & Tsutomu Watanabe, 2016. "The Formation of Consumer Inflation Expectations: New Evidence From Japan's Deflation Experience," CARF F-Series CARF-F-388, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    17. Lena Dräger & Michael J. Lamla, 2017. "Imperfect Information and Consumer Inflation Expectations: Evidence from Microdata," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(6), pages 933-968, December.
    18. Fiechter, Chad & Kuethe, Todd & Zhang, Wendong, 2023. "Information Rigidities and Farmland Value Expectations," ISU General Staff Papers 202306131414240000, Iowa State University, Department of Economics.
    19. Rui (Aruhan) Shi, 2021. "Learning from Zero: How to Make Consumption-Saving Decisions in a Stochastic Environment with an AI Algorithm," CESifo Working Paper Series 9255, CESifo.
    20. Lena Dräger & Michael Lamla, 2013. "Imperfect Information and Inflation Expectations: Evidence from Microdata," Macroeconomics and Finance Series 201301, University of Hamburg, Department of Socioeconomics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2110.02474. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.