IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_1576.html
   My bibliography  Save this paper

Generalized Stochastic Gradient Learning

Author

Listed:
  • George W. Evans
  • Seppo Honkapohja
  • Noah Williams

Abstract

We study the properties of generalized stochastic gradient (GSG) learning in forward-looking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both differ from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity.

Suggested Citation

  • George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," CESifo Working Paper Series 1576, CESifo.
    • Handle: RePEc:ces:ceswps:_1576
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp1576.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. George W. Evans & Seppo Honkapohja, 2003. "Expectations and the Stability Problem for Optimal Monetary Policies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(4), pages 807-824.
    2. Evans, George W. & Honkapohja, S., 1998. "Stochastic gradient learning in the cobweb model," Economics Letters, Elsevier, vol. 61(3), pages 333-337, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mele, Antonio & Molnár, Krisztina & Santoro, Sergio, 2020. "On the perils of stabilizing prices when agents are learning," Journal of Monetary Economics, Elsevier, vol. 115(C), pages 339-353.
    2. Seppo Honkapohja & Kaushik Mitra, 2006. "Learning Stability in Economies with Heterogeneous Agents," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 9(2), pages 284-309, April.
    3. Michael Woodford, 2010. "Robustly Optimal Monetary Policy with Near-Rational Expectations," American Economic Review, American Economic Association, vol. 100(1), pages 274-303, March.
    4. Atanas Christev, 2006. "Learning Hyperinflations," Computing in Economics and Finance 2006 475, Society for Computational Economics.
    5. Giuseppe Ferrero, 2004. "Monetary Policy and the Transition to Rational Expectations," Econometric Society 2004 North American Summer Meetings 101, Econometric Society.
    6. repec:zbw:bofrdp:2007_032 is not listed on IDEAS
    7. Stefano Eusepi & Bruce Preston, 2008. "Stabilizing Expectations under Monetary and Fiscal Policy Coordination," NBER Working Papers 14391, National Bureau of Economic Research, Inc.
    8. George W. Evans & Seppo Honkapohja, 2009. "Robust Learning Stability with Operational Monetary Policy Rules," Central Banking, Analysis, and Economic Policies Book Series, in: Klaus Schmidt-Hebbel & Carl E. Walsh & Norman Loayza (Series Editor) & Klaus Schmidt-Hebbel (Series (ed.),Monetary Policy under Uncertainty and Learning, edition 1, volume 13, chapter 5, pages 145-170, Central Bank of Chile.
    9. Hommes, Cars & Zhu, Mei, 2014. "Behavioral learning equilibria," Journal of Economic Theory, Elsevier, vol. 150(C), pages 778-814.
    10. Francesco Bianchi & Leonardo Melosi, 2018. "Constrained Discretion and Central Bank Transparency," The Review of Economics and Statistics, MIT Press, vol. 100(1), pages 187-202, March.
    11. William Branch & George Evans, 2011. "Monetary policy and heterogeneous expectations," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 365-393, June.
    12. Bullard, James & Mitra, Kaushik, 2002. "Learning about monetary policy rules," Journal of Monetary Economics, Elsevier, vol. 49(6), pages 1105-1129, September.
    13. Mikael Bask, 2009. "Optimal monetary policy under heterogeneity in currency trade," Journal of Financial Economic Policy, Emerald Group Publishing, vol. 1(4), pages 338-354, November.
    14. Alejandro Justiniano & Giorgio E. Primiceri & Andrea Tambalotti, 2013. "The Effects of the Saving and Banking Glut on the U.S. Economy," NBER Chapters, in: NBER International Seminar on Macroeconomics 2013, pages 52-67, National Bureau of Economic Research, Inc.
    15. George W. Evans & Seppo Honkapohja & Kaushik Mitra, 2012. "Does Ricardian Equivalence Hold When Expectations Are Not Rational?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1259-1283, October.
    16. James Bullard & Eric Schaling, 2009. "Monetary Policy, Determinacy, and Learnability in a Two‐Block World Economy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(8), pages 1585-1612, December.
    17. Michael Woodford, 2013. "Macroeconomic Analysis Without the Rational Expectations Hypothesis," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 303-346, May.
    18. Goyal, Ashima & Tripathi, Shruti, 2014. "Stability and Transitions in Emerging Market Policy Rules," Indian Economic Review, Department of Economics, Delhi School of Economics, vol. 49(2), pages 153-172.
    19. Berardi, Michele & Duffy, John, 2007. "The value of central bank transparency when agents are learning," European Journal of Political Economy, Elsevier, vol. 23(1), pages 9-29, March.
    20. Honkapohja, Seppo & Mitra, Kaushik, 2004. "Are non-fundamental equilibria learnable in models of monetary policy?," Journal of Monetary Economics, Elsevier, vol. 51(8), pages 1743-1770, November.
    21. Adam, Klaus & Marcet, Albert, 2011. "Internal rationality, imperfect market knowledge and asset prices," Journal of Economic Theory, Elsevier, vol. 146(3), pages 1224-1252, May.

    More about this item

    Keywords

    adaptive learning; E-stability; recursive least squares; robust estimation;
    All these keywords.

    JEL classification:

    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • E10 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - General
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_1576. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.