IDEAS home Printed from https://ideas.repec.org/p/nbr/nberte/0317.html

Generalized Stochastic Gradient Learning

Author

Listed:
  • George W. Evans
  • Seppo Honkapohja
  • Noah Williams

Abstract

We study the properties of generalized stochastic gradient (GSG) learning in forward-looking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both differ from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity.

Suggested Citation

  • George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," NBER Technical Working Papers 0317, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberte:0317
    Note: TWP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/t0317.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. George W. Evans & Seppo Honkapohja, 2003. "Expectations and the Stability Problem for Optimal Monetary Policies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(4), pages 807-824.
    2. Evans, George W. & Honkapohja, S., 1998. "Stochastic gradient learning in the cobweb model," Economics Letters, Elsevier, vol. 61(3), pages 333-337, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mele, Antonio & Molnár, Krisztina & Santoro, Sergio, 2020. "On the perils of stabilizing prices when agents are learning," Journal of Monetary Economics, Elsevier, vol. 115(C), pages 339-353.
    2. Seppo Honkapohja & Kaushik Mitra, 2006. "Learning Stability in Economies with Heterogeneous Agents," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 9(2), pages 284-309, April.
    3. Atanas Christev, 2006. "Learning Hyperinflations," Computing in Economics and Finance 2006 475, Society for Computational Economics.
    4. Giuseppe Ferrero, 2004. "Monetary Policy and the Transition to Rational Expectations," Econometric Society 2004 North American Summer Meetings 101, Econometric Society.
    5. Stefano Eusepi & Bruce Preston, 2008. "Stabilizing Expectations under Monetary and Fiscal Policy Coordination," NBER Working Papers 14391, National Bureau of Economic Research, Inc.
    6. Bullard, James & Mitra, Kaushik, 2002. "Learning about monetary policy rules," Journal of Monetary Economics, Elsevier, vol. 49(6), pages 1105-1129, September.
    7. Mikael Bask, 2009. "Optimal monetary policy under heterogeneity in currency trade," Journal of Financial Economic Policy, Emerald Group Publishing, vol. 1(4), pages 338-354, November.
    8. Michael Woodford, 2013. "Macroeconomic Analysis Without the Rational Expectations Hypothesis," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 303-346, May.
    9. Berardi, Michele & Duffy, John, 2007. "The value of central bank transparency when agents are learning," European Journal of Political Economy, Elsevier, vol. 23(1), pages 9-29, March.
    10. Gauthier, Stephane, 2002. "Determinacy and Stability under Learning of Rational Expectations Equilibria," Journal of Economic Theory, Elsevier, vol. 102(2), pages 354-374, February.
    11. Jonathan J Adams, 2024. "Optimal Policy Without Rational Expectations: A Sufficient Statistic Solution," Working Papers 001011, University of Florida, Department of Economics.
    12. Kurz, Mordecai & Piccillo, Giulia & Wu, Howei, 2013. "Modeling diverse expectations in an aggregated New Keynesian Model," Journal of Economic Dynamics and Control, Elsevier, vol. 37(8), pages 1403-1433.
    13. Bask, Mikael & Proaño, Christian R., 2016. "Optimal monetary policy under learning and structural uncertainty in a New Keynesian model with a cost channel and inflation inertia," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 112-126.
    14. Goy, Gavin & Hommes, Cars & Mavromatis, Kostas, 2022. "Forward guidance and the role of central bank credibility under heterogeneous beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 1240-1274.
    15. Stefano Eusepi, 2004. "Does Central Bank Transparency Matter for Economic Stability," Computing in Economics and Finance 2004 176, Society for Computational Economics.
    16. George W. Evans & Seppo Honkapohja, 2009. "Robust Learning Stability with Operational Monetary Policy Rules," Central Banking, Analysis, and Economic Policies Book Series, in: Klaus Schmidt-Hebbel & Carl E. Walsh & Norman Loayza (Series Editor) & Klaus Schmidt-Hebbel (Series (ed.),Monetary Policy under Uncertainty and Learning, edition 1, volume 13, chapter 5, pages 145-170, Central Bank of Chile.
    17. Evans, George W. & McGough, Bruce, 2005. "Monetary policy, indeterminacy and learning," Journal of Economic Dynamics and Control, Elsevier, vol. 29(11), pages 1809-1840, November.
    18. Séverine Menguy, 2016. "Optimal Discretionary Monetary Policy in A Potential Zero Lower Bound Framework," International Journal of Economics and Financial Research, Academic Research Publishing Group, vol. 2(6), pages 104-126, 06-2016.
    19. Caprioli, Francesco, 2015. "Optimal fiscal policy under learning," Journal of Economic Dynamics and Control, Elsevier, vol. 58(C), pages 101-124.
    20. Michele Berardi, 2015. "Expectations formation under adaptive learning and evolutionary dynamics," Centre for Growth and Business Cycle Research Discussion Paper Series 206, Economics, The University of Manchester.

    More about this item

    JEL classification:

    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • E10 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - General
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberte:0317. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.