IDEAS home Printed from https://ideas.repec.org/p/cam/camdae/0545.html
   My bibliography  Save this paper

Generalized Stochastic Gradient Learning

Author

Abstract

We study the properties of generalized stochastic gradient (GSG) learning in forwardlooking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both di1er from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity.

Suggested Citation

  • Evans, G.W. & Honkapohja ,S. & Williams, N., 2005. "Generalized Stochastic Gradient Learning," Cambridge Working Papers in Economics 0545, Faculty of Economics, University of Cambridge.
    • Handle: RePEc:cam:camdae:0545
    Note: Ma
    as

    Download full text from publisher

    File URL: http://www.econ.cam.ac.uk/research-files/repec/cam/pdf/cwpe0545.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. George W. Evans & Seppo Honkapohja, 2003. "Expectations and the Stability Problem for Optimal Monetary Policies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(4), pages 807-824.
    2. Evans, George W. & Honkapohja, S., 1998. "Stochastic gradient learning in the cobweb model," Economics Letters, Elsevier, vol. 61(3), pages 333-337, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mele, Antonio & Molnár, Krisztina & Santoro, Sergio, 2020. "On the perils of stabilizing prices when agents are learning," Journal of Monetary Economics, Elsevier, vol. 115(C), pages 339-353.
    2. Seppo Honkapohja & Kaushik Mitra, 2006. "Learning Stability in Economies with Heterogeneous Agents," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 9(2), pages 284-309, April.
    3. Atanas Christev, 2006. "Learning Hyperinflations," Computing in Economics and Finance 2006 475, Society for Computational Economics.
    4. Giuseppe Ferrero, 2004. "Monetary Policy and the Transition to Rational Expectations," Econometric Society 2004 North American Summer Meetings 101, Econometric Society.
    5. repec:zbw:bofrdp:2007_032 is not listed on IDEAS
    6. George W. Evans & Seppo Honkapohja, 2009. "Robust Learning Stability with Operational Monetary Policy Rules," Central Banking, Analysis, and Economic Policies Book Series, in: Klaus Schmidt-Hebbel & Carl E. Walsh & Norman Loayza (Series Editor) & Klaus Schmidt-Hebbel (Series (ed.),Monetary Policy under Uncertainty and Learning, edition 1, volume 13, chapter 5, pages 145-170, Central Bank of Chile.
    7. Hommes, Cars & Zhu, Mei, 2014. "Behavioral learning equilibria," Journal of Economic Theory, Elsevier, vol. 150(C), pages 778-814.
    8. William Branch & George Evans, 2011. "Monetary policy and heterogeneous expectations," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 365-393, June.
    9. Bullard, James & Mitra, Kaushik, 2002. "Learning about monetary policy rules," Journal of Monetary Economics, Elsevier, vol. 49(6), pages 1105-1129, September.
    10. James Bullard & Eric Schaling, 2009. "Monetary Policy, Determinacy, and Learnability in a Two‐Block World Economy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(8), pages 1585-1612, December.
    11. Michael Woodford, 2013. "Macroeconomic Analysis Without the Rational Expectations Hypothesis," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 303-346, May.
    12. Goyal, Ashima & Tripathi, Shruti, 2014. "Stability and Transitions in Emerging Market Policy Rules," Indian Economic Review, Department of Economics, Delhi School of Economics, vol. 49(2), pages 153-172.
    13. Berardi, Michele & Duffy, John, 2007. "The value of central bank transparency when agents are learning," European Journal of Political Economy, Elsevier, vol. 23(1), pages 9-29, March.
    14. Adam, Klaus & Marcet, Albert, 2011. "Internal rationality, imperfect market knowledge and asset prices," Journal of Economic Theory, Elsevier, vol. 146(3), pages 1224-1252, May.
    15. Gauthier, Stephane, 2002. "Determinacy and Stability under Learning of Rational Expectations Equilibria," Journal of Economic Theory, Elsevier, vol. 102(2), pages 354-374, February.
    16. James Bullard & Stefano Eusepi, 2005. "Did the Great Inflation Occur Despite Policymaker Commitment to a Taylor Rule?," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 324-359, April.
    17. Bask, Mikael & Proaño, Christian R., 2016. "Optimal monetary policy under learning and structural uncertainty in a New Keynesian model with a cost channel and inflation inertia," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 112-126.
    18. Goy, Gavin & Hommes, Cars & Mavromatis, Kostas, 2022. "Forward guidance and the role of central bank credibility under heterogeneous beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 1240-1274.
    19. Stefano Eusepi, 2004. "Does Central Bank Transparency Matter for Economic Stability," Computing in Economics and Finance 2004 176, Society for Computational Economics.
    20. Timothy Cogley & Christian Matthes & Argia M. Sbordone, 2011. "Optimal disinflation under learning," Staff Reports 524, Federal Reserve Bank of New York.
    21. George W. Evans & Seppo Honkapohja, 2009. "Robust Learning Stability with Operational Monetary Policy Rules," Central Banking, Analysis, and Economic Policies Book Series, in: Klaus Schmidt-Hebbel & Carl E. Walsh & Norman Loayza (Series Editor) & Klaus Schmidt-Hebbel (Series (ed.),Monetary Policy under Uncertainty and Learning, edition 1, volume 13, chapter 5, pages 145-170, Central Bank of Chile.

    More about this item

    Keywords

    adaptive learning; E-stability; recursive least squares; robust estimation;
    All these keywords.

    JEL classification:

    • C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
    • C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • E10 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - General
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cam:camdae:0545. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jake Dyer (email available below). General contact details of provider: https://www.econ.cam.ac.uk/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.