Generalized Stochastic Gradient Learning

This file is part of IDEAS, which uses RePEc data

Generalized Stochastic Gradient Learning

Author Info

George W. Evans ()
Seppo Honkapohja ()
Noah Williams ()

Additional information is available for the following registered author(s):

Abstract

We study the properties of generalized stochastic gradient (GSG) learning in forward-looking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both differ from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help file. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

Publisher Info
Paper provided by CESifo GmbH in its series CESifo Working Paper Series with number CESifo Working Paper No. 1576.

Download reference. The following formats are available: HTML, plain text, BibTeX, RIS (EndNote), ReDIF
Length:
Date of creation: 2005
Date of revision:
Handle: RePEc:ces:ceswps:_1576

Contact details of provider:
Postal: Poschingerstrasse 5, 81679 Munich
Phone: +49 (89) 9224-0
Fax: +49 (89) 985369
Web page: http://www.cesifo.de

For technical questions regarding this item, or to correct its listing, contact: (Julio Saavedra).

Other versions of this item:

Paper
- George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," NBER Technical Working Papers 0317, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
- Evans, G.W. & Honkapohja ,S. & Williams, N., 2005. "Generalized Stochastic Gradient Learning," Cambridge Working Papers in Economics 0545, Faculty of Economics, University of Cambridge. [Downloadable!]
- George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," University of Oregon Economics Department Working Papers 2005-17, University of Oregon Economics Department, revised 18 May 2008. [Downloadable!]

Find related papers by JEL classification:
C62 - Mathematical and Quantitative Methods - - Mathematical Methods and Programming - - - Existence and Stability Conditions of Equilibrium
C65 - Mathematical and Quantitative Methods - - Mathematical Methods and Programming - - - Miscellaneous Mathematical Tools
D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
E10 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - General
E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation

This paper has been announced in the following NEP Reports:

NEP-ALL-2005-12-09 (All new papers)
NEP-MAC-2005-12-09 (Macroeconomics)

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

George W. Evans & Seppo Honkapohja, 2003. "Expectations and the Stability Problem for Optimal Monetary Policies," Review of Economic Studies, Blackwell Publishing, vol. 70(4), pages 807-824, October. [Downloadable!] (restricted)
Other versions:
- Evans, George W. & Honkapohja, Seppo, 2000. "Expectations and the stability problem for optimal monetary policies," Discussion Paper Series 1: Economic Studies 2000,10, Deutsche Bundesbank, Research Centre. [Downloadable!]
- Evans, George W & Honkapohja, Seppo, 2001. "Expectations and the Stability Problem for Optimal Monetary Policies," CEPR Discussion Papers 2805, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
- George W. Evans & Seppo Honkapohja, 2001. "Expectations and the Stability Problem for Optimal Monetary Policies," University of Oregon Economics Department Working Papers 2001-6, University of Oregon Economics Department, revised 03 Aug 2001. [Downloadable!]
- Honkapohja, S. & Evans, G.W., 2000. "Expectations and the Stability Problem for Optimal Monetary Policies," University of Helsinki, Department of Economics 481, Department of Economics.

Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

Seppo Honkapohja & Kaushik Mitra, 2006. "Learning Stability in Economies with Heterogeneous Agents," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 9(2), pages 284-309, April. [Downloadable!] (restricted)
Other versions:
- Kaushik Mitra & Seppo Honkapohja, 2004. "Learning Stability in Economies with Heterogenous Agents," Royal Holloway, University of London: Discussion Papers in Economics 04/17, Department of Economics, Royal Holloway University of London, revised Jul 2004. [Downloadable!]
- Seppo Honkapohja & Kaushik Mitra, 2002. "Learning stability in economics with heterogenous agents," Working Paper Series 120, European Central Bank. [Downloadable!]
- Honkapohja, Seppo & Mitra, Kaushik, 2002. "Learning Stability in Economies with Heterogenous Agents," CESifo Working Paper Series CESifo Working Paper No. , CESifo GmbH. [Downloadable!]
Carceles-Poveda, Eva & Giannitsarou, Chryssi, 2006. "Adaptive Learning in Practice," CEPR Discussion Papers 5627, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
Other versions:
- Chryssi Giannitsarou & Eva Carceles-Poveda, 2004. "Adaptive Learning in Practice," Computing in Economics and Finance 2004 271, Society for Computational Economics.
- Carceles-Poveda, Eva & Giannitsarou, Chryssi, 2007. "Adaptive learning in practice," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2659-2697, August. [Downloadable!] (restricted)
Emiliano Santoro & Damjan Pfajfar, 2006. "Heterogeneity and learning in inflation expectation formation: an empirical assessment," Department of Economics Working Papers 0607, Department of Economics, University of Trento, Italia. [Downloadable!]
Sergey Slobodyan & Anna Bogomolova & Dmitri Kolyuzhnov, 2006. "Stochastic Gradient versus Recursive Least Squares Learning," Computing in Economics and Finance 2006 446, Society for Computational Economics. [Downloadable!]
James B. Bullard, 2006. "The learnability criterion and monetary policy," Review, Federal Reserve Bank of St. Louis, issue May, pages 203-217. [Downloadable!]
Sergey Slobodyan & Atanas Christev, 2006. "On learnability of Eâ€“stable equilibria," Computing in Economics and Finance 2006 451, Society for Computational Economics. [Downloadable!]

Statistics

Access and download statistics

Did you know? The most prolific authors have over 400 items listed on IDEAS.

This page was last updated on 2008-9-22.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.