Generalized Stochastic Gradient Learning
Abstract
We study the properties of generalized stochastic gradient (GSG) learning in forward-looking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both differ from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by National Bureau of Economic Research, Inc in its series NBER Technical Working Papers with number 0317.Length:
Date of creation: Oct 2005
Date of revision:
Handle: RePEc:nbr:nberte:0317
Note: TWP
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Phone: 617-868-3900
Email:
Web page: http://www.nber.org
More information through EDIRC
Related research
Keywords:Other versions of this item:
- George W. Evans & Seppo Honkapohja & Noah Williams, 2010. "Generalized Stochastic Gradient Learning," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 51(1), pages 237-262, 02.
- Evans, G.W. & Honkapohja ,S. & Williams, N., 2005. "Generalized Stochastic Gradient Learning," Cambridge Working Papers in Economics 0545, Faculty of Economics, University of Cambridge.
- George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," CESifo Working Paper Series 1576, CESifo Group Munich.
- George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," University of Oregon Economics Department Working Papers 2005-17, University of Oregon Economics Department, revised 18 May 2008.
- C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
- C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools
- D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
- E10 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - General
- E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2005-10-22 (All new papers)
- NEP-CMP-2005-10-22 (Computational Economics)
- NEP-EVO-2005-10-22 (Evolutionary Economics)
- NEP-MAC-2005-10-22 (Macroeconomics)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- George W. Evans & Seppo Honkapohja, 2003.
"Expectations and the Stability Problem for Optimal Monetary Policies,"
Review of Economic Studies,
Oxford University Press, vol. 70(4), pages 807-824.
- George W. Evans & Seppo Honkapohja, 2003. "Expectations and the Stability Problem for Optimal Monetary Policies," Review of Economic Studies, Wiley Blackwell, vol. 70(4), pages 807-824, October.
- Evans, George W & Honkapohja, Seppo, 2001. "Expectations and the Stability Problem for Optimal Monetary Policies," CEPR Discussion Papers 2805, C.E.P.R. Discussion Papers.
- Honkapohja, S. & Evans, G.W., 2000. "Expectations and the Stability Problem for Optimal Monetary Policies," University of Helsinki, Department of Economics 481, Department of Economics.
- Honkapohja, Seppo & Evans, George W., 2000. "Expectations and the stability problem for optimal monetary policies," Discussion Paper Series 1: Economic Studies 2000,10, Deutsche Bundesbank, Research Centre.
- George W. Evans & Seppo Honkapohja, 2001. "Expectations and the Stability Problem for Optimal Monetary Policies," University of Oregon Economics Department Working Papers 2001-6, University of Oregon Economics Department, revised 03 Aug 2001.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:nbr:nberte:0317For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

