Generalized Stochastic Gradient Learning
Abstract
We study the properties of generalized stochastic gradient (GSG) learning in forwardlooking models. We examine how the conditions for stability of standard stochastic gradient (SG) learning both differ from and are related to E-stability, which governs stability under least squares learning. SG algorithms are sensitive to units of measurement and we show that there is a transformation of variables for which E-stability governs SG stability. GSG algorithms with constant gain have a deeper justification in terms of parameter drift, robustness and risk sensitivity.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by University of Oregon Economics Department in its series University of Oregon Economics Department Working Papers with number 2005-17.Length: 35
Date of creation: 19 Sep 2005
Date of revision: 18 May 2008
Handle: RePEc:ore:uoecwp:2005-17
Contact details of provider:
Postal: 1285 University of Oregon, 435 PLC, Eugene, OR 97403-1285
Phone: (541) 346-4661
Fax: (541) 346-1243
Email:
Web page: http://economics.uoregon.edu/
More information through EDIRC
Related research
Keywords: adaptive learning; E-stability; recursive least squares; robust estimation;Other versions of this item:
- George W. Evans & Seppo Honkapohja & Noah Williams, 2010. "Generalized Stochastic Gradient Learning," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 51(1), pages 237-262, 02.
- George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," NBER Technical Working Papers 0317, National Bureau of Economic Research, Inc.
- Evans, G.W. & Honkapohja ,S. & Williams, N., 2005. "Generalized Stochastic Gradient Learning," Cambridge Working Papers in Economics 0545, Faculty of Economics, University of Cambridge.
- George W. Evans & Seppo Honkapohja & Noah Williams, 2005. "Generalized Stochastic Gradient Learning," CESifo Working Paper Series 1576, CESifo Group Munich.
- C62 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Existence and Stability Conditions of Equilibrium
- C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools
- D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search, Learning, and Information
- E10 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - General
- E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
This paper has been announced in the following NEP Reports:
- NEP-ALL-2005-09-29 (All new papers)
- NEP-MAC-2005-09-29 (Macroeconomics)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- George W. Evans & Seppo Honkapohja, 2003.
"Expectations and the Stability Problem for Optimal Monetary Policies,"
Review of Economic Studies,
Oxford University Press, vol. 70(4), pages 807-824.
- George W. Evans & Seppo Honkapohja, 2003. "Expectations and the Stability Problem for Optimal Monetary Policies," Review of Economic Studies, Wiley Blackwell, vol. 70(4), pages 807-824, October.
- Evans, George W & Honkapohja, Seppo, 2001. "Expectations and the Stability Problem for Optimal Monetary Policies," CEPR Discussion Papers 2805, C.E.P.R. Discussion Papers.
- Honkapohja, S. & Evans, G.W., 2000. "Expectations and the Stability Problem for Optimal Monetary Policies," University of Helsinki, Department of Economics 481, Department of Economics.
- Honkapohja, Seppo & Evans, George W., 2000. "Expectations and the stability problem for optimal monetary policies," Discussion Paper Series 1: Economic Studies 2000,10, Deutsche Bundesbank, Research Centre.
- George W. Evans & Seppo Honkapohja, 2001. "Expectations and the Stability Problem for Optimal Monetary Policies," University of Oregon Economics Department Working Papers 2001-6, University of Oregon Economics Department, revised 03 Aug 2001.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:ore:uoecwp:2005-17For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Bill Harbaugh).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

