IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this paper or follow this series

Stochastic Gradient versus Recursive Least Squares Learning

  • Sergey Slobodyan
  • Anna Bogomolova,
  • Dmitri Kolyuzhnov

In this paper, we perform an in—depth investigation of relative merits of two adaptive learning algorithms with constant gain, Recursive Least Squares (RLS) and Stochastic Gradient (SG), using the Phelps model of monetary policy as a testing ground. The behavior of the two learning algorithms is very different. Under the mean (averaged) RLS dynamics, the Self—Confirming Equilibrium (SCE) is stable for initial conditions in a very small region around the SCE. Large distance movements of perceived model parameters from their SCE values, or “escapes”, are observed. On the other hand, the SCE is stable under the SG mean dynamics in a large region. However, actual behavior of the SG learning algorithm is divergent for a wide range of constant gain parameters, including those that could be justified as economically meaningful. We explain the discrepancy by looking into the structure of eigenvalues and eigenvectors of the mean dynamics map under SG learning. Results of our paper hint that caution is needed when constant gain learning algorithms are used. If the mean dynamics map is stable but not contracting in every direction, and most eigenvalues of the map are close to the unit circle, the constant gain learning algorithm might diverge.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.cerge-ei.cz/pdf/wp/Wp309.pdf
Download Restriction: no

Paper provided by The Center for Economic Research and Graduate Education - Economics Institute, Prague in its series CERGE-EI Working Papers with number wp309.

as
in new window

Length:
Date of creation: Oct 2006
Date of revision:
Handle: RePEc:cer:papers:wp309
Contact details of provider: Postal: P.O. Box 882, Politickych veznu 7, 111 21 Praha 1
Phone: (+420) 224 005 123
Fax: (+420) 224 005 333
Web page: http://www.cerge-ei.cz
Email:


More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. In-Koo Cho & Noah Williams & Thomas J. Sargent, 2002. "Escaping Nash Inflation," Review of Economic Studies, Oxford University Press, vol. 69(1), pages 1-40.
  2. Dmitri Kolyuzhnov & Anna Bogomolova & Sergey Slobodyan, 2006. "Escape Dynamics: A Continuous—Time Approximation," CERGE-EI Working Papers wp285, The Center for Economic Research and Graduate Education - Economic Institute, Prague.
  3. Thomas Sargent & Noah Williams & Tao Zha, 2006. "The Conquest of South American Inflation," NBER Working Papers 12606, National Bureau of Economic Research, Inc.
  4. Seppo Honkapohja & Kaushik Mitra, 2006. "Learning Stability in Economies with Heterogeneous Agents," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 9(2), pages 284-309, April.
  5. Chryssi Giannitsarou, 2003. "Heterogeneous Learning," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 6(4), pages 885-906, October.
  6. Evans, G.W. & Honkapohja ,S. & Williams, N., 2005. "Generalized Stochastic Gradient Learning," Cambridge Working Papers in Economics 0545, Faculty of Economics, University of Cambridge.
  7. William Poole & Robert H. Rasche, 2002. "Flation," Review, Federal Reserve Bank of St. Louis, issue Nov, pages 1-6.
    • William Poole, 2002. "Flation," Speech 49, Federal Reserve Bank of St. Louis.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:cer:papers:wp309. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jana Koudelkova)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.