Learning and Model Validation
This paper studies the following problem. An agent takes actions based on a possibly misspecified model. The agent is 'large', in the sense that his actions influence the model he is trying to learn about. The agent is aware of potential model misspecification and tries to detect it, in real-time, using an econometric specification test. If his model fails the test, he formulates a new better-fitting model. If his model passes the test, he uses it to formulate and implement a policy based on the provisional assumption that the current model is correctly specified, and will not change in the future. We claim that this testing and model validation process is an accurate description of most macroeconomic policy problems. Unfortunately, the dynamics produced by this process are not well understood. We make progress on this problem by relating it to a problem that is well understood. In particular, we relate it to the dynamics of constant-gain stochastic approximation algorithms. This enables us to appeal to well known results from the large deviations literature to help us understand the dynamics of testing and model revision. We show that as the agent applies an increasingly stringent specification test, the large deviation properties of the discrete model validation dynamics converge to those of the continuous learning dynamics. This sheds new light on the recent constant-gain learning literature.
|Date of creation:||03 Dec 2006|
|Date of revision:|
|Contact details of provider:|| Postal: |
Web page: http://www.EconomicDynamics.org/society.htm
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Brock, William A. & Durlauf, Steven N. & West, Kenneth D., 2007.
"Model uncertainty and policy evaluation: Some theory and empirics,"
Journal of Econometrics,
Elsevier, vol. 136(2), pages 629-664, February.
- William Brock & Steven Durlauf & Kenneth West, 2005. "Model uncertainty and policy evaluation: some theory and empirics," Proceedings, Federal Reserve Bank of San Francisco.
- William A. Brock & Steven N. Durlauf & Kenneth D. West, 2004. "Model Uncertainty and Policy Evaluation: Some Theory and Empirics," NBER Working Papers 10916, National Bureau of Economic Research, Inc.
- Brock,W.A. & Durlauf,S.N. & West,K.D., 2004. "Model uncertainty and policy evaluation : some theory and empirics," Working papers 19, Wisconsin Madison - Social Systems.
- Bullard, James, 1992. "Time-varying parameters and nonconvergence to rational expectations under least squares learning," Economics Letters, Elsevier, vol. 40(2), pages 159-166, October.
- Sungbae An & Frank Schorfheide, 2007.
"Bayesian Analysis of DSGE Models,"
Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
- Cho, In-Koo & Sargent, Thomas J., 2000.
"Escaping Nash inflation,"
Working Paper Series
0023, European Central Bank.
- Cho, In-Koo & Williams, Noah & Sargent, Thomas J, 2002. "Escaping Nash Inflation," Review of Economic Studies, Wiley Blackwell, vol. 69(1), pages 1-40, January.
- In-Koo Cho & Noah Williams & Thomas J. Sargent, 2002. "Escaping Nash Inflation," Review of Economic Studies, Oxford University Press, vol. 69(1), pages 1-40.
- Chu, Chia-Shang James & Stinchcombe, Maxwell & White, Halbert, 1996. "Monitoring Structural Change," Econometrica, Econometric Society, vol. 64(5), pages 1045-65, September.
- Timothy Cogley & Riccardo Colacito & Lars Peter Hansen & Thomas J. Sargent, 2008. "Robustness and U.S. Monetary Policy Experimentation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(8), pages 1599-1623, December.
- Thomas J. Sargent, 1975.
"The observational equivalence of natural and unnatural rate theories of macroeconomics,"
48, Federal Reserve Bank of Minneapolis.
- Sargent, Thomas J, 1976. "The Observational Equivalence of Natural and Unnatural Rate Theories of Macroeconomics," Journal of Political Economy, University of Chicago Press, vol. 84(3), pages 631-40, June.
- William A. Brock & Cars H. Hommes, 1997.
"A Rational Route to Randomness,"
Econometric Society, vol. 65(5), pages 1059-1096, September.
- Chen, Xiaohong & White, Halbert, 1998. "Nonparametric Adaptive Learning with Feedback," Journal of Economic Theory, Elsevier, vol. 82(1), pages 190-222, September.
- Hansen, Lars Peter & Sargent, Thomas J., 1993. "Seasonality and approximation errors in rational expectations models," Journal of Econometrics, Elsevier, vol. 55(1-2), pages 21-55.
- Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-33, March.
- Timothy Cogley & Riccardo Colacito & Thomas J. Sargent, 2007.
"Benefits from U.S. Monetary Policy Experimentation in the Days of Samuelson and Solow and Lucas,"
Journal of Money, Credit and Banking,
Blackwell Publishing, vol. 39(s1), pages 67-99, 02.
- Timothy Cogley & Riccardo Colacito & Thomas J. Sargent, 2005. "Benefits from U.S. monetary policy experimentation in the days of Samuelson and Solow and Lucas," Proceedings, Board of Governors of the Federal Reserve System (U.S.).
- Kandori, Michihiro & Mailath, George J & Rob, Rafael, 1993.
"Learning, Mutation, and Long Run Equilibria in Games,"
Econometric Society, vol. 61(1), pages 29-56, January.
- Kandori, M. & Mailath, G.J., 1991. "Learning, Mutation, And Long Run Equilibria In Games," Papers 71, Princeton, Woodrow Wilson School - John M. Olin Program.
- M. Kandori & G. Mailath & R. Rob, 1999. "Learning, Mutation and Long Run Equilibria in Games," Levine's Working Paper Archive 500, David K. Levine.
- Kalai, Ehud & Lehrer, Ehud, 1991.
"Rational Learning Leads to Nash Equilibrium,"
91-18, C.V. Starr Center for Applied Economics, New York University.
- Ehud Kalai & Ehud Lehrer, 1990. "Rational Learning Leads to Nash Equilibrium," Discussion Papers 895, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- E. Kalai & E. Lehrer, 2010. "Rational Learning Leads to Nash Equilibrium," Levine's Working Paper Archive 529, David K. Levine.
- Ehud Kalai & Ehud Lehrer, 1990. "Rational Learning Leads to Nash Equilibrium," Discussion Papers 925, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
- Inoue, Atsushi & Rossi, Barbara, 2005.
"Recursive Predictability Tests for Real-Time Data,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 23, pages 336-345, July.
- Yuichi Kitamura & Michael Stutzer, 1997. "An Information-Theoretic Alternative to Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 65(4), pages 861-874, July.
- Marcet, Albert & Sargent, Thomas J., 1989. "Convergence of least squares learning mechanisms in self-referential linear stochastic models," Journal of Economic Theory, Elsevier, vol. 48(2), pages 337-368, August.
When requesting a correction, please mention this item's handle: RePEc:red:sed006:178. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Christian Zimmermann)
If references are entirely missing, you can add them using this form.