IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this article or follow this journal

Bayesian averaging, prediction and nonnested model selection

  • Hong, Han
  • Preston, Bruce

This paper studies the asymptotic relationship between Bayesian model averaging and post-selection frequentist predictors in both nested and nonnested models. We derive conditions under which their difference is of a smaller order of magnitude than the inverse of the square root of the sample size in large samples. This result depends crucially on the relation between posterior odds and frequentist model selection criteria. Weak conditions are given under which consistent model selection is feasible, regardless of whether models are nested or nonnested and regardless of whether models are correctly specified or not, in the sense that they select the best model with the least number of parameters with probability converging to 1. Under these conditions, Bayesian posterior odds and BICs are consistent for selecting among nested models, but are not consistent for selecting among nonnested models and possibly overlapping models. These findings have important bearing for applied researchers who are frequent users of model selection tools for empirical investigation of model predictions.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.sciencedirect.com/science/article/pii/S0304407611002028
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Article provided by Elsevier in its journal Journal of Econometrics.

Volume (Year): 167 (2012)
Issue (Month): 2 ()
Pages: 358-369

as
in new window

Handle: RePEc:eee:econom:v:167:y:2012:i:2:p:358-369
Contact details of provider: Web page: http://www.elsevier.com/locate/jeconom

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. James H. Stock & Mark W. Watson, 2001. "Forecasting Output and Inflation: The Role of Asset Prices," NBER Working Papers 8180, National Bureau of Economic Research, Inc.
  2. repec:cup:cbooks:9780521477444 is not listed on IDEAS
  3. repec:cup:cbooks:9780521471626 is not listed on IDEAS
  4. Jesús Fernández-Villaverde & Juan Francisco Rubio-Ramírez, 2004. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Working Paper 2004-3, Federal Reserve Bank of Atlanta.
  5. Todd E. Clark & Michael W. McCracken, 2007. "Combining forecasts from nested models," Finance and Economics Discussion Series 2007-43, Board of Governors of the Federal Reserve System (U.S.).
  6. Alejandro Justiniano & Bruce Preston, 2008. "Can Structural Small Open Economy Models Account for the Influence of Foreign Disturbances?," NBER Working Papers 14547, National Bureau of Economic Research, Inc.
  7. Jes�s Fern�ndez-Villaverde & Juan F. Rubio-Ram�rez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," Review of Economic Studies, Oxford University Press, vol. 74(4), pages 1059-1087.
  8. Hong, Han & Preston, Bruce & Shum, Matthew, 2003. "Generalized Empirical Likelihood Based Model Selection Criteria For Moment Condition Models," Econometric Theory, Cambridge University Press, vol. 19(06), pages 923-943, December.
  9. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(02), pages 186-199, June.
  10. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-54, July.
  11. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
  12. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
  13. Timmermann, Allan G, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, C.E.P.R. Discussion Papers.
  14. Carroll Christopher Dixon, 2001. "Death to the Log-Linearized Consumption Euler Equation! (And Very Poor Health to the Second-Order Approximation)," The B.E. Journal of Macroeconomics, De Gruyter, vol. 1(1), pages 1-38, April.
  15. repec:cup:cbooks:9780521477451 is not listed on IDEAS
  16. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
  17. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-33, March.
  18. Thomas Lubik & Frank Schorfheide, 2003. "Do Central Banks Respond to Exchange Rate Movements? A Structural Investigation," Economics Working Paper Archive 505, The Johns Hopkins University,Department of Economics.
  19. Jonathan H. Wright, 2003. "Bayesian Model Averaging and exchange rate forecasts," International Finance Discussion Papers 779, Board of Governors of the Federal Reserve System (U.S.).
  20. Victor Chernozhukov & Christian Hansen, 2005. "An IV Model of Quantile Treatment Effects," Econometrica, Econometric Society, vol. 73(1), pages 245-261, 01.
  21. repec:cup:cbooks:9780521405515 is not listed on IDEAS
  22. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-57, September.
  23. Jesus Fernandez-Villaverde & Juan F. Rubio-Ramirez, 2004. "Estimating Nonlinear Dynamic Equilibrium economies: A Likelihood Approach," PIER Working Paper Archive 04-001, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
  24. Orazio P. Attanasio & Hamish Low, 2004. "Estimating Euler Equations," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 7(2), pages 405-435, April.
  25. Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
  26. Pötscher, B.M., 1991. "Effects of Model Selection on Inference," Econometric Theory, Cambridge University Press, vol. 7(02), pages 163-185, June.
  27. Newey, Whitney K, 1985. "Maximum Likelihood Specification Testing and Conditional Moment Tests," Econometrica, Econometric Society, vol. 53(5), pages 1047-70, September.
  28. Berry, Steven & Levinsohn, James & Pakes, Ariel, 1995. "Automobile Prices in Market Equilibrium," Econometrica, Econometric Society, vol. 63(4), pages 841-90, July.
  29. Andrews, Donald W. K. & Lu, Biao, 2001. "Consistent model and moment selection procedures for GMM estimation with application to dynamic panel data models," Journal of Econometrics, Elsevier, vol. 101(1), pages 123-164, March.
  30. Fernandez-Villaverde, Jesus & Francisco Rubio-Ramirez, Juan, 2004. "Comparing dynamic equilibrium models to data: a Bayesian approach," Journal of Econometrics, Elsevier, vol. 123(1), pages 153-187, November.
  31. Fan, Yanqin, 1994. "Testing the Goodness of Fit of a Parametric Density Function by Kernel Method," Econometric Theory, Cambridge University Press, vol. 10(02), pages 316-356, June.
  32. Powell, James L., 1986. "Censored regression quantiles," Journal of Econometrics, Elsevier, vol. 32(1), pages 143-155, June.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:167:y:2012:i:2:p:358-369. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.