Does BIC Estimate and Forecast Better Than AIC?
We test two questions: (i) Is the Bayesian information criterion (BIC) more parsimonious than the Akaike information criterion (AIC)?, and (ii) Can the BIC forecast better than the AIC? By using simulated data, we provide statistical inference of both hypotheses individually and then jointly with a multiple hypotheses testing procedure to control better for type-I error. Both testing procedures deliver the same result: The BIC shows an in- and out-of-sample superiority over AIC only in a long-sample context.
|Date of creation:||Nov 2012|
|Date of revision:|
|Contact details of provider:|| Postal: |
Phone: (562) 670 2000
Fax: (562) 698 4847
Web page: http://www.bcentral.cl/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Sullivan, Ryan & Timmermann, Allan G & White, Halbert, 1998.
"Data-Snooping, Technical Trading Rule Performance and the Bootstrap,"
CEPR Discussion Papers
1976, C.E.P.R. Discussion Papers.
- Ryan Sullivan & Allan Timmermann & Halbert White, 1999. "Data-Snooping, Technical Trading Rule Performance, and the Bootstrap," Journal of Finance, American Finance Association, vol. 54(5), pages 1647-1691, October.
- Allan Timmermann & Halbert White & Ryan Sullivan, 1998. "Data-Snooping, Technical Trading, Rule Performance and the Bootstrap," FMG Discussion Papers dp303, Financial Markets Group.
- Whitney K. Newey & Kenneth D. West, 1986.
"A Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix,"
NBER Technical Working Papers
0055, National Bureau of Economic Research, Inc.
- Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 33(1), pages 125-132.
- Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May.
- Diebold, Francis X & Mariano, Roberto S, 2002.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 134-44, January.
- Nickelsburg, Gerald, 1985. "Small-sample properties of dimensionality statistics for fitting VAR models to aggregate economic data : A Monte Carlo study," Journal of Econometrics, Elsevier, vol. 28(2), pages 183-192, May.
- Wolak, Frank A., 1989. "Testing inequality constraints in linear econometric models," Journal of Econometrics, Elsevier, vol. 41(2), pages 205-235, June.
- Todd E. Clark & Michael McCracken, 1999.
"Tests of Equal Forecast Accuracy and Encompassing for Nested Models,"
Computing in Economics and Finance 1999
1241, Society for Computational Economics.
- Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
- Todd E. Clark & Michael W. McCracken, 2000. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Econometric Society World Congress 2000 Contributed Papers 0319, Econometric Society.
- Todd E. Clark & Michael W. McCracken, 1999. "Tests of equal forecast accuracy and encompassing for nested models," Research Working Paper 99-11, Federal Reserve Bank of Kansas City.
- West, Kenneth D, 1996.
"Asymptotic Inference about Predictive Ability,"
Econometric Society, vol. 64(5), pages 1067-84, September.
- Geweke, John & Meese, Richard, 1981.
"Estimating regression models of finite but unknown order,"
Journal of Econometrics,
Elsevier, vol. 16(1), pages 162-162, May.
- Geweke, John F & Meese, Richard, 1981. "Estimating Regression Models of Finite but Unknown Order," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 22(1), pages 55-70, February.
- Kilian, Lutz, 2001. "Impulse Response Analysis in Vector Autoregressions with Unknown Lag Order," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 20(3), pages 161-79, April.
- Clive Granger & Yongil Jeon, 2004. "Forecasting Performance of Information Criteria with Many Macro Series," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(10), pages 1227-1240.
- Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
- Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
- Hamparsum Bozdogan, 1987. "Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions," Psychometrika, Springer, vol. 52(3), pages 345-370, September.
- L. Randall Wray & Stephanie Bell, 2004. "Introduction," Chapters, in: Credit and State Theories of Money, chapter 1 Edward Elgar.
- Pablo Pincheira, 2012. "A Joint Test of Superior Predictive Ability for Chilean Inflation Forecasts," Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 15(3), pages 04-39, December.
- Yi, Gang & Judge, George, 1988. "Statistical model selection criteria," Economics Letters, Elsevier, vol. 28(1), pages 47-51.
- Sawa, Takamitsu, 1978. "Information Criteria for Discriminating among Alternative Regression Models," Econometrica, Econometric Society, vol. 46(6), pages 1273-91, November.
- Lawrence Raffalovich & Glenn Deane & David Armstrong & Hui-Shien Tsao, 2008. "Model selection procedures in social research: Monte-Carlo simulation results," Journal of Applied Statistics, Taylor & Francis Journals, vol. 35(10), pages 1093-1114.
When requesting a correction, please mention this item's handle: RePEc:chb:bcchwp:679. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Claudio Sepulveda)
If references are entirely missing, you can add them using this form.