Time Series Forecasting: Model Evaluation and Selection Using Nonparametric Risk Bounds
AbstractWe derive generalization error bounds -- bounds on the expected inaccuracy of the predictions -- for traditional time series forecasting models. Our results hold for many standard forecasting tools including autoregressive models, moving average models, and, more generally, linear state-space models. These bounds allow forecasters to select among competing models and to guarantee that with high probability, their chosen model will perform well without making strong assumptions about the data generating process or appealing to asymptotic theory. We motivate our techniques with and apply them to standard economic and nancial forecasting tools -- a GARCH model for predicting equity volatility and a dynamic stochastic general equilibrium model (DSGE), the standard tool in macroeconomic forecasting. We demonstrate in particular how our techniques can aid forecasters and policy makers in choosing models which behave well under uncertainty and mis-specifi cation.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Institute for New Economic Thinking (INET) in its series INET Research Notes with number 18.
Date of creation: 02 Dec 2012
Date of revision:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Jesús Fernández-Villaverde, 2009.
"The Econometrics of DSGE Models,"
PIER Working Paper Archive
09-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- Sims, Christopher A, 2002.
"Solving Linear Rational Expectations Models,"
Society for Computational Economics, vol. 20(1-2), pages 1-20, October.
- Christopher Sims, 2001. "Matlab Code for Solving Linear Rational Expectations Models," QM&RBC Codes 11, Quantitative Macroeconomics & Real Business Cycles.
- Mokkadem, Abdelkader, 1988. "Mixing properties of ARMA processes," Stochastic Processes and their Applications, Elsevier, vol. 29(2), pages 309-315, September.
- DeJong, David N. & Ingram, Beth F. & Whiteman, Charles H., 2000. "A Bayesian approach to dynamic macroeconomics," Journal of Econometrics, Elsevier, vol. 98(2), pages 203-223, October.
- Durbin, James & Koopman, Siem Jan, 2001.
"Time Series Analysis by State Space Methods,"
Oxford University Press, number 9780198523543.
- Tom Doan, . "SEASONALDLM: RATS procedure to create the matrices for the seasonal component of a DLM," Statistical Software Components RTS00251, Boston College Department of Economics.
- Gertler, Mark & Karadi, Peter, 2011. "A model of unconventional monetary policy," Journal of Monetary Economics, Elsevier, vol. 58(1), pages 17-34, January.
- Andrea Gerali & Stefano Neri & Luca Sessa & Federico M. Signoretti, 2010.
"Credit and banking in a DSGE model of the euro area,"
Temi di discussione (Economic working papers)
740, Bank of Italy, Economic Research and International Relations Area.
- Andrea Gerali & Stefano Neri & Luca Sessa & Federico M. Signoretti, 2010. "Credit and Banking in a DSGE Model of the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 42(s1), pages 107-141, 09.
- Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
- Frank Smets & Rafael Wouters, 2007.
"Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach,"
American Economic Review,
American Economic Association, vol. 97(3), pages 586-606, June.
- Smets, Frank & Wouters, Rafael, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," CEPR Discussion Papers 6112, C.E.P.R. Discussion Papers.
- Smets, Frank & Wouters, Raf, 2007. "Shocks and frictions in US business cycles: a Bayesian DSGE approach," Working Paper Series 0722, European Central Bank.
- Frank Smets & Raf Wouters, 2007. "Shocks and Frictions in US Business Cycles : a Bayesian DSGE Approach," Working Paper Research 109, National Bank of Belgium.
- Harvey, Andrew & Ruiz, Esther & Shephard, Neil, 1994.
"Multivariate Stochastic Variance Models,"
Review of Economic Studies,
Wiley Blackwell, vol. 61(2), pages 247-64, April.
- Tom Doan, . "RATS programs to estimate multivariate stochastic volatility models," Statistical Software Components RTZ00093, Boston College Department of Economics.
- Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
- Athanasopoulos, George & Vahid, Farshid, 2008.
"VARMA versus VAR for Macroeconomic Forecasting,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 26, pages 237-252, April.
- George Athanasopoulos & Farshid Vahid, 2006. "VARMA versus VAR for Macroeconomic Forecasting," Monash Econometrics and Business Statistics Working Papers 4/06, Monash University, Department of Econometrics and Business Statistics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Enno Schröder).
If references are entirely missing, you can add them using this form.