Time Series Forecasting: Model Evaluation and Selection Using Nonparametric Risk Bounds
AbstractWe derive generalization error bounds -- bounds on the expected inaccuracy of the predictions -- for traditional time series forecasting models. Our results hold for many standard forecasting tools including autoregressive models, moving average models, and, more generally, linear state-space models. These bounds allow forecasters to select among competing models and to guarantee that with high probability, their chosen model will perform well without making strong assumptions about the data generating process or appealing to asymptotic theory. We motivate our techniques with and apply them to standard economic and nancial forecasting tools -- a GARCH model for predicting equity volatility and a dynamic stochastic general equilibrium model (DSGE), the standard tool in macroeconomic forecasting. We demonstrate in particular how our techniques can aid forecasters and policy makers in choosing models which behave well under uncertainty and mis-specifi cation.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Institute for New Economic Thinking (INET) in its series INET Research Notes with number 18.
Date of creation: 02 Dec 2012
Date of revision:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Andrea Gerali & Stefano Neri & Luca Sessa & Federico M. Signoretti, 2010.
"Credit and banking in a DSGE model of the euro area,"
Temi di discussione (Economic working papers)
740, Bank of Italy, Economic Research and International Relations Area.
- Andrea Gerali & Stefano Neri & Luca Sessa & Federico M. Signoretti, 2010. "Credit and Banking in a DSGE Model of the Euro Area," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 42(s1), pages 107-141, 09.
- Smets, Frank & Wouters, Rafael, 2007.
"Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach,"
CEPR Discussion Papers
6112, C.E.P.R. Discussion Papers.
- Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
- Smets, Frank & Wouters, Raf, 2007. "Shocks and frictions in US business cycles: a Bayesian DSGE approach," Working Paper Series 0722, European Central Bank.
- Frank Smets & Raf Wouters, 2007. "Shocks and Frictions in US Business Cycles : a Bayesian DSGE Approach," Working Paper Research 109, National Bank of Belgium.
- DeJong, David N. & Ingram, Beth F. & Whiteman, Charles H., 2000. "A Bayesian approach to dynamic macroeconomics," Journal of Econometrics, Elsevier, vol. 98(2), pages 203-223, October.
- Jesús Fernández-Villaverde, 2009.
"The Econometrics of DSGE Models,"
PIER Working Paper Archive
09-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- Racine, Jeff, 2000. "Consistent cross-validatory model-selection for dependent data: hv-block cross-validation," Journal of Econometrics, Elsevier, vol. 99(1), pages 39-61, November.
- Gertler, Mark & Karadi, Peter, 2011. "A model of unconventional monetary policy," Journal of Monetary Economics, Elsevier, vol. 58(1), pages 17-34, January.
- Mokkadem, Abdelkader, 1988. "Mixing properties of ARMA processes," Stochastic Processes and their Applications, Elsevier, vol. 29(2), pages 309-315, September.
- Sims, Christopher A, 2002.
"Solving Linear Rational Expectations Models,"
Society for Computational Economics, vol. 20(1-2), pages 1-20, October.
- Christopher Sims, 2001. "Matlab Code for Solving Linear Rational Expectations Models," QM&RBC Codes 11, Quantitative Macroeconomics & Real Business Cycles.
- Harvey, Andrew & Ruiz, Esther & Shephard, Neil, 1994.
"Multivariate Stochastic Variance Models,"
Review of Economic Studies,
Wiley Blackwell, vol. 61(2), pages 247-64, April.
- Tom Doan, . "RATS programs to estimate multivariate stochastic volatility models," Statistical Software Components RTZ00093, Boston College Department of Economics.
- Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
- Athanasopoulos, George & Vahid, Farshid, 2008.
"VARMA versus VAR for Macroeconomic Forecasting,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 26, pages 237-252, April.
- George Athanasopoulos & Farshid Vahid, 2006. "VARMA versus VAR for Macroeconomic Forecasting," Monash Econometrics and Business Statistics Working Papers 4/06, Monash University, Department of Econometrics and Business Statistics.
- Durbin, James & Koopman, Siem Jan, 2001.
"Time Series Analysis by State Space Methods,"
Oxford University Press, number 9780198523543.
- Tom Doan, . "SEASONALDLM: RATS procedure to create the matrices for the seasonal component of a DLM," Statistical Software Components RTS00251, Boston College Department of Economics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Enno Schröder).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.