Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets
AbstractThe predictive accuracy of various econometric models, including random walks, vector-autoregressive and vector-error-correction models, are investigated using daily futures prices of four commodities (the S&P 500 index, treasury bonds, gold, and crude oil). All models are estimated using a rolling-window approach, and evaluated by both in-sample and out-of-sample performance measures. The criteria considered include system criteria, where we evaluate multiequation forecasting models, and univariate forecast-accuracy criteria. The five univariate criteria are root mean square error (RMSE), mean absolute deviation (MAD), mean absolute percentage error (MAPE), confusion matrix (CM), and confusion rate (CR). The five system criteria used include the trace of second-moment matrix of the forecast-errors matrix (TMSE), the trace of second-moment matrix of percentage-forecast errors (TMAPE), the generalized forecast-error second-moment matrix (GFESM), and a trading-rule profit criterion (TPC) based on a maximum-spread trading strategy. An in-sample criterion, the mean Schwarz information criteria (MSIC), is also computed. Our results suggest that error-correction models perform better in shorter forecast horizons, when models are compared based on quadratic loss measures and confusion matrices. However, the error-correction models which we consider perform better at all forecast horizons (one to five steps ahead) when models are compared based on a profit-maximization loss function. Further, our error-correction model, where the error-correction term is constructed according to a cost-of-carry equilibrium condition, outperforms our alternative error-correction model, which uses the price spreads as the error-correction term.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by De Gruyter in its journal Studies in Nonlinear Dynamics & Econometrics.
Volume (Year): 2 (1998)
Issue (Month): 4 (January)
Contact details of provider:
Web page: http://www.degruyter.com
Other versions of this item:
- Zeng, T. & Swanson, N.R., 1997. "Predictive Evaluation of Econometric Forecasting Models in Commodity Futures Markets," Papers 9-97-4, Pennsylvania State - Department of Economics.
- C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Andrea Bastianin & Matteo Manera & Anil Markandya & Elisa Scarpa, 2011. "Oil Price Forecast Evaluation with Flexible Loss Functions," Working Papers 2011.91, Fondazione Eni Enrico Mattei.
- Matteo Manera & Chiara Longo & Anil Markandya & Elisa Scarpa, 2007. "Evaluating the Empirical Performance of Alternative Econometric Models for Oil Price Forecasting," Working Papers 2007.4, Fondazione Eni Enrico Mattei.
- Giliola Frey & Matteo Manera & Anil Markandya & Elisa Scarpa, 2009. "Econometric Models for Oil Price Forecasting: A Critical Survey," CESifo Forum, Ifo Institute for Economic Research at the University of Munich, vol. 10(1), pages 29-44, 04.
- Van Bellegem, Sebastien & von Sachs, Rainer, 2004. "Forecasting economic time series with unconditional time-varying variance," International Journal of Forecasting, Elsevier, vol. 20(4), pages 611-627.
- Claudio Dicembrino & Pasquale Lucio Scandizzo, 2012. "The Fundamental and Speculative Components of the Oil Spot Price: A Real Option Value Approach," CEIS Research Paper 229, Tor Vergata University, CEIS, revised 18 Apr 2012.
- Batchelor, Roy & Alizadeh, Amir & Visvikis, Ilias, 2007. "Forecasting spot and forward prices in the international freight market," International Journal of Forecasting, Elsevier, vol. 23(1), pages 101-114.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Peter Golla).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.