Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle
AbstractThe forecast combination puzzle refers to the finding that a simple average forecast combination outperforms more sophisticated weighting schemes and/or the best individual model. The paper derives optimal (worst) forecast combinations based on stochastic dominance (SD) analysis with differential forecast weights. For the optimal (worst) forecast combination, this index will minimize (maximize) forecasts errors by combining time-series model based forecasts at a given probability level. By weighting each forecast differently, we find the optimal (worst) forecast combination that does not rely on arbitrary weights. Using two exchange rate series on weekly data for the Japanese Yen/U.S. Dollar and U.S. Dollar/Great Britain Pound for the period from 1975 to 2010 we find that the simple average forecast combination is neither the worst nor the best forecast combination something that provides partial support for the forecast combination puzzle. In that context, the random walk model is the model that consistently contributes with considerably more than an equal weight to the worst forecast combination for all variables being forecasted and for all forecast horizons, whereas a flexible Neural Network autoregressive model and a self-exciting threshold autoregressive model always enter the best forecast combination with much greater than equal weights.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by The Rimini Centre for Economic Analysis in its series Working Paper Series with number 17_12.
Date of creation: Jun 2012
Date of revision:
Nonparametric Stochastic Dominance; Mixed Integer Programming; Forecast combinations; Forecast combination puzzle;
Other versions of this item:
- Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an optimal forecast combination? A stochastic dominance approach applied to the forecast combination puzzle," Working Papers 1206, University of Guelph, Department of Economics.
- C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
- C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
- C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
- C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
- G01 - Financial Economics - - General - - - Financial Crises
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Russell Davidson & Jean-Yves Duclos, 2000.
"Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality,"
Econometric Society, vol. 68(6), pages 1435-1464, November.
- Davidson, R. & Duclos, J.-Y., 1998. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," G.R.E.Q.A.M. 98a14, Universite Aix-Marseille III.
- Davidson, Russell & Duclos, Jean-Yves, 1998. "Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality," Cahiers de recherche 9805, Université Laval - Département d'économique.
- Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, 06.
- Olivier Scaillet & Nikolas Topaloglou, 2005.
"Testing for Stochastic Dominance Efficiency,"
FAME Research Paper Series
rp154, International Center for Financial Asset Management and Engineering.
- Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-93, September.
- Anders Bredahl Kock & Timo Teräsvirta, 2010. "Forecasting with nonlinear time series models," CREATES Research Papers 2010-01, School of Economics and Management, University of Aarhus.
- Garry F. Barrett & Stephen G. Donald, 2003. "Consistent Tests for Stochastic Dominance," Econometrica, Econometric Society, vol. 71(1), pages 71-104, January.
- Graham Elliott & Allan Timmermann, 2005.
"Optimal Forecast Combination Under Regime Switching ,"
International Economic Review,
Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(4), pages 1081-1102, November.
- Elliott, Graham & Timmermann, Allan G, 2004. "Optimal Forecast Combination Under Regime Switching," CEPR Discussion Papers 4649, C.E.P.R. Discussion Papers.
- Graham Elliott & Allan Timmermann, 2008.
Journal of Economic Literature,
American Economic Association, vol. 46(1), pages 3-56, March.
- Dick van Dijk & Philip Hans Franses & Michael P. Clements & Jeremy Smith, 2003.
"On SETAR non-linearity and forecasting,"
Journal of Forecasting,
John Wiley & Sons, Ltd., vol. 22(5), pages 359-375.
- De Gooijer, Jan G. & De Bruin, Paul T., 1998. "On forecasting SETAR processes," Statistics & Probability Letters, Elsevier, vol. 37(1), pages 7-14, January.
- Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006.
"A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series,"
Journal of Econometrics,
Elsevier, vol. 135(1-2), pages 499-526.
- Massimiliano Marcellino & James Stock & Mark Watson, 2005. "A Comparison of Direct and Iterated Multistep AR Methods for Forecasting Macroeconomic Time Series," Working Papers 285, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
- Marcellino, Massimiliano & Stock, James H & Watson, Mark W, 2005. "A Comparison of Direct and Iterated Multistep AR Methods for Forecasting Macroeconomic Time Series," CEPR Discussion Papers 4976, C.E.P.R. Discussion Papers.
- Timmermann, Allan G, 2005.
CEPR Discussion Papers
5361, C.E.P.R. Discussion Papers.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521634809, November.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
- Beach, Charles M & Davidson, Russell, 1983. "Distribution-Free Statistical Inference with Lorenz Curves and Income Shares," Review of Economic Studies, Wiley Blackwell, vol. 50(4), pages 723-35, October.
- Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor and Francis Journals, vol. 29(5-6), pages 534-570.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Roberto Patuelli).
If references are entirely missing, you can add them using this form.