IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v3y2015i4p797-824d59295.html
   My bibliography  Save this article

Forecast Combination under Heavy-Tailed Errors

Author

Listed:
  • Gang Cheng

    (School of Statistics, University of Minnesota at Twin Cities, 313 Ford Hall, 224 Church Street SE, Minneapolis, MN 55455, USA)

  • Sicong Wang

    (School of Statistics, University of Minnesota at Twin Cities, 313 Ford Hall, 224 Church Street SE, Minneapolis, MN 55455, USA)

  • Yuhong Yang

    (School of Statistics, University of Minnesota at Twin Cities, 313 Ford Hall, 224 Church Street SE, Minneapolis, MN 55455, USA)

Abstract

Forecast combination has been proven to be a very important technique to obtain accurate predictions for various applications in economics, finance, marketing and many other areas. In many applications, forecast errors exhibit heavy-tailed behaviors for various reasons. Unfortunately, to our knowledge, little has been done to obtain reliable forecast combinations for such situations. The familiar forecast combination methods, such as simple average, least squares regression or those based on the variance-covariance of the forecasts, may perform very poorly due to the fact that outliers tend to occur, and they make these methods have unstable weights, leading to un-robust forecasts. To address this problem, in this paper, we propose two nonparametric forecast combination methods. One is specially proposed for the situations in which the forecast errors are strongly believed to have heavy tails that can be modeled by a scaled Student’s t-distribution; the other is designed for relatively more general situations when there is a lack of strong or consistent evidence on the tail behaviors of the forecast errors due to a shortage of data and/or an evolving data-generating process. Adaptive risk bounds of both methods are developed. They show that the resulting combined forecasts yield near optimal mean forecast errors relative to the candidate forecasts. Simulations and a real example demonstrate their superior performance in that they indeed tend to have significantly smaller prediction errors than the previous combination methods in the presence of forecast outliers.

Suggested Citation

  • Gang Cheng & Sicong Wang & Yuhong Yang, 2015. "Forecast Combination under Heavy-Tailed Errors," Econometrics, MDPI, vol. 3(4), pages 1-28, November.
  • Handle: RePEc:gam:jecnmx:v:3:y:2015:i:4:p:797-824:d:59295
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/3/4/797/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2225-1146/3/4/797/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wei, Xiaoqiao & Yang, Yuhong, 2012. "Robust forecast combinations," Journal of Econometrics, Elsevier, vol. 166(2), pages 224-236.
    2. Zou, Hui & Yang, Yuhong, 2004. "Combining time series models for forecasting," International Journal of Forecasting, Elsevier, vol. 20(1), pages 69-84.
    3. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    4. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024, January.
    5. Yuan, Zheng & Yang, Yuhong, 2005. "Combining Linear Regression Models: When and How?," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1202-1214, December.
    6. Sánchez, Ismael, 2008. "Adaptive combination of forecasts with application to wind energy," International Journal of Forecasting, Elsevier, vol. 24(4), pages 679-693.
    7. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    8. Carlo Altavilla & Paul De Grauwe, 2010. "Forecasting and combining competing models of exchange rate determination," Applied Economics, Taylor & Francis Journals, vol. 42(27), pages 3455-3480.
    9. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    10. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    11. Yang, Yuhong, 2004. "Combining Forecasting Procedures: Some Theoretical Results," Econometric Theory, Cambridge University Press, vol. 20(1), pages 176-222, February.
    12. Cheng, Gang & Yang, Yuhong, 2015. "Forecast combination with outlier protection," International Journal of Forecasting, Elsevier, vol. 31(2), pages 223-237.
    13. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    14. Jon D. Samuels & Rodrigo Sekkel, 2013. "Forecasting with Many Models: Model Confidence Sets and Forecast Combination," Staff Working Papers 13-11, Bank of Canada.
    15. Green, Kesten C. & Armstrong, J. Scott, 2015. "Simple versus complex forecasting: The evidence," Journal of Business Research, Elsevier, vol. 68(8), pages 1678-1685.
    16. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    17. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    18. Zhang, Xinyu & Lu, Zudi & Zou, Guohua, 2013. "Adaptively combined forecasting for discrete response time series," Journal of Econometrics, Elsevier, vol. 176(1), pages 80-91.
    19. Ing, Ching-Kang & Sin, Chor-yiu & Yu, Shu-Hui, 2012. "Model selection for integrated autoregressive processes of infinite order," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 57-71.
    20. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    21. Thaís C. O. Fonseca & Marco A. R. Ferreira & Helio S. Migon, 2008. "Objective Bayesian analysis for the Student-t regression model," Biometrika, Biometrika Trust, vol. 95(2), pages 325-333.
    22. Sancetta, Alessio, 2010. "Recursive Forecast Combination For Dependent Heterogeneous Data," Econometric Theory, Cambridge University Press, vol. 26(2), pages 598-631, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jing Zhou & Gerda Claeskens & Jelena Bradic, 2020. "Detangling robustness in high dimensions: composite versus model-averaged estimation," Papers 2006.07457, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Cheng, Gang & Yang, Yuhong, 2015. "Forecast combination with outlier protection," International Journal of Forecasting, Elsevier, vol. 31(2), pages 223-237.
    3. Wei, Xiaoqiao & Yang, Yuhong, 2012. "Robust forecast combinations," Journal of Econometrics, Elsevier, vol. 166(2), pages 224-236.
    4. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    5. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.
    6. Samuels, Jon D. & Sekkel, Rodrigo M., 2017. "Model Confidence Sets and forecast combination," International Journal of Forecasting, Elsevier, vol. 33(1), pages 48-60.
    7. Carlo Altavilla & Matteo Ciccarelli, 2006. "Inflation Forecasts, Monetary Policy and Unemployment Dynamics: Evidence from the US and the Euro Area," Discussion Papers 7_2006, D.E.S. (Department of Economic Studies), University of Naples "Parthenope", Italy.
    8. Yongchen Zhao, 2021. "The robustness of forecast combination in unstable environments: a Monte Carlo study of advanced algorithms," Empirical Economics, Springer, vol. 61(1), pages 173-199, July.
    9. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2019. "On the Forecast Combination Puzzle," Econometrics, MDPI, vol. 7(3), pages 1-26, September.
    10. Chu‐An Liu & Biing‐Shen Kuo, 2016. "Model averaging in predictive regressions," Econometrics Journal, Royal Economic Society, vol. 19(2), pages 203-231, June.
    11. Stavroula P. Fameliti & Vasiliki D. Skintzi, 2020. "Predictive ability and economic gains from volatility forecast combinations," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 200-219, March.
    12. Zhang, Xinyu & Lu, Zudi & Zou, Guohua, 2013. "Adaptively combined forecasting for discrete response time series," Journal of Econometrics, Elsevier, vol. 176(1), pages 80-91.
    13. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    14. Antoine Mandel & Amir Sani, 2016. "Learning Time-Varying Forecast Combinations," Documents de travail du Centre d'Economie de la Sorbonne 16036, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    15. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    16. Antoine Mandel & Amir Sani, 2017. "A Machine Learning Approach to the Forecast Combination Puzzle," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01317974, HAL.
    17. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    18. Cobb, Marcus P A, 2017. "Joint Forecast Combination of Macroeconomic Aggregates and Their Components," MPRA Paper 76556, University Library of Munich, Germany.
    19. Davide De Gaetano, 2017. "Forecasting With Garch Models Under Structural Breaks: An Approach Based On Combinations Across Estimation Windows," Departmental Working Papers of Economics - University 'Roma Tre' 0219, Department of Economics - University Roma Tre.
    20. Andrea Bastianin & Marzio Galeotti & Matteo Manera, 2019. "Statistical and economic evaluation of time series models for forecasting arrivals at call centers," Empirical Economics, Springer, vol. 57(3), pages 923-955, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:3:y:2015:i:4:p:797-824:d:59295. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.