IDEAS home Printed from https://ideas.repec.org/p/mse/cesdoc/16036r.html
   My bibliography  Save this paper

Learning Time-Varying Forecast Combinations

Author

Abstract

Combining forecasts has been demonstrated as a robust solution to noisy data, structural breaks, unstable forecasters and shifting environmental dynamics. In practice, sophisticated combination methods have failed to consistently outperform the mean over multiple horizons, pools of varying forecasters and different endogenous variables. This paper addresses the challenge to “develop methods better geared to the intermittent and evolving nature of predictive relations”, noted in Stock and Watson (2001), by proposing an adaptive non-parametric “meta” approach that provides a time-varying hedge against the performance of the mean for any selected forecast combination approach. This approach arguably solves the so-called “Forecast Combination Puzzle” using a meta-algorithm that adaptively hedges weights between the mean and a specific forecast combination algorithm or pool of forecasters augmented with one or more forecast combination algorithms. Theoretical performance bounds are reported and empirical performance is evaluated on the seven country macroeconomic output and inflation dataset introduced in Stock and Watson (2001) as well as the Euro-area Survey of Professional Forecasters

Suggested Citation

  • Antoine Mandel & Amir Sani, 2016. "Learning Time-Varying Forecast Combinations," Documents de travail du Centre d'Economie de la Sorbonne 16036r, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne, revised Sep 2016.
  • Handle: RePEc:mse:cesdoc:16036r
    as

    Download full text from publisher

    File URL: ftp://mse.univ-paris1.fr/pub/mse/CES2016/16036R.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Pesaran, M. Hashem & Timmermann, Allan, 2005. "Small sample properties of forecasts from autoregressive models under structural breaks," Journal of Econometrics, Elsevier, vol. 129(1-2), pages 183-217.
    2. Clements, Michael P. & Hendry, David F., 2006. "Forecasting with Breaks," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 12, pages 605-657, Elsevier.
    3. Carlos Bowles & Roberta Friz & Veronique Genre & Geoff Kenny & Aidan Meyler & Tuomas Rautanen, 2007. "The ECB survey of professional forecasters (SPF) – A review after eight years’ experience," Occasional Paper Series 59, European Central Bank.
    4. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    5. Guidolin, Massimo & Timmermann, Allan, 2009. "Forecasts of US short-term interest rates: A flexible forecast combination approach," Journal of Econometrics, Elsevier, vol. 150(2), pages 297-311, June.
    6. Novales, Alfonso & de Fruto, Rafael Flores, 1997. "Forecasting with periodic models A comparison with time invariant coefficient models," International Journal of Forecasting, Elsevier, vol. 13(3), pages 393-405, September.
    7. Yang, Yuhong, 2004. "Combining Forecasting Procedures: Some Theoretical Results," Econometric Theory, Cambridge University Press, vol. 20(1), pages 176-222, February.
    8. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    9. Yu-Chin Chen & Kenneth S. Rogoff & Barbara Rossi, 2010. "Can Exchange Rates Forecast Commodity Prices?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 1145-1194.
    10. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    11. Todd E. Clark & Michael W. McCracken, 2009. "Combining Forecasts from Nested Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 303-329, June.
    12. Juan Angel Garcia, 2003. "An introduction to the ECB’s survey of professional forecasters," Occasional Paper Series 08, European Central Bank.
    13. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    14. Diebold, Francis X., 1989. "Forecast combination and encompassing: Reconciling two divergent literatures," International Journal of Forecasting, Elsevier, vol. 5(4), pages 589-592.
    15. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    16. Sánchez, Ismael, 2008. "Adaptive combination of forecasts with application to wind energy," International Journal of Forecasting, Elsevier, vol. 24(4), pages 679-693.
    17. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecast combination and the Bank of England's suite of statistical forecasting models," Economic Modelling, Elsevier, vol. 25(4), pages 772-792, July.
    18. Pesaran, M. Hashem & Pick, Andreas & Pranovich, Mikhail, 2013. "Optimal forecasts in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 177(2), pages 134-152.
    19. Kenny, Geoff & Genre, Véronique & Bowles, Carlos & Friz, Roberta & Meyler, Aidan & Rautanen, Tuomas, 2007. "The ECB survey of professional forecasters (SPF) - A review after eight years' experience," Occasional Paper Series 59, European Central Bank.
    20. Gianni De Nicolò & Marcella Lucchetta, 2017. "Forecasting Tail Risks," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 159-170, January.
    21. Pauwels, Laurent L. & Vasnev, Andrey L., 2016. "A note on the estimation of optimal weights for density forecast combinations," International Journal of Forecasting, Elsevier, vol. 32(2), pages 391-397.
    22. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2015. "Complete subset regressions with large-dimensional sets of predictors," Journal of Economic Dynamics and Control, Elsevier, vol. 54(C), pages 86-110.
    23. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    24. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, June.
    25. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809.
    26. Lennart Hoogerheide & Richard Kleijn & Francesco Ravazzolo & Herman K. Van Dijk & Marno Verbeek, 2010. "Forecast accuracy and economic gains from Bayesian model averaging using time-varying weights," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 251-269.
    27. Graham Elliott & Allan Timmermann, 2005. "Optimal Forecast Combination Under Regime Switching ," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(4), pages 1081-1102, November.
    28. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2013. "Complete subset regressions," Journal of Econometrics, Elsevier, vol. 177(2), pages 357-373.
    29. Diebold, Francis X. & Pauly, Peter, 1990. "The use of prior information in forecast combination," International Journal of Forecasting, Elsevier, vol. 6(4), pages 503-508, December.
    30. Patton, Andrew J. & Sheppard, Kevin, 2009. "Optimal combinations of realised volatility estimators," International Journal of Forecasting, Elsevier, vol. 25(2), pages 218-238.
    31. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    32. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    33. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    34. Carlos Bowles & Roberta Friz & Veronique Genre & Geoff Kenny & Aidan Meyler & Tuomas Rautanen, 2010. "An Evaluation of the Growth and Unemployment Forecasts in the ECB Survey of Professional Forecasters," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(2), pages 1-28.
    35. Eleonora Granziera & Corinne Luu & Pierre St-Amant, 2013. "The Accuracy of Short-Term Forecast Combinations," Bank of Canada Review, Bank of Canada, vol. 2013(Summer), pages 13-21.
    36. LeSage, James P & Magura, Michael, 1992. "A Mixture-Model Approach to Combining Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 445-452, October.
    37. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    38. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    39. Tian, Jing & Anderson, Heather M., 2014. "Forecast combinations under structural break uncertainty," International Journal of Forecasting, Elsevier, vol. 30(1), pages 161-175.
    40. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    41. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    42. Sancetta, Alessio, 2010. "Recursive Forecast Combination For Dependent Heterogeneous Data," Econometric Theory, Cambridge University Press, vol. 26(2), pages 598-631, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:hal:spmain:info:hdl:2441/4pa18fd9lf9h59m4vfavfcf61e is not listed on IDEAS
    2. Sylvain Barde & Sander van Der Hoog, 2017. "An empirical validation protocol for large-scale agent-based models," Working Papers hal-03458672, HAL.
    3. Álvarez, Luis J. & Sánchez, Isabel, 2019. "Inflation projections for monetary policy decision making," Journal of Policy Modeling, Elsevier, vol. 41(4), pages 568-585.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antoine Mandel & Amir Sani, 2017. "A Machine Learning Approach to the Forecast Combination Puzzle," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01317974, HAL.
    2. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    3. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    4. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    5. Yongchen Zhao, 2021. "The robustness of forecast combination in unstable environments: a Monte Carlo study of advanced algorithms," Empirical Economics, Springer, vol. 61(1), pages 173-199, July.
    6. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2019. "On the Forecast Combination Puzzle," Econometrics, MDPI, vol. 7(3), pages 1-26, September.
    7. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    8. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    9. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    10. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    11. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    12. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.
    13. Kourentzes, Nikolaos & Barrow, Devon & Petropoulos, Fotios, 2019. "Another look at forecast selection and combination: Evidence from forecast pooling," International Journal of Production Economics, Elsevier, vol. 209(C), pages 226-235.
    14. Christopher G. Gibbs & Andrey L. Vasnev, 2017. "Conditionally Optimal Weights and Forward-Looking Approaches to Combining Forecasts," Discussion Papers 2017-10, School of Economics, The University of New South Wales.
    15. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2018. "Quantile forecast combination using stochastic dominance," Empirical Economics, Springer, vol. 55(4), pages 1717-1755, December.
    16. Jiun-Hua Su, 2021. "No-Regret Forecasting with Egalitarian Committees," Papers 2109.13801, arXiv.org.
    17. Jing Zeng, 2015. "Combining Country-Specific Forecasts when Forecasting Euro Area Macroeconomic Aggregates," Working Paper Series of the Department of Economics, University of Konstanz 2015-11, Department of Economics, University of Konstanz.
    18. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2015. "On the Forecast Combination Puzzle," Papers 1505.00475, arXiv.org.
    19. Mehmet Pinar & Thanasis Stengos & M. Ege Yazgan, 2012. "Is there an Optimal Forecast Combination? A Stochastic Dominance Approach to Forecast Combination Puzzle," Working Paper series 17_12, Rimini Centre for Economic Analysis.
    20. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.

    More about this item

    Keywords

    Forecast combinations; Forecast combination puzzle; Machine learning; Econometrics;
    All these keywords.

    JEL classification:

    • C71 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Cooperative Games
    • D85 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Network Formation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mse:cesdoc:16036r. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lucie Label (email available below). General contact details of provider: https://edirc.repec.org/data/cenp1fr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.