IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i1p18-38.html
   My bibliography  Save this article

Too similar to combine? On negative weights in forecast combination

Author

Listed:
  • Radchenko, Peter
  • Vasnev, Andrey L.
  • Wang, Wendun

Abstract

This paper provides the first thorough investigation of the negative weights that can emerge when combining forecasts. The usual practice in the literature is to consider only convex combinations and ignore or trim negative weights, i.e., set them to zero. This default strategy has its merits, but it is not optimal. We study the problem from various angles, and the main conclusion is that negative weights emerge when highly correlated forecasts with similar variances are combined. In this situation, the estimated weights have large variances, and trimming reduces the variance of the weights and improves the combined forecast. The threshold of zero is arbitrary and can be improved. We propose an optimal trimming threshold, i.e., an additional tuning parameter to improve forecasting performance. The effects of optimal trimming are demonstrated in simulations. In the empirical example using the European Central Bank Survey of Professional Forecasters, we find that the new strategy performs exceptionally well and can deliver improvements of more than 10% for inflation, up to 20% for GDP growth, and more than 20% for unemployment forecasts relative to the equal-weight benchmark.

Suggested Citation

  • Radchenko, Peter & Vasnev, Andrey L. & Wang, Wendun, 2023. "Too similar to combine? On negative weights in forecast combination," International Journal of Forecasting, Elsevier, vol. 39(1), pages 18-38.
  • Handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:18-38
    DOI: 10.1016/j.ijforecast.2021.08.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207021001242
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2021.08.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Olivier Ledoit & Michael Wolf, 2017. "Nonlinear Shrinkage of the Covariance Matrix for Portfolio Selection: Markowitz Meets Goldilocks," Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4349-4388.
    2. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1683, August.
    3. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    4. Jianqing Fan & Jingjin Zhang & Ke Yu, 2012. "Vast Portfolio Selection With Gross-Exposure Constraints," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 592-606, June.
    5. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    6. Jianqing Fan & Alex Furger & Dacheng Xiu, 2016. "Incorporating Global Industrial Classification Standard Into Portfolio Allocation: A Simple Factor-Based Large Covariance Matrix Estimator With High-Frequency Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 489-503, October.
    7. Jan R. Magnus & Giuseppe De Luca, 2016. "Weighted-Average Least Squares (Wals): A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 30(1), pages 117-148, February.
    8. Robert L. Winkler & Robert T. Clemen, 1992. "Sensitivity of Weights in Combining Forecasts," Operations Research, INFORMS, vol. 40(3), pages 609-614, June.
    9. Roccazzella, Francesco & Gambetti, Paolo & Vrins, Frédéric, 2022. "Optimal and robust combination of forecasts via constrained optimization and shrinkage," International Journal of Forecasting, Elsevier, vol. 38(1), pages 97-116.
    10. Ravi Jagannathan & Tongshu Ma, 2003. "Risk Reduction in Large Portfolios: Why Imposing the Wrong Constraints Helps," Journal of Finance, American Finance Association, vol. 58(4), pages 1651-1684, August.
    11. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    12. Matsypura, Dmytro & Thompson, Ryan & Vasnev, Andrey L., 2018. "Optimal selection of expert forecasts with integer programming," Omega, Elsevier, vol. 78(C), pages 165-175.
    13. Post, Thierry & Karabatı, Selçuk & Arvanitis, Stelios, 2019. "Robust optimization of forecast combinations," International Journal of Forecasting, Elsevier, vol. 35(3), pages 910-926.
    14. Christopher G. Gibbs & Andrey L. Vasnev, 2017. "Conditionally Optimal Weights and Forward-Looking Approaches to Combining Forecasts," Discussion Papers 2017-10, School of Economics, The University of New South Wales.
    15. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    16. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Clements, Adam & Vasnev, Andrey, 2021. "Forecast combination puzzle in the HAR model," Working Papers BAWP-2021-01, University of Sydney Business School, Discipline of Business Analytics.
    2. Qiu, Yue & Zheng, Yuchen, 2023. "Improving box office projections through sentiment analysis: Insights from regularization-based forecast combinations," Economic Modelling, Elsevier, vol. 125(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhentao Shi & Liangjun Su & Tian Xie, 2020. "L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis," Papers 2010.09477, arXiv.org, revised Aug 2022.
    2. Roccazzella, Francesco & Gambetti, Paolo & Vrins, Frédéric, 2022. "Optimal and robust combination of forecasts via constrained optimization and shrinkage," International Journal of Forecasting, Elsevier, vol. 38(1), pages 97-116.
    3. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2019. "On the Forecast Combination Puzzle," Econometrics, MDPI, vol. 7(3), pages 1-26, September.
    4. Ding, Yi & Li, Yingying & Zheng, Xinghua, 2021. "High dimensional minimum variance portfolio estimation under statistical factor models," Journal of Econometrics, Elsevier, vol. 222(1), pages 502-515.
    5. Roccazzella, Francesco & Candelon, Bertrand, 2022. "Should we care about ECB inflation expectations?," LIDAM Discussion Papers LFIN 2022004, Université catholique de Louvain, Louvain Finance (LFIN).
    6. Giovanni Bonaccolto & Massimiliano Caporin & Sandra Paterlini, 2018. "Asset allocation strategies based on penalized quantile regression," Computational Management Science, Springer, vol. 15(1), pages 1-32, January.
    7. Wang, Christina Dan & Chen, Zhao & Lian, Yimin & Chen, Min, 2022. "Asset selection based on high frequency Sharpe ratio," Journal of Econometrics, Elsevier, vol. 227(1), pages 168-188.
    8. Sebastian M. Blanc & Thomas Setzer, 2020. "Bias–Variance Trade-Off and Shrinkage of Weights in Forecast Combination," Management Science, INFORMS, vol. 66(12), pages 5720-5737, December.
    9. Sung Hoon Choi & Donggyu Kim, 2023. "Large Global Volatility Matrix Analysis Based on Observation Structural Information," Papers 2305.01464, arXiv.org, revised Feb 2024.
    10. Sung Hoon Choi & Donggyu Kim, 2022. "Large Volatility Matrix Analysis Using Global and National Factor Models," Papers 2208.12323, arXiv.org, revised Dec 2022.
    11. Choi, Sung Hoon & Kim, Donggyu, 2023. "Large volatility matrix analysis using global and national factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 1917-1933.
    12. Cai, T. Tony & Hu, Jianchang & Li, Yingying & Zheng, Xinghua, 2020. "High-dimensional minimum variance portfolio estimation based on high-frequency data," Journal of Econometrics, Elsevier, vol. 214(2), pages 482-494.
    13. Thomas Conlon & John Cotter & Iason Kynigakis, 2021. "Machine Learning and Factor-Based Portfolio Optimization," Papers 2107.13866, arXiv.org.
    14. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    15. Caner, Mehmet & Medeiros, Marcelo & Vasconcelos, Gabriel F.R., 2023. "Sharpe Ratio analysis in high dimensions: Residual-based nodewise regression in factor models," Journal of Econometrics, Elsevier, vol. 235(2), pages 393-417.
    16. Mathijs Cosemans & Rik Frehen & Peter C. Schotman & Rob Bauer, 2016. "Estimating Security Betas Using Prior Information Based on Firm Fundamentals," Review of Financial Studies, Society for Financial Studies, vol. 29(4), pages 1072-1112.
    17. Paolo Gambetti & Francesco Roccazzella & Frédéric Vrins, 2022. "Meta-Learning Approaches for Recovery Rate Prediction," Risks, MDPI, vol. 10(6), pages 1-29, June.
    18. Chiang, I-Hsuan Ethan & Liao, Yin & Zhou, Qing, 2021. "Modeling the cross-section of stock returns using sensible models in a model pool," Journal of Empirical Finance, Elsevier, vol. 60(C), pages 56-73.
    19. Sven Husmann & Antoniya Shivarova & Rick Steinert, 2020. "Company classification using machine learning," Papers 2004.01496, arXiv.org, revised May 2020.
    20. Pysarenko, Sergiy & Alexeev, Vitali & Tapon, Francis, 2019. "Predictive blends: Fundamental Indexing meets Markowitz," Journal of Banking & Finance, Elsevier, vol. 100(C), pages 28-42.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:1:p:18-38. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.