IDEAS home Printed from https://ideas.repec.org/a/ris/apltrx/0498.html

Forecast evaluation improving using the simplest methods of individual forecasts’ combination

Author

Listed:
  • Ekaterina Astafyeva

    (Russian Presidential Academy of National Economy and Public Administration (RANEPA), Moscow, Russian Federation)

  • Marina Turuntseva

    (Russian Presidential Academy of National Economy and Public Administration (RANEPA), Gaidar Institute, Moscow, Russian Federation;)

Abstract

Combining forecasts is considered the easiest way to improve the forecast quality compared to individual models. In this paper, we test the capabilities of the simplest methods of combination, such as simple averages and estimates based on the standard error of previous forecasts, to improve the performance of short-run forecasts of five resource price indicators (oil and metals). The basis of the work is the Gaidar Institute forecasts database, which provides the database of primary forecasts and allows you to calculate their combinations in real time. Based on the obtained results we conclude that even the simplest methods of combination are a way to improve the accuracy of forecasts. In addition, in the case of resource prices, one can even single out a group of methods (namely, combining with weights inversely proportional to the squared errors of individual forecasts) that provide the maximum gain in quality for the most periods.

Suggested Citation

  • Ekaterina Astafyeva & Marina Turuntseva, 2024. "Forecast evaluation improving using the simplest methods of individual forecasts’ combination," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 74, pages 78-103.
    • Handle: RePEc:ris:apltrx:0498
    as

    Download full text from publisher

    File URL: http://pe.cemi.rssi.ru/pe_2024_74_078-103.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    2. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    3. Magnus, Jan R. & Vasnev, Andrey L., 2023. "On the uncertainty of a combined forecast: The critical role of correlation," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1895-1908.
    4. Robert L. Winkler & Robert T. Clemen, 1992. "Sensitivity of Weights in Combining Forecasts," Operations Research, INFORMS, vol. 40(3), pages 609-614, June.
    5. Radchenko, Peter & Vasnev, Andrey L. & Wang, Wendun, 2023. "Too similar to combine? On negative weights in forecast combination," International Journal of Forecasting, Elsevier, vol. 39(1), pages 18-38.
    6. Claeskens, Gerda & Magnus, Jan R. & Vasnev, Andrey L. & Wang, Wendun, 2016. "The forecast combination puzzle: A simple theoretical explanation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 754-762.
    7. Elliott, Graham & Timmermann, Allan, 2004. "Optimal forecast combinations under general loss functions and forecast error distributions," Journal of Econometrics, Elsevier, vol. 122(1), pages 47-79, September.
    8. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    9. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    10. Jeremy Smith & Kenneth F. Wallis, 2009. "A Simple Explanation of the Forecast Combination Puzzle," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(3), pages 331-355, June.
    11. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    12. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniil Koloskov & Marina Turuntseva, 2025. "The oil and coke prices forecast evaluation using the different forecasting scheme," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 80, pages 5-25.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    2. Gibbs, Christopher G. & Vasnev, Andrey L., 2024. "Conditionally optimal weights and forward-looking approaches to combining forecasts," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1734-1751.
    3. Thompson, Ryan & Qian, Yilin & Vasnev, Andrey L., 2024. "Flexible global forecast combinations," Omega, Elsevier, vol. 126(C).
    4. Blanc, Sebastian M. & Setzer, Thomas, 2016. "When to choose the simple average in forecast combination," Journal of Business Research, Elsevier, vol. 69(10), pages 3951-3962.
    5. Han Su & Xiaojia Guo & Xiaoke Zhang, 2026. "Regularized Ensemble Forecasting for Learning Weights from Historical and Current Forecasts," Papers 2602.11379, arXiv.org.
    6. Sebastian M. Blanc & Thomas Setzer, 2020. "Bias–Variance Trade-Off and Shrinkage of Weights in Forecast Combination," Management Science, INFORMS, vol. 66(12), pages 5720-5737, December.
    7. Kang, Yanfei & Cao, Wei & Petropoulos, Fotios & Li, Feng, 2022. "Forecast with forecasts: Diversity matters," European Journal of Operational Research, Elsevier, vol. 301(1), pages 180-190.
    8. Martin, Gael M. & Loaiza-Maya, Rubén & Maneesoonthorn, Worapree & Frazier, David T. & Ramírez-Hassan, Andrés, 2022. "Optimal probabilistic forecasts: When do they work?," International Journal of Forecasting, Elsevier, vol. 38(1), pages 384-406.
    9. Wei Qian & Craig A. Rolling & Gang Cheng & Yuhong Yang, 2019. "On the Forecast Combination Puzzle," Econometrics, MDPI, vol. 7(3), pages 1-26, September.
    10. Kourentzes, Nikolaos & Barrow, Devon & Petropoulos, Fotios, 2019. "Another look at forecast selection and combination: Evidence from forecast pooling," International Journal of Production Economics, Elsevier, vol. 209(C), pages 226-235.
    11. David Soule & Yael Grushka-Cockayne & Jason Merrick, 2024. "A Heuristic for Combining Correlated Experts When There Are Few Data," Management Science, INFORMS, vol. 70(10), pages 6637-6668, October.
    12. Zhentao Shi & Liangjun Su & Tian Xie, 2020. "L2-Relaxation: With Applications to Forecast Combination and Portfolio Analysis," Papers 2010.09477, arXiv.org, revised Aug 2022.
    13. Lee, Tae-Hwy & Seregina, Ekaterina, 2026. "Combining forecasts under structural breaks using Graphical LASSO," International Journal of Forecasting, Elsevier, vol. 42(1), pages 126-137.
    14. Antoine Mandel & Amir Sani, 2016. "Learning Time-Varying Forecast Combinations," Documents de travail du Centre d'Economie de la Sorbonne 16036, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    15. Francis X. Diebold & Aaron Mora & Minchul Shin, 2025. "On the Wisdom of Crowds (of Economists)," PIER Working Paper Archive 25-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    16. Jing Zeng, 2015. "Combining Country-Specific Forecasts when Forecasting Euro Area Macroeconomic Aggregates," Working Paper Series of the Department of Economics, University of Konstanz 2015-11, Department of Economics, University of Konstanz.
    17. Huiyu Huang & Tae-Hwy Lee, 2010. "To Combine Forecasts or to Combine Information?," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 534-570.
    18. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    19. Wang, Shengjie & Kang, Yanfei & Petropoulos, Fotios, 2024. "Combining probabilistic forecasts of intermittent demand," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1038-1048.
    20. Qiu, Yue & Qu, Shaoguang & Shi, Zhentao & Xie, Tian, 2025. "Predicting cryptocurrency volatility: The power of model clustering," Economic Modelling, Elsevier, vol. 144(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ris:apltrx:0498. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Anatoly Peresetsky (email available below). General contact details of provider: http://appliedeconometrics.cemi.rssi.ru/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.