IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2017-3.html
   My bibliography  Save this paper

Coherent Probabilistic Forecasts for Hierarchical Time Series

Author

Listed:
  • Souhaib Ben Taieb
  • James W. Taylor
  • Rob J. Hyndman

Abstract

Many applications require forecasts for a hierarchy comprising a set of time series along with aggregates of subsets of these series. Although forecasts can be produced independently for each series in the hierarchy, typically this does not lead to coherent forecasts -- the property that forecasts add up appropriately across the hierarchy. State-of-the-art hierarchical forecasting methods usually reconcile the independently generated forecasts to satisfy the aggregation constraints. A fundamental limitation of prior research is that it has considered only the problem of forecasting the mean of each time series. We consider the situation where probabilistic forecasts are needed for each series in the hierarchy. We define forecast coherency in this setting, and propose an algorithm to compute predictive distributions for each series in the hierarchy. Our algorithm has the advantage of synthesizing information from different levels in the hierarchy through a sparse forecast combination and a probabilistic hierarchical aggregation. We evaluate the accuracy of our forecasting algorithm on both simulated data and large-scale electricity smart meter data. The results show consistent performance gains compared to state-of-the art methods.

Suggested Citation

  • Souhaib Ben Taieb & James W. Taylor & Rob J. Hyndman, 2017. "Coherent Probabilistic Forecasts for Hierarchical Time Series," Monash Econometrics and Business Statistics Working Papers 3/17, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2017-3
    as

    Download full text from publisher

    File URL: http://business.monash.edu/econometrics-and-business-statistics/research/publications/ebs/wp03-17.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    2. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    3. Arbenz, Philipp & Hummel, Christoph & Mainik, Georg, 2012. "Copula based hierarchical risk aggregation through sample reordering," Insurance: Mathematics and Economics, Elsevier, vol. 51(1), pages 122-133.
    4. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    5. Arora, Siddharth & Taylor, James W., 2016. "Forecasting electricity smart meter data using conditional kernel density estimation," Omega, Elsevier, vol. 59(PA), pages 47-59.
    6. Andrew J. Patton, 2006. "Modelling Asymmetric Exchange Rate Dependence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 527-556, May.
    7. Mirko Kremer & Enno Siemsen & Douglas J. Thomas, 2016. "The Sum and Its Parts: Judgmental Hierarchical Forecasting," Management Science, INFORMS, vol. 62(9), pages 2745-2764, September.
    8. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    9. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    10. Torsten Hothorn & Thomas Kneib & Peter Bühlmann, 2014. "Conditional transformation models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 3-27, January.
    11. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    12. Berrocal, Veronica J. & Raftery, Adrian E. & Gneiting, Tilmann & Steed, Richard C., 2010. "Probabilistic Weather Forecasting for Winter Road Maintenance," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 522-537.
    13. Hyndman, Rob J. & Lee, Alan J. & Wang, Earo, 2016. "Fast computation of reconciled forecasts for hierarchical and grouped time series," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 16-32.
    14. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    15. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    16. Yanqin Fan & Andrew J. Patton, 2014. "Copulas in Econometrics," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 179-200, August.
    17. Shanika L Wickramasuriya & George Athanasopoulos & Rob J Hyndman, 2015. "Forecasting hierarchical and grouped time series through trace minimization," Monash Econometrics and Business Statistics Working Papers 15/15, Monash University, Department of Econometrics and Business Statistics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hong, Tao & Xie, Jingrui & Black, Jonathan, 2019. "Global energy forecasting competition 2017: Hierarchical probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1389-1399.
    2. Jeon, Jooyoung & Panagiotelis, Anastasios & Petropoulos, Fotios, 2019. "Probabilistic forecast reconciliation with applications to wind power and electric load," European Journal of Operational Research, Elsevier, vol. 279(2), pages 364-379.
    3. Ziel, Florian, 2019. "Quantile regression for the qualifying match of GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1400-1408.
    4. Tomokaze Shiratori & Ken Kobayashi & Yuichi Takano, 2020. "Prediction of hierarchical time series using structured regularization and its application to artificial neural networks," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-23, November.
    5. Panagiotelis, Anastasios & Athanasopoulos, George & Gamakumara, Puwasala & Hyndman, Rob J., 2021. "Forecast reconciliation: A geometric view with new insights on bias correction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 343-359.
    6. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    7. Li, Han & Hyndman, Rob J., 2021. "Assessing mortality inequality in the U.S.: What can be said about the future?," Insurance: Mathematics and Economics, Elsevier, vol. 99(C), pages 152-162.
    8. Gary Koop & Stuart McIntyre & James Mitchell & Aubrey Poon, 2020. "Regional output growth in the United Kingdom: More timely and higher frequency estimates from 1970," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(2), pages 176-197, March.
    9. Hollyman, Ross & Petropoulos, Fotios & Tipping, Michael E., 2021. "Understanding forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 294(1), pages 149-160.
    10. Lila, Maurício Franca & Meira, Erick & Cyrino Oliveira, Fernando Luiz, 2022. "Forecasting unemployment in Brazil: A robust reconciliation approach using hierarchical data," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).
    11. Hakeem‐Ur Rehman & Guohua Wan & Raza Rafique, 2023. "A hybrid approach with step‐size aggregation to forecasting hierarchical time series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(1), pages 176-192, January.
    12. Nystrup, Peter & Lindström, Erik & Møller, Jan K. & Madsen, Henrik, 2021. "Dimensionality reduction in forecasting with temporal hierarchies," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1127-1146.
    13. Smyl, Slawek & Hua, N. Grace, 2019. "Machine learning methods for GEFCom2017 probabilistic load forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1424-1431.
    14. Daniele Girolimetto & George Athanasopoulos & Tommaso Di Fonzo & Rob J Hyndman, 2023. "Cross-temporal Probabilistic Forecast Reconciliation," Monash Econometrics and Business Statistics Working Papers 6/23, Monash University, Department of Econometrics and Business Statistics.
    15. Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "Evaluating quantile forecasts in the M5 uncertainty competition," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1531-1545.
    16. Meira, Erick & Lila, Maurício Franca & Cyrino Oliveira, Fernando Luiz, 2023. "A novel reconciliation approach for hierarchical electricity consumption forecasting based on resistant regression," Energy, Elsevier, vol. 269(C).
    17. Brégère, Margaux & Huard, Malo, 2022. "Online hierarchical forecasting for power consumption data," International Journal of Forecasting, Elsevier, vol. 38(1), pages 339-351.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    2. Alexander Henzi & Johanna F. Ziegel & Tilmann Gneiting, 2021. "Isotonic distributional regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 963-993, November.
    3. Werner Ehm & Tilmann Gneiting & Alexander Jordan & Fabian Krüger, 2016. "Of quantiles and expectiles: consistent scoring functions, Choquet representations and forecast rankings," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 505-562, June.
    4. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    5. Tino Werner, 2022. "Elicitability of Instance and Object Ranking," Decision Analysis, INFORMS, vol. 19(2), pages 123-140, June.
    6. Lahiri, Kajal & Yang, Liu, 2013. "Forecasting Binary Outcomes," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106, Elsevier.
    7. Emilio Zanetti Chini, 2018. "Forecasters’ utility and forecast coherence," CREATES Research Papers 2018-23, Department of Economics and Business Economics, Aarhus University.
    8. Ruben Loaiza‐Maya & Gael M. Martin & David T. Frazier, 2021. "Focused Bayesian prediction," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(5), pages 517-543, August.
    9. Hajo Holzmann & Matthias Eulert, 2014. "The role of the information set for forecasting - with applications to risk management," Papers 1404.7653, arXiv.org.
    10. Gensler, André & Sick, Bernhard & Vogt, Stephan, 2018. "A review of uncertainty representations and metaverification of uncertainty assessment techniques for renewable energies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 352-379.
    11. Tobias Fissler & Hajo Holzmann, 2022. "Measurability of functionals and of ideal point forecasts," Papers 2203.08635, arXiv.org.
    12. Marc-Oliver Pohle, 2020. "The Murphy Decomposition and the Calibration-Resolution Principle: A New Perspective on Forecast Evaluation," Papers 2005.01835, arXiv.org.
    13. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    14. Bjørnland, Hilde C. & Ravazzolo, Francesco & Thorsrud, Leif Anders, 2017. "Forecasting GDP with global components: This time is different," International Journal of Forecasting, Elsevier, vol. 33(1), pages 153-173.
    15. Sándor Baran & Patrícia Szokol & Marianna Szabó, 2021. "Truncated generalized extreme value distribution‐based ensemble model output statistics model for calibration of wind speed ensemble forecasts," Environmetrics, John Wiley & Sons, Ltd., vol. 32(6), September.
    16. Matteo Iacopini & Francesco Ravazzolo & Luca Rossini, 2020. "Proper scoring rules for evaluating asymmetry in density forecasting," Papers 2006.11265, arXiv.org, revised Sep 2020.
    17. Luisa Bisaglia & Matteo Grigoletto, 2021. "A new time-varying model for forecasting long-memory series," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 139-155, March.
    18. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    19. Johanna F. Ziegel, 2013. "Coherence and elicitability," Papers 1303.1690, arXiv.org, revised Mar 2014.
    20. Fabian Kruger & Hendrik Plett, 2022. "Prediction intervals for economic fixed-event forecasts," Papers 2210.13562, arXiv.org, revised Mar 2024.

    More about this item

    Keywords

    forecast combination; probabilistic forecast; copula; machine learning.;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2017-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.