IDEAS home Printed from https://ideas.repec.org/a/taf/jnlasa/v114y2019i526p804-819.html
   My bibliography  Save this article

Optimal Forecast Reconciliation for Hierarchical and Grouped Time Series Through Trace Minimization

Author

Listed:
  • Shanika L. Wickramasuriya
  • George Athanasopoulos
  • Rob J. Hyndman

Abstract

Large collections of time series often have aggregation constraints due to product or geographical groupings. The forecasts for the most disaggregated series are usually required to add-up exactly to the forecasts of the aggregated series, a constraint we refer to as “coherence.” Forecast reconciliation is the process of adjusting forecasts to make them coherent.The reconciliation algorithm proposed by Hyndman et al. (2011) is based on a generalized least squares estimator that requires an estimate of the covariance matrix of the coherency errors (i.e., the errors that arise due to incoherence). We show that this matrix is impossible to estimate in practice due to identifiability conditions.We propose a new forecast reconciliation approach that incorporates the information from a full covariance matrix of forecast errors in obtaining a set of coherent forecasts. Our approach minimizes the mean squared error of the coherent forecasts across the entire collection of time series under the assumption of unbiasedness. The minimization problem has a closed-form solution. We make this solution scalable by providing a computationally efficient representation.We evaluate the performance of the proposed method compared to alternative methods using a series of simulation designs which take into account various features of the collected time series. This is followed by an empirical application using Australian domestic tourism data. The results indicate that the proposed method works well with artificial and real data. Supplementary materials for this article are available online.

Suggested Citation

  • Shanika L. Wickramasuriya & George Athanasopoulos & Rob J. Hyndman, 2019. "Optimal Forecast Reconciliation for Hierarchical and Grouped Time Series Through Trace Minimization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 804-819, April.
  • Handle: RePEc:taf:jnlasa:v:114:y:2019:i:526:p:804-819
    DOI: 10.1080/01621459.2018.1448825
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/01621459.2018.1448825
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/01621459.2018.1448825?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Athanasopoulos, George & Ahmed, Roman A. & Hyndman, Rob J., 2009. "Hierarchical forecasts for Australian domestic tourism," International Journal of Forecasting, Elsevier, vol. 25(1), pages 146-166.
    2. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    3. Schäfer Juliane & Strimmer Korbinian, 2005. "A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, November.
    4. Hyndman, Rob J. & Lee, Alan J. & Wang, Earo, 2016. "Fast computation of reconciled forecasts for hierarchical and grouped time series," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 16-32.
    5. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    6. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    7. E. Shlifer & R. W. Wolff, 1979. "Aggregation and Proration in Forecasting," Management Science, INFORMS, vol. 25(6), pages 594-603, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Panagiotelis, Anastasios & Gamakumara, Puwasala & Athanasopoulos, George & Hyndman, Rob J., 2023. "Probabilistic forecast reconciliation: Properties, evaluation and score optimisation," European Journal of Operational Research, Elsevier, vol. 306(2), pages 693-706.
    2. Shanika L Wickramasuriya & George Athanasopoulos & Rob J Hyndman, 2015. "Forecasting hierarchical and grouped time series through trace minimization," Monash Econometrics and Business Statistics Working Papers 15/15, Monash University, Department of Econometrics and Business Statistics.
    3. George Athanasopoulos & Puwasala Gamakumara & Anastasios Panagiotelis & Rob J Hyndman & Mohamed Affan, 2019. "Hierarchical Forecasting," Monash Econometrics and Business Statistics Working Papers 2/19, Monash University, Department of Econometrics and Business Statistics.
    4. Pritularga, Kandrika F. & Svetunkov, Ivan & Kourentzes, Nikolaos, 2021. "Stochastic coherency in forecast reconciliation," International Journal of Production Economics, Elsevier, vol. 240(C).
    5. Han Lin Shang, 2017. "Reconciling Forecasts of Infant Mortality Rates at National and Sub-National Levels: Grouped Time-Series Methods," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 36(1), pages 55-84, February.
    6. Eckert, Florian & Hyndman, Rob J. & Panagiotelis, Anastasios, 2021. "Forecasting Swiss exports using Bayesian forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 291(2), pages 693-710.
    7. Kourentzes, Nikolaos & Athanasopoulos, George, 2019. "Cross-temporal coherent forecasts for Australian tourism," Annals of Tourism Research, Elsevier, vol. 75(C), pages 393-409.
    8. Leprince, Julien & Madsen, Henrik & Møller, Jan Kloppenborg & Zeiler, Wim, 2023. "Hierarchical learning, forecasting coherent spatio-temporal individual and aggregated building loads," Applied Energy, Elsevier, vol. 348(C).
    9. Bergsteinsson, Hjörleifur G. & Møller, Jan Kloppenborg & Nystrup, Peter & Pálsson, Ólafur Pétur & Guericke, Daniela & Madsen, Henrik, 2021. "Heat load forecasting using adaptive temporal hierarchies," Applied Energy, Elsevier, vol. 292(C).
    10. Nystrup, Peter & Lindström, Erik & Møller, Jan K. & Madsen, Henrik, 2021. "Dimensionality reduction in forecasting with temporal hierarchies," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1127-1146.
    11. Jeon, Jooyoung & Panagiotelis, Anastasios & Petropoulos, Fotios, 2019. "Probabilistic forecast reconciliation with applications to wind power and electric load," European Journal of Operational Research, Elsevier, vol. 279(2), pages 364-379.
    12. Abouarghoub, Wessam & Nomikos, Nikos K. & Petropoulos, Fotios, 2018. "On reconciling macro and micro energy transport forecasts for strategic decision making in the tanker industry," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 113(C), pages 225-238.
    13. Hakeem‐Ur Rehman & Guohua Wan & Raza Rafique, 2023. "A hybrid approach with step‐size aggregation to forecasting hierarchical time series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(1), pages 176-192, January.
    14. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    15. Kourentzes, Nikolaos & Saayman, Andrea & Jean-Pierre, Philippe & Provenzano, Davide & Sahli, Mondher & Seetaram, Neelu & Volo, Serena, 2021. "Visitor arrivals forecasts amid COVID-19: A perspective from the Africa team," Annals of Tourism Research, Elsevier, vol. 88(C).
    16. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    17. Spiliotis, Evangelos & Petropoulos, Fotios & Kourentzes, Nikolaos & Assimakopoulos, Vassilios, 2018. "Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption," MPRA Paper 91762, University Library of Munich, Germany.
    18. Li Bai & Pierre Pinson, 2019. "Distributed Reconciliation in Day-Ahead Wind Power Forecasting," Energies, MDPI, vol. 12(6), pages 1-19, March.
    19. George Athanasopoulos & Rob J Hyndman & Nikolaos Kourentzes & Anastasios Panagiotelis, 2023. "Forecast Reconciliation: A Review," Monash Econometrics and Business Statistics Working Papers 8/23, Monash University, Department of Econometrics and Business Statistics.
    20. Jeroen Rombouts & Marie Ternes & Ines Wilms, 2024. "Cross-Temporal Forecast Reconciliation at Digital Platforms with Machine Learning," Papers 2402.09033, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlasa:v:114:y:2019:i:526:p:804-819. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UASA20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.