IDEAS home Printed from https://ideas.repec.org/a/taf/jnlbes/v39y2021i1p40-53.html
   My bibliography  Save this article

Multi-Horizon Forecast Comparison

Author

Listed:
  • Rogier Quaedvlieg

Abstract

We introduce tests for multi-horizon superior predictive ability (SPA). Rather than comparing forecasts of different models at multiple horizons individually, we propose to jointly consider all horizons of a forecast path. We define the concepts of uniform and average SPA. The former entails superior performance at each individual horizon, while the latter allows inferior performance at some horizons to be compensated by others. The article illustrates how the tests lead to more coherent conclusions, and how they are better able to differentiate between models than the single-horizon tests. We provide an extension of the previously introduced model confidence set to allow for multi-horizon comparison of more than two models. Simulations demonstrate appropriate size and high power. An illustration of the tests on a large set of macroeconomic variables demonstrates the empirical benefits of multi-horizon comparison.

Suggested Citation

  • Rogier Quaedvlieg, 2021. "Multi-Horizon Forecast Comparison," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 40-53, January.
    • Handle: RePEc:taf:jnlbes:v:39:y:2021:i:1:p:40-53
    DOI: 10.1080/07350015.2019.1620074
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07350015.2019.1620074
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/07350015.2019.1620074?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Firat Melih Yilmaz & Engin Yildiztepe, 2024. "Statistical Evaluation of Deep Learning Models for Stock Return Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 63(1), pages 221-244, January.
    2. Andrew Martinez, 2017. "Testing for Differences in Path Forecast Accuracy: Forecast-Error Dynamics Matter," Working Papers (Old Series) 1717, Federal Reserve Bank of Cleveland.
    3. Giovanni Ballarin & Petros Dellaportas & Lyudmila Grigoryeva & Marcel Hirt & Sophie van Huellen & Juan-Pablo Ortega, 2022. "Reservoir Computing for Macroeconomic Forecasting with Mixed Frequency Data," Papers 2211.00363, arXiv.org, revised Jan 2024.
    4. Verena Monschang & Mark Trede & Bernd Wilfling, 2023. "Multi-horizon uniform superior predictive ability revisited: A size-exploiting and consistent test," CQE Working Papers 10623, Center for Quantitative Economics (CQE), University of Muenster.
    5. Corradi, Valentina & Fosten, Jack & Gutknecht, Daniel, 2023. "Out-of-sample tests for conditional quantile coverage an application to Growth-at-Risk," Journal of Econometrics, Elsevier, vol. 236(2).
    6. Lin, Yu & Liao, Qidong & Lin, Zixiao & Tan, Bin & Yu, Yuanyuan, 2022. "A novel hybrid model integrating modified ensemble empirical mode decomposition and LSTM neural network for multi-step precious metal prices prediction," Resources Policy, Elsevier, vol. 78(C).
    7. Philip Beran & Arne Vogler, 2021. "Multi-Day-Ahead Electricity Price Forecasting: A Comparison of fundamental, econometric and hybrid Models," EWL Working Papers 2102, University of Duisburg-Essen, Chair for Management Science and Energy Economics, revised Oct 2021.
    8. Cepni, Oguzhan & Clements, Michael P., 2024. "How local is the local inflation factor? Evidence from emerging European countries," International Journal of Forecasting, Elsevier, vol. 40(1), pages 160-183.
    9. Heni Boubaker & Bassem Saidane & Mouna Ben Saad Zorgati, 2022. "Modelling the dynamics of stock market in the gulf cooperation council countries: evidence on persistence to shocks," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-22, December.
    10. Lazar, Emese & Wang, Shixuan & Xue, Xiaohan, 2023. "Loss function-based change point detection in risk measures," European Journal of Operational Research, Elsevier, vol. 310(1), pages 415-431.
    11. Taylor, James W. & Taylor, Kathryn S., 2023. "Combining probabilistic forecasts of COVID-19 mortality in the United States," European Journal of Operational Research, Elsevier, vol. 304(1), pages 25-41.
    12. Jack Fosten & Daniel Gutknecht & Marc-Oliver Pohle, 2023. "Testing Quantile Forecast Optimality," Papers 2302.02747, arXiv.org, revised Oct 2023.
    13. Etienne, Xiaoli L. & Farhangdoost, Sara & Hoffman, Linwood A. & Adam, Brian D., 2023. "Forecasting the U.S. season-average farm price of corn: Derivation of an alternative futures-based forecasting model," Journal of Commodity Markets, Elsevier, vol. 30(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlbes:v:39:y:2021:i:1:p:40-53. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UBES20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.