IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v65y2023i4d10.1007_s00181-023-02389-8.html
   My bibliography  Save this article

An artificial intelligence approach to forecasting when there are structural breaks: a reinforcement learning-based framework for fast switching

Author

Listed:
  • Jeronymo Marcondes Pinto

    (Secretariat of Labour Inspection)

  • Emerson Fernandes Marçal

    (CEMAP-EESP-FGV)

Abstract

Economic forecasting during structural breaks is challenging due to the possible systematic failure of existent models. Robust forecast devices are able to provide unbiased forecasts just after structural change but at the cost of higher variance in normal times. Therefore, there is a trade-off between bias and variance when we intend to forecast a variable under the possibility of structural breaks. In order to choose the best model for each case scenario, we propose a novel algorithm based on the Reinforcement Learning method. Our method is able to gather history performance from all the tested models and choose the one with best performance depending on the “state” of data as soon as the effects of this change are perceived. Hence, our method is able to adapt to the changes of the structural break very fast and change back to a model with less variance as soon as those effects vanish. We provide evidence based on an extensive and rigorous empirical test with Monte Carlo and real data forecasting exercises that this algorithm can improve forecast performance in a scenario of structural change without losing significant performance under normal times.

Suggested Citation

  • Jeronymo Marcondes Pinto & Emerson Fernandes Marçal, 2023. "An artificial intelligence approach to forecasting when there are structural breaks: a reinforcement learning-based framework for fast switching," Empirical Economics, Springer, vol. 65(4), pages 1729-1759, October.
  • Handle: RePEc:spr:empeco:v:65:y:2023:i:4:d:10.1007_s00181-023-02389-8
    DOI: 10.1007/s00181-023-02389-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-023-02389-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-023-02389-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    2. Jeronymo Marcondes Pinto & Jennifer L. Castle, 2022. "Machine Learning Dynamic Switching Approach to Forecasting in the Presence of Structural Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 18(2), pages 129-157, July.
    3. Inoue, Atsushi & Jin, Lu & Rossi, Barbara, 2017. "Rolling window selection for out-of-sample forecasting with time-varying parameters," Journal of Econometrics, Elsevier, vol. 196(1), pages 55-67.
    4. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    5. Castle, Jennifer L. & Clements, Michael P. & Hendry, David F., 2015. "Robust approaches to forecasting," International Journal of Forecasting, Elsevier, vol. 31(1), pages 99-112.
    6. Hendry, David F., 2006. "Robustifying forecasts from equilibrium-correction systems," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 399-426.
    7. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    8. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809, January.
    9. Erdenebat Bataa & Denise R. Osborn & Marianne Sensier & Dick van Dijk, 2013. "Structural Breaks in the International Dynamics of Inflation," The Review of Economics and Statistics, MIT Press, vol. 95(2), pages 646-659, May.
    10. Giorgio Canarella & Stephen M. Miller, 2016. "Inflation Persistence and Structural Breaks: The Experience of Inflation Targeting Countries and the US," Working papers 2016-11, University of Connecticut, Department of Economics.
    11. Chen-Fu Chien & Yun-Siang Lin & Sheng-Kai Lin, 2020. "Deep reinforcement learning for selecting demand forecast models to empower Industry 3.5 and an empirical study for a semiconductor component distributor," International Journal of Production Research, Taylor & Francis Journals, vol. 58(9), pages 2784-2804, May.
    12. Castle, Jennifer L. & Fawcett, Nicholas W.P. & Hendry, David F., 2010. "Forecasting with equilibrium-correction models during structural breaks," Journal of Econometrics, Elsevier, vol. 158(1), pages 25-36, September.
    13. Jennifer L. Castle & Michael P. Clements & David F. Hendry, 2016. "An Overview of Forecasting Facing Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 3-23, September.
    14. Shahid, Farah & Zameer, Aneela & Muneeb, Muhammad, 2021. "A novel genetic LSTM model for wind power forecast," Energy, Elsevier, vol. 223(C).
    15. Clements, Michael P & Hendry, David F, 1996. "Intercept Corrections and Structural Change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 475-494, Sept.-Oct.
    16. Michael P. Clements & David F. Hendry, 2001. "Forecasting Non-Stationary Economic Time Series," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262531895, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Jeronymo Marcondes Pinto & Jennifer L. Castle, 2022. "Machine Learning Dynamic Switching Approach to Forecasting in the Presence of Structural Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 18(2), pages 129-157, July.
    3. Jennifer L. Castle & Michael P. Clements & David F. Hendry, 2016. "An Overview of Forecasting Facing Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 3-23, September.
    4. David Hendry & Michael P. Clements, 2010. "Forecasting from Mis-specified Models in the Presence of Unanticipated Location Shifts," Economics Series Working Papers 484, University of Oxford, Department of Economics.
    5. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    6. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    7. Ericsson, Neil R., 2017. "Economic forecasting in theory and practice: An interview with David F. Hendry," International Journal of Forecasting, Elsevier, vol. 33(2), pages 523-542.
    8. Hendry, David F. & Clements, Michael P., 2003. "Economic forecasting: some lessons from recent research," Economic Modelling, Elsevier, vol. 20(2), pages 301-329, March.
    9. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    10. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    11. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    12. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    13. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    14. Hendry, David F. & Hubrich, Kirstin, 2006. "Forecasting economic aggregates by disaggregates," Working Paper Series 589, European Central Bank.
    15. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    16. Jennifer Castle & David Hendry, 2007. "Forecasting UK Inflation: the Roles of Structural Breaks and Time Disaggregation," Economics Series Working Papers 309, University of Oxford, Department of Economics.
    17. Jennifer L. Castle & Jurgen A. Doornik & David F. Hendry, 2021. "Selecting a Model for Forecasting," Econometrics, MDPI, vol. 9(3), pages 1-35, June.
    18. Larson, William D. & Sinclair, Tara M., 2022. "Nowcasting unemployment insurance claims in the time of COVID-19," International Journal of Forecasting, Elsevier, vol. 38(2), pages 635-647.
    19. Roccazzella, Francesco & Candelon, Bertrand, 2022. "Should we care about ECB inflation expectations?," LIDAM Discussion Papers LFIN 2022004, Université catholique de Louvain, Louvain Finance (LFIN).
    20. Hubrich, Kirstin, 2005. "Forecasting euro area inflation: Does aggregating forecasts by HICP component improve forecast accuracy?," International Journal of Forecasting, Elsevier, vol. 21(1), pages 119-136.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:65:y:2023:i:4:d:10.1007_s00181-023-02389-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.