IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v66y2024i5d10.1007_s00181-023-02515-6.html
   My bibliography  Save this article

Benchmarking econometric and machine learning methodologies in nowcasting GDP

Author

Listed:
  • Daniel Hopp

    (UNCTAD)

Abstract

Nowcasting can play a key role in giving policymakers timelier insight to data published with a significant time lag, such as final GDP figures. Currently, there are a plethora of methodologies and approaches for practitioners to choose from. However, there lacks a comprehensive comparison of these disparate approaches in terms of predictive performance and characteristics. This paper addresses that deficiency by examining the performance of 17 different methodologies in nowcasting US quarterly GDP growth, including all the methods most commonly employed in nowcasting, as well as some of the most popular traditional machine learning approaches. Performance was assessed over a 20-year period, from 2002 to 2022. This span encompassed two crises, the 2008 financial crisis and the COVID crisis, as well as extended tranquil periods. The two best-performing methodologies in the analysis were long short-term memory artificial neural networks (LSTM) and Bayesian vector autoregression (Bayesian VAR). To facilitate further application and testing of each of the examined methodologies, an open-source repository containing boilerplate code that can be applied to different datasets is published alongside the paper, available at: github.com/dhopp1/nowcasting_benchmark

Suggested Citation

  • Daniel Hopp, 2024. "Benchmarking econometric and machine learning methodologies in nowcasting GDP," Empirical Economics, Springer, vol. 66(5), pages 2191-2247, May.
  • Handle: RePEc:spr:empeco:v:66:y:2024:i:5:d:10.1007_s00181-023-02515-6
    DOI: 10.1007/s00181-023-02515-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-023-02515-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-023-02515-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Roberto S. Mariano & Yasutomo Murasawa, 2003. "A new coincident index of business cycles based on monthly and quarterly series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 427-443.
    2. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    3. Carriero, Andrea & Galvão, Ana Beatriz & Kapetanios, George, 2019. "A comprehensive evaluation of macroeconomic forecasting methods," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1226-1239.
    4. Banbura, Marta & Rünstler, Gerhard, 2011. "A look into the factor model black box: Publication lags and the role of hard and soft data in forecasting GDP," International Journal of Forecasting, Elsevier, vol. 27(2), pages 333-346, April.
    5. Venus Khim-Sen Liew, 2004. "Which Lag Length Selection Criteria Should We Employ?," Economics Bulletin, AccessEcon, vol. 3(33), pages 1-9.
    6. Andrii Babii & Eric Ghysels & Jonas Striaukas, 2022. "Machine Learning Time Series Regressions With an Application to Nowcasting," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1094-1106, June.
    7. Eickmeier, Sandra & Ng, Tim, 2011. "Forecasting national activity using lots of international predictors: An application to New Zealand," International Journal of Forecasting, Elsevier, vol. 27(2), pages 496-511, April.
    8. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    9. Tony Chernis & Rodrigo Sekkel, 2017. "A dynamic factor model for nowcasting Canadian GDP growth," Empirical Economics, Springer, vol. 53(1), pages 217-234, August.
    10. Giannone, Domenico & Reichlin, Lucrezia & Simonelli, Saverio, 2009. "Nowcasting Euro Area Economic Activity in Real Time: The Role of Confidence Indicators," National Institute Economic Review, National Institute of Economic and Social Research, vol. 210, pages 90-97, October.
    11. Frank Schorfheide & Dongho Song, 2015. "Real-Time Forecasting With a Mixed-Frequency VAR," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 366-380, July.
    12. Kuzin, Vladimir & Marcellino, Massimiliano & Schumacher, Christian, 2011. "MIDAS vs. mixed-frequency VAR: Nowcasting GDP in the euro area," International Journal of Forecasting, Elsevier, vol. 27(2), pages 529-542.
    13. Richardson, Adam & van Florenstein Mulder, Thomas & Vehbi, Tuğrul, 2021. "Nowcasting GDP using machine-learning algorithms: A real-time assessment," International Journal of Forecasting, Elsevier, vol. 37(2), pages 941-948.
    14. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    15. Massimiliano Marcellino & Christian Schumacher, 2010. "Factor MIDAS for Nowcasting and Forecasting with Ragged‐Edge Data: A Model Comparison for German GDP," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(4), pages 518-550, August.
    16. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    17. Singh, Rama Krishna & Prajneshu, 2008. "Artificial Neural Network Methodology for Modelling and Forecasting Maize Crop Yield," Agricultural Economics Research Review, Agricultural Economics Research Association (India), vol. 21(01).
    18. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    19. Richardson, Adam & van Florenstein Mulder, Thomas & Vehbi, Tuğrul, 2021. "Nowcasting GDP using machine-learning algorithms: A real-time assessment," International Journal of Forecasting, Elsevier, vol. 37(2), pages 941-948.
    20. James H. Stock & Mark W. Watson, 2001. "Vector Autoregressions," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 101-115, Fall.
    21. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    22. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.
    23. Loermann, Julius & Maas, Benedikt, 2019. "Nowcasting US GDP with artificial neural networks," MPRA Paper 95459, University Library of Munich, Germany.
    24. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    25. Domenico Giannone & Lucrezia Reichlin & David H. Small, 2005. "Nowcasting GDP and inflation: the real-time informational content of macroeconomic data releases," Finance and Economics Discussion Series 2005-42, Board of Governors of the Federal Reserve System (U.S.).
    26. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    27. repec:ulb:ulbeco:2013/13388 is not listed on IDEAS
    28. Jansen, W. Jos & Jin, Xiaowen & de Winter, Jasper M., 2016. "Forecasting and nowcasting real GDP: Comparing statistical models and subjective forecasts," International Journal of Forecasting, Elsevier, vol. 32(2), pages 411-436.
    29. Barış Soybilgen & Ege Yazgan, 2021. "Nowcasting US GDP Using Tree-Based Ensemble Models and Dynamic Factors," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 387-417, January.
    30. Hallin, Marc & Liska, Roman, 2011. "Dynamic factors in the presence of blocks," Journal of Econometrics, Elsevier, vol. 163(1), pages 29-41, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Elizaveta Volgina, 2025. "Forecasting Inflation Using News Indices," Russian Journal of Money and Finance, Bank of Russia, vol. 84(1), pages 26-59, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel Hopp, 2022. "Benchmarking Econometric and Machine Learning Methodologies in Nowcasting," Papers 2205.03318, arXiv.org.
    2. Danilo Cascaldi-Garcia & Matteo Luciani & Michele Modugno, 2024. "Lessons from nowcasting GDP across the world," Chapters, in: Michael P. Clements & Ana Beatriz Galvão (ed.), Handbook of Research Methods and Applications in Macroeconomic Forecasting, chapter 8, pages 187-217, Edward Elgar Publishing.
    3. Dennis Kant & Andreas Pick & Jasper de Winter, 2025. "Nowcasting GDP using machine learning methods," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 109(1), pages 1-24, March.
    4. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    5. Stavros Degiannakis, 2023. "The D-model for GDP nowcasting," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-33, December.
    6. Samuel N. Cohen & Silvia Lui & Will Malpass & Giulia Mantoan & Lars Nesheim & 'Aureo de Paula & Andrew Reeves & Craig Scott & Emma Small & Lingyi Yang, 2023. "Nowcasting with signature methods," Papers 2305.10256, arXiv.org.
    7. Dennis Kant & Andreas Pick & Jasper de Winter, 2022. "Nowcasting GDP using machine learning methods," Working Papers 754, DNB.
    8. Bańbura, Marta & Giannone, Domenico & Modugno, Michele & Reichlin, Lucrezia, 2013. "Now-Casting and the Real-Time Data Flow," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 195-237, Elsevier.
    9. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2022. "Nowcasting with large Bayesian vector autoregressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 500-519.
    10. Cascaldi-Garcia, Danilo & Ferreira, Thiago R.T. & Giannone, Domenico & Modugno, Michele, 2024. "Back to the present: Learning about the euro area through a now-casting model," International Journal of Forecasting, Elsevier, vol. 40(2), pages 661-686.
    11. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    12. Daniel Hopp, 2021. "Economic Nowcasting with Long Short-Term Memory Artificial Neural Networks (LSTM)," Papers 2106.08901, arXiv.org.
    13. Hopp Daniel, 2022. "Economic Nowcasting with Long Short-Term Memory Artificial Neural Networks (LSTM)," Journal of Official Statistics, Sciendo, vol. 38(3), pages 847-873, September.
    14. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    15. Claudia Foroni & Massimiliano Marcellino, 2013. "A survey of econometric methods for mixed-frequency data," Economics Working Papers ECO2013/02, European University Institute.
    16. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87, May.
    17. James Chapman & Ajit Desai, . "Using payments data to nowcast macroeconomic variables during the onset of Covid-19," Journal of Financial Market Infrastructures, Journal of Financial Market Infrastructures.
    18. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    19. Richardson, Adam & van Florenstein Mulder, Thomas & Vehbi, Tuğrul, 2021. "Nowcasting GDP using machine-learning algorithms: A real-time assessment," International Journal of Forecasting, Elsevier, vol. 37(2), pages 941-948.
    20. Christian Glocker & Philipp Wegmueller, 2020. "Business cycle dating and forecasting with real-time Swiss GDP data," Empirical Economics, Springer, vol. 58(1), pages 73-105, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:66:y:2024:i:5:d:10.1007_s00181-023-02515-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.