IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v58y2020i1d10.1007_s00181-019-01704-6.html
   My bibliography  Save this article

Assessing nowcast accuracy of US GDP growth in real time: the role of booms and busts

Author

Listed:
  • Boriss Siliverstovs

    (Bank of Latvia
    KOF Swiss Economic Institute, ETH Zürich)

Abstract

In this paper, we reassess the forecasting performance of the Bayesian mixed-frequency model suggested in Carriero et al. (2015) in terms of point and density forecasts of the GDP growth rate using US macroeconomic data. Following Chauvet and Potter (2013), we evaluate the forecasting accuracy of the model relative to a univariate AR(2) model separately for expansions and recessions, as defined by the NBER business cycle chronology, rather than relying on a comparison of forecast accuracy over the whole forecast sample spanning 1985Q1–2011Q3. We find that most of the evidence favouring the more sophisticated model over the simple benchmark model is due to relatively few observations during recessions, especially those during the Great Recession. In contrast, during expansions, the gains in forecasting accuracy over the benchmark model are at best very modest. This implies that the relative forecasting performance of the models varies with business cycle phases. Ignoring this fact results in a distorted picture, the relative performance of the more sophisticated model in comparison with the naive benchmark model tends to be overstated during expansions and understated during recessions.

Suggested Citation

  • Boriss Siliverstovs, 2020. "Assessing nowcast accuracy of US GDP growth in real time: the role of booms and busts," Empirical Economics, Springer, vol. 58(1), pages 7-27, January.
  • Handle: RePEc:spr:empeco:v:58:y:2020:i:1:d:10.1007_s00181-019-01704-6
    DOI: 10.1007/s00181-019-01704-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-019-01704-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-019-01704-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Eric Ghysels & Arthur Sinko & Rossen Valkanov, 2007. "MIDAS Regressions: Further Results and New Directions," Econometric Reviews, Taylor & Francis Journals, vol. 26(1), pages 53-90.
    2. Claudia Foroni & Massimiliano Marcellino, 2013. "A survey of econometric methods for mixed-frequency data," Working Paper 2013/06, Norges Bank.
    3. Boriss Siliverstovs, 2017. "Short-term forecasting with mixed-frequency data: a MIDASSO approach," Applied Economics, Taylor & Francis Journals, vol. 49(13), pages 1326-1343, March.
    4. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    5. Heiner F. Mikosch & Stefan Neuwirth, 2015. "Real-Time Forecasting with a MIDAS VAR," KOF Working papers 15-377, KOF Swiss Economic Institute, ETH Zurich.
    6. Giannone, Domenico & Monti, Francesca & Reichlin, Lucrezia, 2016. "Exploiting the monthly data flow in structural forecasting," Journal of Monetary Economics, Elsevier, vol. 84(C), pages 201-215.
    7. Michael W. McCracken & Michael T. Owyang & Tatevik Sekhposyan, 2021. "Real-Time Forecasting and Scenario Analysis Using a Large Mixed-Frequency Bayesian VAR," International Journal of Central Banking, International Journal of Central Banking, vol. 17(71), pages 1-41, December.
    8. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    9. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    10. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    11. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    12. Todd E. Clark, 2011. "Real-Time Density Forecasts From Bayesian Vector Autoregressions With Stochastic Volatility," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 327-341, July.
    13. Geweke, John & Amisano, Gianni, 2010. "Comparing and evaluating Bayesian predictive distributions of asset returns," International Journal of Forecasting, Elsevier, vol. 26(2), pages 216-230, April.
    14. Frank Schorfheide & Dongho Song, 2015. "Real-Time Forecasting With a Mixed-Frequency VAR," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 366-380, July.
    15. Massimiliano Marcellino & Christian Schumacher, 2010. "Factor MIDAS for Nowcasting and Forecasting with Ragged‐Edge Data: A Model Comparison for German GDP," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(4), pages 518-550, August.
    16. Joshua C. C. Chan, 2017. "The Stochastic Volatility in Mean Model With Time-Varying Parameters: An Application to Inflation Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 17-28, January.
    17. Zhang, Bo & Chan, Joshua C.C. & Cross, Jamie L., 2020. "Stochastic volatility models with ARMA innovations: An application to G7 inflation forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1318-1328.
    18. Massimiliano Marcellino & Mario Porqueddu & Fabrizio Venditti, 2016. "Short-Term GDP Forecasting With a Mixed-Frequency Dynamic Factor Model With Stochastic Volatility," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(1), pages 118-127, January.
    19. Ghysels, Eric & Santa-Clara, Pedro & Valkanov, Rossen, 2004. "The MIDAS Touch: Mixed Data Sampling Regression Models," University of California at Los Angeles, Anderson Graduate School of Management qt9mf223rs, Anderson Graduate School of Management, UCLA.
    20. repec:zbw:bofitp:urn:nbn:fi:bof-201504131156 is not listed on IDEAS
    21. Gian Luigi Mazzi & James Mitchell & Gaetana Montana, 2014. "Density Nowcasts and Model Combination: Nowcasting Euro-Area GDP Growth over the 2008–09 Recession," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(2), pages 233-256, April.
    22. Claudia Foroni & Massimiliano Marcellino & Christian Schumacher, 2015. "Unrestricted mixed data sampling (MIDAS): MIDAS regressions with unrestricted lag polynomials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(1), pages 57-82, January.
    23. Pierre Guérin & Massimiliano Marcellino, 2013. "Markov-Switching MIDAS Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 45-56, January.
    24. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    25. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    26. repec:zbw:bofitp:2015_013 is not listed on IDEAS
    27. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Caroline Jardet & Baptiste Meunier, 2022. "Nowcasting world GDP growth with high‐frequency data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1181-1200, September.
    2. Boriss Siliverstovs & Daniel S. Wochner, 2021. "State‐dependent evaluation of predictive ability," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 547-574, April.
    3. Magnus Kvåle Helliesen & Håvard Hungnes & Terje Skjerpen, 2022. "Revisions in the Norwegian National Accounts: accuracy, unbiasedness and efficiency in preliminary figures," Empirical Economics, Springer, vol. 62(3), pages 1079-1121, March.
    4. Boriss Siliverstovs & Daniel Wochner, 2019. "Recessions as Breadwinner for Forecasters State-Dependent Evaluation of Predictive Ability: Evidence from Big Macroeconomic US Data," KOF Working papers 19-463, KOF Swiss Economic Institute, ETH Zurich.
    5. António Duarte Santos & Hélio Castro, 2022. "Housing and Setting Constraints: The Portuguese Evidence," Sustainability, MDPI, vol. 14(18), pages 1-14, September.
    6. Ghulame Rubbaniy & Ali Awais Khalid & Stathis Polyzos & Balqees Naser Almessabi, 2022. "Cyclicality of capital adequacy ratios in heterogeneous environment: A nonlinear panel smooth transition regression explanation," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(6), pages 1960-1979, September.
    7. Boriss Siliverstovs, 2021. "Gauging the Effect of Influential Observations on Measures of Relative Forecast Accuracy in a Post-COVID-19 Era: Application to Nowcasting Euro Area GDP Growth," Working Papers 2021/01, Latvijas Banka.
    8. Boriss Siliverstovs, 2021. "New York FED Staff Nowcasts and Reality: What Can We Learn about the Future, the Present, and the Past?," Econometrics, MDPI, vol. 9(1), pages 1-25, March.
    9. Daniel Wochner, 2020. "Dynamic Factor Trees and Forests – A Theory-led Machine Learning Framework for Non-Linear and State-Dependent Short-Term U.S. GDP Growth Predictions," KOF Working papers 20-472, KOF Swiss Economic Institute, ETH Zurich.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    2. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    3. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    4. Knut Are Aastveit & Francesco Ravazzolo & Herman K. van Dijk, 2018. "Combined Density Nowcasting in an Uncertain Economic Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 131-145, January.
    5. Foroni, Claudia & Guérin, Pierre & Marcellino, Massimiliano, 2015. "Markov-switching mixed-frequency VAR models," International Journal of Forecasting, Elsevier, vol. 31(3), pages 692-711.
    6. Chauvet, Marcelle & Potter, Simon, 2013. "Forecasting Output," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 141-194, Elsevier.
    7. Fabian Krüger & Todd E. Clark & Francesco Ravazzolo, 2017. "Using Entropic Tilting to Combine BVAR Forecasts With External Nowcasts," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 470-485, July.
    8. Markus Heinrich & Magnus Reif, 2018. "Forecasting using mixed-frequency VARs with time-varying parameters," ifo Working Paper Series 273, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    9. Michal Franta & David Havrlant & Marek Rusnák, 2016. "Forecasting Czech GDP Using Mixed-Frequency Data Models," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(2), pages 165-185, December.
    10. Knut Are Aastveit & Tuva Marie Fastbø & Eleonora Granziera & Kenneth Sæterhagen Paulsen & Kjersti Næss Torstensen, 2020. "Nowcasting Norwegian household consumption with debit card transaction data," Working Paper 2020/17, Norges Bank.
    11. Claudia Foroni & Massimiliano Marcellino, 2013. "A survey of econometric methods for mixed-frequency data," Economics Working Papers ECO2013/02, European University Institute.
    12. Bańbura, Marta & Giannone, Domenico & Modugno, Michele & Reichlin, Lucrezia, 2013. "Now-Casting and the Real-Time Data Flow," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 195-237, Elsevier.
    13. Davide Pettenuzzo & Rossen Valkanov & Allan Timmermann, 2014. "A Bayesian MIDAS Approach to Modeling First and Second Moment Dynamics," Working Papers 76, Brandeis University, Department of Economics and International Business School.
    14. Knut Are Aastveit & Claudia Foroni & Francesco Ravazzolo, 2017. "Density Forecasts With Midas Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(4), pages 783-801, June.
    15. Thomas B. Götz & Alain W. Hecq, 2019. "Granger Causality Testing in Mixed‐Frequency VARs with Possibly (Co)Integrated Processes," Journal of Time Series Analysis, Wiley Blackwell, vol. 40(6), pages 914-935, November.
    16. Götz, Thomas B. & Hecq, Alain & Smeekes, Stephan, 2016. "Testing for Granger causality in large mixed-frequency VARs," Journal of Econometrics, Elsevier, vol. 193(2), pages 418-432.
    17. Mogliani, Matteo & Simoni, Anna, 2021. "Bayesian MIDAS penalized regressions: Estimation, selection, and prediction," Journal of Econometrics, Elsevier, vol. 222(1), pages 833-860.
    18. Dhaene, Geert & Wu, Jianbin, 2020. "Incorporating overnight and intraday returns into multivariate GARCH volatility models," Journal of Econometrics, Elsevier, vol. 217(2), pages 471-495.
    19. Andrea Carriero & Todd E. Clark & Marcellino Massimiliano, 2020. "Nowcasting Tail Risks to Economic Activity with Many Indicators," Working Papers 20-13R2, Federal Reserve Bank of Cleveland, revised 22 Sep 2020.
    20. Ankargren Sebastian & Unosson Måns & Yang Yukai, 2020. "A Flexible Mixed-Frequency Vector Autoregression with a Steady-State Prior," Journal of Time Series Econometrics, De Gruyter, vol. 12(2), pages 1-41, July.

    More about this item

    Keywords

    Nowcasting; Mixed-frequency data; Real-time data; Business cycle;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:58:y:2020:i:1:d:10.1007_s00181-019-01704-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.