IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v9y2021i1p11-d511974.html
   My bibliography  Save this article

New York FED Staff Nowcasts and Reality: What Can We Learn about the Future, the Present, and the Past?

Author

Listed:
  • Boriss Siliverstovs

    (Monetary Policy Department, Bank of Latvia, K. Valdemara iela 2A, LV-1050 Riga, Latvia
    KOF Swiss Economic Institute, ETH Zurich, Leonhardstrasse 21, 8092 Zürich, Switzerland)

Abstract

We assess the forecasting performance of the nowcasting model developed at the New York FED. We show that the observation regarding a striking difference in the model’s predictive ability across business cycle phases made earlier in the literature also applies here. During expansions, the nowcasting model forecasts at best are at least as good as the historical mean model, whereas during the recessionary periods, there are very substantial gains corresponding in the reduction in MSFE of about 90% relative to the benchmark model. We show how the asymmetry in the relative forecasting performance can be verified by the use of such recursive measures of relative forecast accuracy as Cumulated Sum of Squared Forecast Error Difference (CSSFED) and Recursive Relative Mean Squared Forecast Error (based on Rearranged observations) (R 2 MSFE(+R)). Ignoring these asymmetries results in a biased judgement of the relative forecasting performance of the competing models over a sample as a whole, as well as during economic expansions, when the forecasting accuracy of a more sophisticated model relative to naive benchmark models tends to be overstated. Hence, care needs to be exercised when ranking several models by their forecasting performance without taking into consideration various states of the economy.

Suggested Citation

  • Boriss Siliverstovs, 2021. "New York FED Staff Nowcasts and Reality: What Can We Learn about the Future, the Present, and the Past?," Econometrics, MDPI, vol. 9(1), pages 1-25, March.
  • Handle: RePEc:gam:jecnmx:v:9:y:2021:i:1:p:11-:d:511974
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/9/1/11/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2225-1146/9/1/11/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    2. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    3. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    4. Andrii Babii & Eric Ghysels & Jonas Striaukas, 2022. "Machine Learning Time Series Regressions With an Application to Nowcasting," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1094-1106, June.
    5. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    6. Geweke, John & Amisano, Gianni, 2010. "Comparing and evaluating Bayesian predictive distributions of asset returns," International Journal of Forecasting, Elsevier, vol. 26(2), pages 216-230, April.
    7. Lucia Alessi & Eric Ghysels & Luca Onorante & Richard Peach & Simon Potter, 2014. "Central Bank Macroeconomic Forecasting During the Global Financial Crisis: The European Central Bank and Federal Reserve Bank of New York Experiences," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(4), pages 483-500, October.
    8. Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," Annual Review of Economics, Annual Reviews, vol. 10(1), pages 615-643, August.
    9. Reichlin, Lucrezia & Giannone, Domenico & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
    10. Boriss Siliverstovs & Daniel S. Wochner, 2021. "State‐dependent evaluation of predictive ability," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 547-574, April.
    11. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2022. "Nowcasting with large Bayesian vector autoregressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 500-519.
    12. Boriss Siliverstovs, 2012. "Keeping a Finger on the Pulse of the Economy," KOF Working papers 12-302, KOF Swiss Economic Institute, ETH Zurich.
    13. Cai, Michael & Del Negro, Marco & Giannoni, Marc P. & Gupta, Abhi & Li, Pearl & Moszkowski, Erica, 2019. "DSGE forecasts of the lost recovery," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1770-1789.
    14. Boriss Siliverstovs & Daniel Wochner, 2019. "Recessions as Breadwinner for Forecasters State-Dependent Evaluation of Predictive Ability: Evidence from Big Macroeconomic US Data," KOF Working papers 19-463, KOF Swiss Economic Institute, ETH Zurich.
    15. Siliverstovs, Boriss, 2017. "Dissecting models' forecasting performance," Economic Modelling, Elsevier, vol. 67(C), pages 294-299.
    16. Domenico Giannone & Lucrezia Reichlin & David Small, 2008. "Nowcasting: the real time informational content of macroeconomic data releases," ULB Institutional Repository 2013/6409, ULB -- Universite Libre de Bruxelles.
    17. Siliverstovs Boriss & Kholodilin Konstantin A., 2012. "Assessing the Real-Time Informational Content of Macroeconomic Data Releases for Now-/Forecasting GDP: Evidence for Switzerland," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 232(4), pages 429-444, August.
    18. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    19. Claudia Foroni & Massimiliano Marcellino & Christian Schumacher, 2015. "Unrestricted mixed data sampling (MIDAS): MIDAS regressions with unrestricted lag polynomials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(1), pages 57-82, January.
    20. Boriss Siliverstovs, 2020. "Assessing nowcast accuracy of US GDP growth in real time: the role of booms and busts," Empirical Economics, Springer, vol. 58(1), pages 7-27, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Caroline Jardet & Baptiste Meunier, 2022. "Nowcasting world GDP growth with high‐frequency data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1181-1200, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Boriss Siliverstovs, 2021. "Gauging the Effect of Influential Observations on Measures of Relative Forecast Accuracy in a Post-COVID-19 Era: Application to Nowcasting Euro Area GDP Growth," Working Papers 2021/01, Latvijas Banka.
    2. Knut Are Aastveit & Francesco Ravazzolo & Herman K. van Dijk, 2018. "Combined Density Nowcasting in an Uncertain Economic Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 131-145, January.
    3. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    4. Bańbura, Marta & Giannone, Domenico & Modugno, Michele & Reichlin, Lucrezia, 2013. "Now-Casting and the Real-Time Data Flow," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 195-237, Elsevier.
    5. Klaus Abberger & Michael Graff & Boriss Siliverstovs & Jan-Egbert Sturm, 2014. "The KOF Economic Barometer, Version 2014," KOF Working papers 14-353, KOF Swiss Economic Institute, ETH Zurich.
    6. Bec, Frédérique & Mogliani, Matteo, 2015. "Nowcasting French GDP in real-time with surveys and “blocked” regressions: Combining forecasts or pooling information?," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1021-1042.
    7. Barbaglia, Luca & Frattarolo, Lorenzo & Onorante, Luca & Pericoli, Filippo Maria & Ratto, Marco & Tiozzo Pezzoli, Luca, 2023. "Testing big data in a big crisis: Nowcasting under Covid-19," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1548-1563.
    8. Knut Are Aastveit & Tuva Marie Fastbø & Eleonora Granziera & Kenneth Sæterhagen Paulsen & Kjersti Næss Torstensen, 2020. "Nowcasting Norwegian household consumption with debit card transaction data," Working Paper 2020/17, Norges Bank.
    9. Richard K. Crump & Stefano Eusepi & Domenico Giannone & Eric Qian & Argia M. Sbordone, 2021. "A Large Bayesian VAR of the United States Economy," Staff Reports 976, Federal Reserve Bank of New York.
    10. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    11. Leif Anders Thorsrud, 2016. "Nowcasting using news topics Big Data versus big bank," Working Papers No 6/2016, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    12. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2022. "Nowcasting with large Bayesian vector autoregressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 500-519.
    13. Mogliani, Matteo & Darné, Olivier & Pluyaud, Bertrand, 2017. "The new MIBA model: Real-time nowcasting of French GDP using the Banque de France's monthly business survey," Economic Modelling, Elsevier, vol. 64(C), pages 26-39.
    14. Michael Pfarrhofer, 2020. "Forecasts with Bayesian vector autoregressions under real time conditions," Papers 2004.04984, arXiv.org.
    15. Sarun Kamolthip, 2021. "Macroeconomic Forecasting with LSTM and Mixed Frequency Time Series Data," PIER Discussion Papers 165, Puey Ungphakorn Institute for Economic Research.
    16. Jon Ellingsen & Vegard H. Larsen & Leif Anders Thorsrud, 2020. "News Media vs. FRED-MD for Macroeconomic Forecasting," CESifo Working Paper Series 8639, CESifo.
    17. Kaufmann, Daniel & Scheufele, Rolf, 2017. "Business tendency surveys and macroeconomic fluctuations," International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
    18. Antonello D’Agostino & Domenico Giannone & Michele Lenza & Michele Modugno, 2016. "Nowcasting Business Cycles: A Bayesian Approach to Dynamic Heterogeneous Factor Models," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 569-594, Emerald Group Publishing Limited.
    19. Schumacher, Christian, 2016. "A comparison of MIDAS and bridge equations," International Journal of Forecasting, Elsevier, vol. 32(2), pages 257-270.
    20. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:9:y:2021:i:1:p:11-:d:511974. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.