IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/12589.html
   My bibliography  Save this paper

Macroeconomic Nowcasting and Forecasting with Big Data

Author

Listed:
  • Bok, Brandyn
  • Caratelli, Daniele
  • Giannone, Domenico
  • Sbordone, Argia
  • Tambalotti, Andrea

Abstract

Data, data, data ... Economists know their importance well, especially when it comes to monitoring macroeconomic conditions -- the basis for making informed economic and policy decisions. Handling large and complex data sets was a challenge that macroeconomists engaged in real-time analysis faced long before "big data" became pervasive in other disciplines. We review how methods for tracking economic conditions using big data have evolved over time and explain how econometric techniques have advanced to mimic and automate best practices of forecasters on trading desks, at central banks, and in other market-monitoring roles. We present in detail the methodology underlying the New York Fed Staff Nowcast, which employs these innovative techniques to produce early estimates of GDP growth, synthesizing a wide range of macroeconomic data as they become available.

Suggested Citation

  • Bok, Brandyn & Caratelli, Daniele & Giannone, Domenico & Sbordone, Argia & Tambalotti, Andrea, 2018. "Macroeconomic Nowcasting and Forecasting with Big Data," CEPR Discussion Papers 12589, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:12589
    as

    Download full text from publisher

    File URL: http://www.cepr.org/active/publications/discussion_papers/dp.php?dpno=12589
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Roberto S. Mariano & Yasutomo Murasawa, 2003. "A new coincident index of business cycles based on monthly and quarterly series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 427-443.
    2. Altavilla, Carlo & Giannone, Domenico & Modugno, Michele, 2017. "Low frequency effects of macroeconomic news on government bond yields," Journal of Monetary Economics, Elsevier, vol. 92(C), pages 31-46.
    3. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    4. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    5. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.
    6. G. Rünstler & K. Barhoumi & S. Benk & R. Cristadoro & A. Den Reijer & A. Jakaitiene & P. Jelonek & A. Rua & K. Ruth & C. Van Nieuwenhuyze, 2009. "Short-term forecasting of GDP using large datasets: a pseudo real-time forecast evaluation exercise," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(7), pages 595-611.
    7. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    8. Knotek, Edward S. & Zaman, Saeed, 2019. "Financial nowcasts and their usefulness in macroeconomic forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1708-1724.
    9. Lahiri, Kajal & Monokroussos, George, 2013. "Nowcasting US GDP: The role of ISM business surveys," International Journal of Forecasting, Elsevier, vol. 29(4), pages 644-658.
    10. Frank Schorfheide & Dongho Song, 2015. "Real-Time Forecasting With a Mixed-Frequency VAR," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 366-380, July.
    11. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    12. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Bayesian VARs: Specification Choices and Forecast Accuracy," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 46-73, January.
    13. repec:hal:journl:peer-00844811 is not listed on IDEAS
    14. Matheson, Troy D., 2010. "An analysis of the informational content of New Zealand data releases: The importance of business opinion surveys," Economic Modelling, Elsevier, vol. 27(1), pages 304-314, January.
    15. Antonello D’Agostino & Domenico Giannone & Michele Lenza & Michele Modugno, 2016. "Nowcasting Business Cycles: A Bayesian Approach to Dynamic Heterogeneous Factor Models," Advances in Econometrics, in: Eric Hillebrand & Siem Jan Koopman (ed.), Dynamic Factor Models, volume 35, pages 569-594, Emerald Publishing Ltd.
    16. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2006. "Forecasting Using a Large Number of Predictors: Is Bayesian Regression a Valid Alternative to Principal Components?," CEPR Discussion Papers 5829, C.E.P.R. Discussion Papers.
    17. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    18. Joelle Liebermann, 2014. "Real-Time Nowcasting of GDP: A Factor Model vs. Professional Forecasters," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(6), pages 783-811, December.
    19. Charles E. Gilbert & Norman J. Morin & Andrew D. Paciorek & Claudia R. Sahm, 2015. "Residual Seasonality in GDP," FEDS Notes 2015-05-14, Board of Governors of the Federal Reserve System (U.S.).
    20. Dahlhaus, Tatjana & Guénette, Justin-Damien & Vasishtha, Garima, 2017. "Nowcasting BRIC+M in real time," International Journal of Forecasting, Elsevier, vol. 33(4), pages 915-935.
    21. Aruoba, S. BoraÄŸan & Diebold, Francis X. & Scotti, Chiara, 2009. "Real-Time Measurement of Business Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 417-427.
    22. Elena Angelini & Gonzalo Camba‐Mendez & Domenico Giannone & Lucrezia Reichlin & Gerhard Rünstler, 2011. "Short‐term forecasts of euro area GDP growth," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 25-44, February.
    23. Gerhard Bry & Charlotte Boschan, 1971. "Foreword to "Cyclical Analysis of Time Series: Selected Procedures and Computer Programs"," NBER Chapters, in: Cyclical Analysis of Time Series: Selected Procedures and Computer Programs, pages -1, National Bureau of Economic Research, Inc.
    24. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    25. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
    26. Refet S. Gürkaynak & Jonathan H. Wright, 2013. "Identification and Inference Using Event Studies," Manchester School, University of Manchester, vol. 81, pages 48-65, September.
    27. Alberto Caruso, 2015. "Nowcasting Mexican GDP," Working Papers ECARES ECARES 2015-40, ULB -- Universite Libre de Bruxelles.
    28. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    29. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    30. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    31. Don Harding & Adrian Pagan, 2016. "The Econometric Analysis of Recurrent Events in Macroeconomics and Finance," Economics Books, Princeton University Press, edition 1, number 10744.
    32. Juan Antolin-Diaz & Thomas Drechsel & Ivan Petrella, 2017. "Tracking the Slowdown in Long-Run GDP Growth," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 343-356, May.
    33. Alain Kabundi & Elmarie Nel & Franz Ruch, 2016. "Nowcasting Real GDP growth in South Africa," Working Papers 7068, South African Reserve Bank.
    34. Scott Brave & R. Andrew Butters & Alejandro Justiniano, 2016. "Forecasting Economic Activity with Mixed Frequency Bayesian VARs," Working Paper Series WP-2016-5, Federal Reserve Bank of Chicago.
    35. Harding, Don & Pagan, Adrian, 2002. "Dissecting the cycle: a methodological investigation," Journal of Monetary Economics, Elsevier, vol. 49(2), pages 365-381, March.
    36. Knut Aastveit & Tørres Trovik, 2012. "Nowcasting norwegian GDP: the role of asset prices in a small open economy," Empirical Economics, Springer, vol. 42(1), pages 95-119, February.
    37. Tony Chernis & Rodrigo Sekkel, 2017. "A dynamic factor model for nowcasting Canadian GDP growth," Empirical Economics, Springer, vol. 53(1), pages 217-234, August.
    38. Leonardo Bartolini & Linda S. Goldberg & Adam Sacarny, 2008. "How economic news moves markets," Current Issues in Economics and Finance, Federal Reserve Bank of New York, vol. 14(Aug).
    39. Patrick C. Higgins, 2014. "GDPNow: A Model for GDP \"Nowcasting\"," FRB Atlanta Working Paper 2014-7, Federal Reserve Bank of Atlanta.
    40. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    41. Tobias Adrian & Nina Boyarchenko & Domenico Giannone, 2019. "Vulnerable Growth," American Economic Review, American Economic Association, vol. 109(4), pages 1263-1289, April.
    42. Kurt Graden Lunsford, 2017. "Lingering Residual Seasonality in GDP Growth," Economic Commentary, Federal Reserve Bank of Cleveland, issue March.
    43. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    44. J. Steven Landefeld & Eugene P. Seskin & Barbara M. Fraumeni, 2008. "Taking the Pulse of the Economy: Measuring GDP," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 193-216, Spring.
    45. Matteo Luciani & Lorenzo Ricci, 2014. "Nowcasting Norway," International Journal of Central Banking, International Journal of Central Banking, vol. 10(4), pages 215-248, December.
    46. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    47. Gerhard Bry & Charlotte Boschan, 1971. "Cyclical Analysis of Time Series: Selected Procedures and Computer Programs," NBER Books, National Bureau of Economic Research, Inc, number bry_71-1.
    48. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    49. Tim Mahedy & Glenn D. Rudebusch & Daniel J. Wilson, 2015. "The puzzle of weak first-quarter GDP growth," FRBSF Economic Letter, Federal Reserve Bank of San Francisco.
    50. Keith R. Phillips & Jack Wang, 2016. "Residual seasonality in U.S. GDP data," Working Papers 1608, Federal Reserve Bank of Dallas.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bańbura, Marta & Giannone, Domenico & Modugno, Michele & Reichlin, Lucrezia, 2013. "Now-Casting and the Real-Time Data Flow," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 195-237, Elsevier.
    2. Danilo Cascaldi-Garcia & Thiago Revil T. Ferreira & Domenico Giannone & Michele Modugno, 2021. "Back to the Present: Learning about the Euro Area through a Now-casting Model," International Finance Discussion Papers 1313, Board of Governors of the Federal Reserve System (U.S.).
    3. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    4. Caruso, Alberto, 2018. "Nowcasting with the help of foreign indicators: The case of Mexico," Economic Modelling, Elsevier, vol. 69(C), pages 160-168.
    5. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2020. "Nowcasting with large Bayesian vector autoregressions," Working Paper Series 2453, European Central Bank.
    6. Dahlhaus, Tatjana & Guénette, Justin-Damien & Vasishtha, Garima, 2017. "Nowcasting BRIC+M in real time," International Journal of Forecasting, Elsevier, vol. 33(4), pages 915-935.
    7. Matteo Luciani & Lorenzo Ricci, 2014. "Nowcasting Norway," International Journal of Central Banking, International Journal of Central Banking, vol. 10(4), pages 215-248, December.
    8. Bragoli, Daniela & Modugno, Michele, 2017. "A now-casting model for Canada: Do U.S. variables matter?," International Journal of Forecasting, Elsevier, vol. 33(4), pages 786-800.
    9. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    10. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    11. Caruso, Alberto, 2019. "Macroeconomic news and market reaction: Surprise indexes meet nowcasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1725-1734.
    12. Bańbura, Marta & Giannone, Domenico & Lenza, Michele, 2015. "Conditional forecasts and scenario analysis with vector autoregressions for large cross-sections," International Journal of Forecasting, Elsevier, vol. 31(3), pages 739-756.
    13. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    14. Matteo Luciani & Madhavi Pundit & Arief Ramayandi & Giovanni Veronese, 2018. "Nowcasting Indonesia," Empirical Economics, Springer, vol. 55(2), pages 597-619, September.
    15. Martha Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Nowcasting," Working Papers ECARES ECARES 2010-021, ULB -- Universite Libre de Bruxelles.
    16. Tóth, Peter, 2014. "Malý dynamický faktorový model na krátkodobé prognózovanie slovenského HDP [A Small Dynamic Factor Model for the Short-Term Forecasting of Slovak GDP]," MPRA Paper 63713, University Library of Munich, Germany.
    17. Kaufmann, Daniel & Scheufele, Rolf, 2017. "Business tendency surveys and macroeconomic fluctuations," International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
    18. Chudik, Alexander & Grossman, Valerie & Pesaran, M. Hashem, 2016. "A multi-country approach to forecasting output growth using PMIs," Journal of Econometrics, Elsevier, vol. 192(2), pages 349-365.
    19. Christian Glocker & Philipp Wegmueller, 2020. "Business cycle dating and forecasting with real-time Swiss GDP data," Empirical Economics, Springer, vol. 58(1), pages 73-105, January.
    20. Pirschel, Inske, 2016. "Forecasting euro area recessions in real-time," Kiel Working Papers 2020, Kiel Institute for the World Economy (IfW Kiel).

    More about this item

    Keywords

    business cycle analysis; high-dimensional data; monitoring economic conditions; real-time data flow;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E3 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:12589. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://www.cepr.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.