IDEAS home Printed from https://ideas.repec.org/p/fip/fedcwq/96636.html
   My bibliography  Save this paper

The FOMC versus the Staff: Do Policymakers Add Value in Their Tales?

Author

Listed:

Abstract

Using close to 40 years of textual data from FOMC transcripts and the Federal Reserve staff's Greenbook/Tealbook, we extend Romer and Romer (2008) to test if the FOMC adds information relative to its staff forecasts not via its own quantitative forecasts but via its words. We use methods from natural language processing to extract from both types of document text-based forecasts that capture attentiveness to and sentiment about the macroeconomy. We test whether these text-based forecasts provide value-added in explaining the distribution of outcomes for GDP growth, the unemployment rate, and inflation. We find that FOMC tales about macroeconomic risks do add value in the tails, especially for GDP growth and the unemployment rate. For inflation, we find value-added in both FOMC point forecasts and narrative, once we extract from the text a broader set of measures of macroeconomic sentiment and risk attentiveness.

Suggested Citation

  • Ilias Filippou & James Mitchell & My T. Nguyen, 2023. "The FOMC versus the Staff: Do Policymakers Add Value in Their Tales?," Working Papers 23-20, Federal Reserve Bank of Cleveland.
  • Handle: RePEc:fip:fedcwq:96636
    DOI: 10.26509/frbc-wp-202320
    as

    Download full text from publisher

    File URL: https://doi.org/10.26509/frbc-wp-202320
    File Function: Persistent Link
    Download Restriction: no

    File URL: https://www.clevelandfed.org/-/media/project/clevelandfedtenant/clevelandfedsite/publications/working-papers/2023/wp2320.pdf
    File Function: Full Text
    Download Restriction: no

    File URL: https://libkey.io/10.26509/frbc-wp-202320?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Segal, Gill & Shaliastovich, Ivan & Yaron, Amir, 2015. "Good and bad uncertainty: Macroeconomic and financial market implications," Journal of Financial Economics, Elsevier, vol. 117(2), pages 369-397.
    2. Stephen Hansen & Michael McMahon & Andrea Prat, 2018. "Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 801-870.
    3. Martin Ellison & Thomas J. Sargent, 2012. "A Defense Of The Fomc," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(4), pages 1047-1065, November.
    4. Gardner, Ben & Scotti, Chiara & Vega, Clara, 2022. "Words speak as loudly as actions: Central bank communication and the response of equity prices to macroeconomic announcements," Journal of Econometrics, Elsevier, vol. 231(2), pages 387-409.
    5. Stephen Hansen & Michael McMahon, 2016. "Shocking Language: Understanding the Macroeconomic Effects of Central Bank Communication," NBER Chapters, in: NBER International Seminar on Macroeconomics 2015, National Bureau of Economic Research, Inc.
    6. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    7. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    8. Hansen, Stephen & McMahon, Michael & Tong, Matthew, 2019. "The long-run information effect of central bank communication," Journal of Monetary Economics, Elsevier, vol. 108(C), pages 185-202.
    9. Tarek A Hassan & Stephan Hollander & Laurence van Lent & Ahmed Tahoun, 2019. "Firm-Level Political Risk: Measurement and Effects," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 2135-2202.
    10. Gerard Hoberg & Gordon Phillips, 2016. "Text-Based Network Industries and Endogenous Product Differentiation," Journal of Political Economy, University of Chicago Press, vol. 124(5), pages 1423-1465.
    11. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    12. Christina D. Romer & David H. Romer, 2004. "A New Measure of Monetary Shocks: Derivation and Implications," American Economic Review, American Economic Association, vol. 94(4), pages 1055-1084, September.
    13. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    14. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809, January.
    15. Stekler, Herman & Symington, Hilary, 2016. "Evaluating qualitative forecasts: The FOMC minutes, 2006–2010," International Journal of Forecasting, Elsevier, vol. 32(2), pages 559-570.
    16. Nathan S. Balke & Michael Fulmer & Ren Zhang, 2017. "Incorporating the Beige Book into a Quantitative Index of Economic Activity," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(5), pages 497-514, August.
    17. Clements, Michael P. & Reade, J. James, 2020. "Forecasting and forecast narratives: The Bank of England Inflation Reports," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1488-1500.
    18. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    19. Binder, Carola Conces & Wetzel, Samantha, 2018. "The FOMC versus the staff, revisited: When do policymakers add value?," Economics Letters, Elsevier, vol. 171(C), pages 72-75.
    20. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, March.
    21. Adam Hale Shapiro & Daniel J Wilson, 2022. "Taking the Fed at its Word: A New Approach to Estimating Central Bank Objectives using Text Analysis [Inflation Targeting Does Not Anchor Inflation Expectations: Evidence from Firms in New Zealand]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(5), pages 2768-2805.
    22. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    23. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    24. Sharpe, Steven A. & Sinha, Nitish R. & Hollrah, Christopher A., 2023. "The power of narrative sentiment in economic forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1097-1121.
    25. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bespalova, Olga, 2020. "GDP forecasts: Informational asymmetry of the SPF and FOMC minutes," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1531-1540.
    2. Istrefi, Klodiana & Odendahl, Florens & Sestieri, Giulia, 2023. "Fed communication on financial stability concerns and monetary policy decisions: Revelations from speeches," Journal of Banking & Finance, Elsevier, vol. 151(C).
    3. Hubert, Paul & Labondance, Fabien, 2021. "The signaling effects of central bank tone," European Economic Review, Elsevier, vol. 133(C).
    4. Sharpe, Steven A. & Sinha, Nitish R. & Hollrah, Christopher A., 2023. "The power of narrative sentiment in economic forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1097-1121.
    5. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    6. Leif Anders Thorsrud, 2016. "Nowcasting using news topics Big Data versus big bank," Working Papers No 6/2016, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    7. Martin Baumgaertner & Johannes Zahner, 2021. "Whatever it takes to understand a central banker - Embedding their words using neural networks," MAGKS Papers on Economics 202130, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    8. Hansen, Stephen & McMahon, Michael & Tong, Matthew, 2019. "The long-run information effect of central bank communication," Journal of Monetary Economics, Elsevier, vol. 108(C), pages 185-202.
    9. Antón Sarabia Arturo & Bazdresch Santiago & Lelo-de-Larrea Alejandra, 2023. "The Influence of Central Bank's Projections and Economic Narrative on Professional Forecasters' Expectations: Evidence from Mexico," Working Papers 2023-21, Banco de México.
    10. García, Diego & Hu, Xiaowen & Rohrer, Maximilian, 2023. "The colour of finance words," Journal of Financial Economics, Elsevier, vol. 147(3), pages 525-549.
    11. Shapiro, Adam Hale & Sudhof, Moritz & Wilson, Daniel J., 2022. "Measuring news sentiment," Journal of Econometrics, Elsevier, vol. 228(2), pages 221-243.
    12. Vegard H�ghaug Larsen & Leif Anders Thorsrud, 2018. "Business cycle narratives," Working Papers No 6/2018, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
    13. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    14. Kwok Ping Tsang & Zichao Yang, 2023. "Agree to Disagree: Measuring Hidden Dissents in FOMC Meetings," Papers 2308.10131, arXiv.org, revised Mar 2024.
    15. Niţoi, Mihai & Pochea, Maria-Miruna & Radu, Ştefan-Constantin, 2023. "Unveiling the sentiment behind central bank narratives: A novel deep learning index," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    16. Henning Fischer & Marta García-Bárzana & Peter Tillmann & Peter Winker, 2014. "Evaluating FOMC forecast ranges: an interval data approach," Empirical Economics, Springer, vol. 47(1), pages 365-388, August.
    17. Lin, Jianhao & Mei, Ziwei & Chen, Liangyuan & Zhu, Chuanqi, 2023. "Is the People's Bank of China consistent in words and deeds?," China Economic Review, Elsevier, vol. 78(C).
    18. Aromi, J. Daniel, 2020. "Linking words in economic discourse: Implications for macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1517-1530.
    19. Davide Romelli & Hamza Bennani, 2021. "Disagreement inside the FOMC: New Insights from Tone Analysis," Trinity Economics Papers tep1021, Trinity College Dublin, Department of Economics.
    20. Kawamura, Kohei & Kobashi, Yohei & Shizume, Masato & Ueda, Kozo, 2019. "Strategic central bank communication: Discourse analysis of the Bank of Japan’s Monthly Report," Journal of Economic Dynamics and Control, Elsevier, vol. 100(C), pages 230-250.

    More about this item

    Keywords

    monetary policy; sentiment; uncertainty; risk; forecast evaluation; FOMC meetings; textual analysis; machine learning; quantile regression;
    All these keywords.

    JEL classification:

    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
    • E31 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Price Level; Inflation; Deflation
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedcwq:96636. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: 4D Library (email available below). General contact details of provider: https://edirc.repec.org/data/frbclus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.