IDEAS home Printed from https://ideas.repec.org/p/fip/fednsr/97356.html
   My bibliography  Save this paper

Fed Transparency and Policy Expectation Errors: A Text Analysis Approach

Author

Listed:
  • Eric Fischer
  • Rebecca McCaughrin
  • Saketh Prazad
  • Mark Vandergon

Abstract

This paper seeks to estimate the extent to which market-implied policy expectations could be improved with further information disclosure from the FOMC. Using text analysis methods based on large language models, we show that if FOMC meeting materials with five-year lagged release dates—like meeting transcripts and Tealbooks—were accessible to the public in real time, market policy expectations could substantially improve forecasting accuracy. Most of this improvement occurs during easing cycles. For instance, at the six-month forecasting horizon, the market could have predicted as much as 125 basis points of additional easing during the 2001 and 2008 recessions, equivalent to a 40-50 percent reduction in mean squared error. This potential forecasting improvement appears to be related to incomplete information about the Fed’s reaction function, particularly with respect to financial stability concerns in 2008. In contrast, having enhanced access to meeting materials would not have improved the market’s policy rate forecasting during tightening cycles.

Suggested Citation

  • Eric Fischer & Rebecca McCaughrin & Saketh Prazad & Mark Vandergon, 2023. "Fed Transparency and Policy Expectation Errors: A Text Analysis Approach," Staff Reports 1081, Federal Reserve Bank of New York.
  • Handle: RePEc:fip:fednsr:97356
    DOI: 10.59576/sr.1081
    as

    Download full text from publisher

    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/sr1081.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://www.newyorkfed.org/research/staff_reports/sr1081.html
    File Function: Summary
    Download Restriction: no

    File URL: https://libkey.io/10.59576/sr.1081?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bauer, Michael D. & Pflueger, Carolin E. & Sunderam, Adi, 2022. "Perceptions about monetary policy," IMFS Working Paper Series 176, Goethe University Frankfurt, Institute for Monetary and Financial Stability (IMFS).
    2. Picault, Matthieu & Renault, Thomas, 2017. "Words are not all created equal: A new measure of ECB communication," Journal of International Money and Finance, Elsevier, vol. 79(C), pages 136-156.
    3. Gardner, Ben & Scotti, Chiara & Vega, Clara, 2022. "Words speak as loudly as actions: Central bank communication and the response of equity prices to macroeconomic announcements," Journal of Econometrics, Elsevier, vol. 231(2), pages 387-409.
    4. Eijffinger, Sylvester C.W. & Geraats, Petra M., 2006. "How transparent are central banks?," European Journal of Political Economy, Elsevier, vol. 22(1), pages 1-21, March.
    5. Piazzesi, Monika & Swanson, Eric T., 2008. "Futures prices as risk-adjusted forecasts of monetary policy," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 677-691, May.
    6. Schmeling, Maik & Schrimpf, Andreas & Steffensen, Sigurd A.M., 2022. "Monetary policy expectation errors," Journal of Financial Economics, Elsevier, vol. 146(3), pages 841-858.
    7. Stephen Hansen & Michael McMahon, 2016. "Shocking Language: Understanding the Macroeconomic Effects of Central Bank Communication," NBER Chapters, in: NBER International Seminar on Macroeconomics 2015, National Bureau of Economic Research, Inc.
    8. Shijie Wu & Ozan Irsoy & Steven Lu & Vadim Dabravolski & Mark Dredze & Sebastian Gehrmann & Prabhanjan Kambadur & David Rosenberg & Gideon Mann, 2023. "BloombergGPT: A Large Language Model for Finance," Papers 2303.17564, arXiv.org, revised Dec 2023.
    9. Swanson, Eric T., 2006. "Have Increases in Federal Reserve Transparency Improved Private Sector Interest Rate Forecasts?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(3), pages 791-819, April.
    10. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hubert, Paul & Labondance, Fabien, 2021. "The signaling effects of central bank tone," European Economic Review, Elsevier, vol. 133(C).
    2. Niţoi, Mihai & Pochea, Maria-Miruna & Radu, Ştefan-Constantin, 2023. "Unveiling the sentiment behind central bank narratives: A novel deep learning index," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    3. Jonne Lehtimäki & Marianne Palmu, 2022. "Who Should You Listen to in a Crisis? Differences in Communication of Central Bank Policymakers," Journal of Central Banking Theory and Practice, Central bank of Montenegro, vol. 11(3), pages 33-57.
    4. repec:hal:spmain:info:hdl:2441/3mgbd73vkp9f9oje7utooe7vpg is not listed on IDEAS
    5. Martin Baumgaertner & Johannes Zahner, 2021. "Whatever it takes to understand a central banker - Embedding their words using neural networks," MAGKS Papers on Economics 202130, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    6. repec:hal:spmain:info:hdl:2441/5221 is not listed on IDEAS
    7. Mikael Apel & Marianna Blix Grimaldi & Isaiah Hull, 2022. "How Much Information Do Monetary Policy Committees Disclose? Evidence from the FOMC's Minutes and Transcripts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(5), pages 1459-1490, August.
    8. Youngjoon Lee & Soohyon Kim & Ki Young Park, 2018. "Deciphering Monetary Policy Committee Minutes with Text Mining Approach: A Case of South Korea," Working papers 2018rwp-132, Yonsei University, Yonsei Economics Research Institute.
    9. Paul Hubert & Fabien Labondance, 2019. "Central bank tone and the dispersion of views within monetary policy committees," Sciences Po publications 2019 – 08, Sciences Po.
    10. Bruno Ducoudre, 2008. "Structure par terme des taux d’intérêt et anticipations de la politique économique," Sciences Po publications info:hdl:2441/5221, Sciences Po.
    11. Gardner, Ben & Scotti, Chiara & Vega, Clara, 2022. "Words speak as loudly as actions: Central bank communication and the response of equity prices to macroeconomic announcements," Journal of Econometrics, Elsevier, vol. 231(2), pages 387-409.
    12. Baranowski, Pawel & Bennani, Hamza & Doryń, Wirginia, 2021. "Do the ECB's introductory statements help predict monetary policy? Evidence from a tone analysis," European Journal of Political Economy, Elsevier, vol. 66(C).
    13. Gómez-Cram, Roberto & Grotteria, Marco, 2022. "Real-time price discovery via verbal communication: Method and application to Fedspeak," Journal of Financial Economics, Elsevier, vol. 143(3), pages 993-1025.
    14. Parle, Conor, 2022. "The financial market impact of ECB monetary policy press conferences — A text based approach," European Journal of Political Economy, Elsevier, vol. 74(C).
    15. repec:hal:spmain:info:hdl:2441/7v8fvu0bf08jcoi4epn8cutjm8 is not listed on IDEAS
    16. Menno Middeldorp, 2011. "Central bank transparency, the accuracy of professional forecasts, and interest rate volatility," Staff Reports 496, Federal Reserve Bank of New York.
    17. Young Joon Lee & Soohyon Kim & Ki Young Park, 2019. "Deciphering Monetary Policy Board Minutes with Text Mining: The Case of South Korea," Korean Economic Review, Korean Economic Association, vol. 35, pages 471-511.
    18. Martin T. Bohl & Dimitrios Kanelis & Pierre L. Siklos, 2022. "How Central Bank Mandates Influence Content and Tone of Communication Over Time," CQE Working Papers 9622, Center for Quantitative Economics (CQE), University of Muenster.
    19. Baumgärtner, Martin & Zahner, Johannes, 2023. "Whatever it takes to understand a central banker: Embedding their words using neural networks," IMFS Working Paper Series 194, Goethe University Frankfurt, Institute for Monetary and Financial Stability (IMFS).
    20. Angelo M. Fasolo & Flávia M. Graminho & Saulo B. Bastos, 2021. "Seeing the Forest for the Trees: using hLDA models to evaluate communication in Banco Central do Brasil," Working Papers Series 555, Central Bank of Brazil, Research Department.
    21. Ilias Filippou & James Mitchell & My T. Nguyen, 2023. "The FOMC versus the Staff: Do Policymakers Add Value in Their Tales?," Working Papers 23-20, Federal Reserve Bank of Cleveland.
    22. Donato Masciandaro & Oana Peia & Davide Romelli, 2022. "Central Bank Communication and Social Media: From Silence to Twitter," BAFFI CAREFIN Working Papers 22187, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
    23. Justyna Klejdysz & Robin L. Lumsdaine, 2023. "Shifts in ECB Communication: A Textual Analysis of the Press Conference," International Journal of Central Banking, International Journal of Central Banking, vol. 19(2), pages 473-542, June.

    More about this item

    Keywords

    interest rates; monetary policy; central banks and their policies; sentiment analysis;
    All these keywords.

    JEL classification:

    • E43 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Interest Rates: Determination, Term Structure, and Effects
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fednsr:97356. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gabriella Bucciarelli (email available below). General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.