IDEAS home Printed from https://ideas.repec.org/p/fip/fednsr/97356.html
   My bibliography  Save this paper

Fed Transparency and Policy Expectation Errors: A Text Analysis Approach

Author

Listed:

Abstract

This paper seeks to estimate the extent to which market-implied policy expectations could be improved with further information disclosure from the FOMC. Using text analysis methods based on large language models, we show that if FOMC meeting materials with five-year lagged release dates—like meeting transcripts and Tealbooks—were accessible to the public in real time, market policy expectations could substantially improve forecasting accuracy. Most of this improvement occurs during easing cycles. For instance, at the six-month forecasting horizon, the market could have predicted as much as 125 basis points of additional easing during the 2001 and 2008 recessions, equivalent to a 40-50 percent reduction in mean squared error. This potential forecasting improvement appears to be related to incomplete information about the Fed’s reaction function, particularly with respect to financial stability concerns in 2008. In contrast, having enhanced access to meeting materials would not have improved the market’s policy rate forecasting during tightening cycles.

Suggested Citation

  • Eric Fischer & Rebecca McCaughrin & Saketh Prazad & Mark Vandergon, 2023. "Fed Transparency and Policy Expectation Errors: A Text Analysis Approach," Staff Reports 1081, Federal Reserve Bank of New York.
  • Handle: RePEc:fip:fednsr:97356
    DOI: 10.59576/sr.1081
    as

    Download full text from publisher

    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/sr1081.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://www.newyorkfed.org/research/staff_reports/sr1081.html
    File Function: Summary
    Download Restriction: no

    File URL: https://libkey.io/10.59576/sr.1081?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael D Bauer & Carolin E Pflueger & Adi Sunderam, 2024. "Perceptions About Monetary Policy," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(4), pages 2227-2278.
    2. Picault, Matthieu & Renault, Thomas, 2017. "Words are not all created equal: A new measure of ECB communication," Journal of International Money and Finance, Elsevier, vol. 79(C), pages 136-156.
    3. Gardner, Ben & Scotti, Chiara & Vega, Clara, 2022. "Words speak as loudly as actions: Central bank communication and the response of equity prices to macroeconomic announcements," Journal of Econometrics, Elsevier, vol. 231(2), pages 387-409.
    4. Eijffinger, Sylvester C.W. & Geraats, Petra M., 2006. "How transparent are central banks?," European Journal of Political Economy, Elsevier, vol. 22(1), pages 1-21, March.
    5. Piazzesi, Monika & Swanson, Eric T., 2008. "Futures prices as risk-adjusted forecasts of monetary policy," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 677-691, May.
    6. Schmeling, Maik & Schrimpf, Andreas & Steffensen, Sigurd A.M., 2022. "Monetary policy expectation errors," Journal of Financial Economics, Elsevier, vol. 146(3), pages 841-858.
    7. Stephen Hansen & Michael McMahon, 2016. "Shocking Language: Understanding the Macroeconomic Effects of Central Bank Communication," NBER Chapters, in: NBER International Seminar on Macroeconomics 2015, National Bureau of Economic Research, Inc.
    8. Shijie Wu & Ozan Irsoy & Steven Lu & Vadim Dabravolski & Mark Dredze & Sebastian Gehrmann & Prabhanjan Kambadur & David Rosenberg & Gideon Mann, 2023. "BloombergGPT: A Large Language Model for Finance," Papers 2303.17564, arXiv.org, revised Dec 2023.
    9. Swanson, Eric T., 2006. "Have Increases in Federal Reserve Transparency Improved Private Sector Interest Rate Forecasts?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(3), pages 791-819, April.
    10. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ko, Eunmi, 2024. "An affine term structure model with Fed chairs’ speeches," Finance Research Letters, Elsevier, vol. 63(C).
    2. Jean-Charles Bricongne & Baptiste Meunier & Raquel Caldeira, 2024. "Should Central Banks Care About Text Mining? A Literature Review," Working papers 950, Banque de France.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hubert, Paul & Labondance, Fabien, 2021. "The signaling effects of central bank tone," European Economic Review, Elsevier, vol. 133(C).
    2. Niţoi, Mihai & Pochea, Maria-Miruna & Radu, Ştefan-Constantin, 2023. "Unveiling the sentiment behind central bank narratives: A novel deep learning index," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    3. Jonne Lehtimäki & Marianne Palmu, 2022. "Who Should You Listen to in a Crisis? Differences in Communication of Central Bank Policymakers," Journal of Central Banking Theory and Practice, Central bank of Montenegro, vol. 11(3), pages 33-57.
    4. repec:hal:spmain:info:hdl:2441/3mgbd73vkp9f9oje7utooe7vpg is not listed on IDEAS
    5. Martin Baumgaertner & Johannes Zahner, 2021. "Whatever it takes to understand a central banker - Embedding their words using neural networks," MAGKS Papers on Economics 202130, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    6. repec:hal:spmain:info:hdl:2441/5221 is not listed on IDEAS
    7. Qiu, Yue & Xie, Tian & Xie, Wenjing & Zheng, Xiangzhong, 2023. "Federal policy announcements and capital reallocation: Insights from inflow and outflow trends in the U.S," Journal of International Money and Finance, Elsevier, vol. 139(C).
    8. Mikael Apel & Marianna Blix Grimaldi & Isaiah Hull, 2022. "How Much Information Do Monetary Policy Committees Disclose? Evidence from the FOMC's Minutes and Transcripts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(5), pages 1459-1490, August.
    9. Youngjoon Lee & Soohyon Kim & Ki Young Park, 2018. "Deciphering Monetary Policy Committee Minutes with Text Mining Approach: A Case of South Korea," Working papers 2018rwp-132, Yonsei University, Yonsei Economics Research Institute.
    10. Paul Hubert & Fabien Labondance, 2019. "Central bank tone and the dispersion of views within monetary policy committees," Working Papers hal-03403256, HAL.
    11. repec:spo:wpmain:info:hdl:2441/5221 is not listed on IDEAS
    12. Gardner, Ben & Scotti, Chiara & Vega, Clara, 2022. "Words speak as loudly as actions: Central bank communication and the response of equity prices to macroeconomic announcements," Journal of Econometrics, Elsevier, vol. 231(2), pages 387-409.
    13. Baranowski, Pawel & Bennani, Hamza & Doryń, Wirginia, 2021. "Do the ECB's introductory statements help predict monetary policy? Evidence from a tone analysis," European Journal of Political Economy, Elsevier, vol. 66(C).
    14. Gómez-Cram, Roberto & Grotteria, Marco, 2022. "Real-time price discovery via verbal communication: Method and application to Fedspeak," Journal of Financial Economics, Elsevier, vol. 143(3), pages 993-1025.
    15. Parle, Conor, 2022. "The financial market impact of ECB monetary policy press conferences — A text based approach," European Journal of Political Economy, Elsevier, vol. 74(C).
    16. repec:hal:spmain:info:hdl:2441/7v8fvu0bf08jcoi4epn8cutjm8 is not listed on IDEAS
    17. Menno Middeldorp, 2011. "Central bank transparency, the accuracy of professional forecasts, and interest rate volatility," Staff Reports 496, Federal Reserve Bank of New York.
    18. Young Joon Lee & Soohyon Kim & Ki Young Park, 2019. "Deciphering Monetary Policy Board Minutes with Text Mining: The Case of South Korea," Korean Economic Review, Korean Economic Association, vol. 35, pages 471-511.
    19. Martin T. Bohl & Dimitrios Kanelis & Pierre L. Siklos, 2022. "How Central Bank Mandates Influence Content and Tone of Communication Over Time," CQE Working Papers 9622, Center for Quantitative Economics (CQE), University of Muenster.
    20. Baumgärtner, Martin & Zahner, Johannes, 2023. "Whatever it takes to understand a central banker: Embedding their words using neural networks," IMFS Working Paper Series 194, Goethe University Frankfurt, Institute for Monetary and Financial Stability (IMFS).
    21. Angelo M. Fasolo & Flávia M. Graminho & Saulo B. Bastos, 2021. "Seeing the Forest for the Trees: using hLDA models to evaluate communication in Banco Central do Brasil," Working Papers Series 555, Central Bank of Brazil, Research Department.
    22. Anastasiou, Dimitris & Krokida, Styliani-Iris & Tsouknidis, Dimitris & Drakos, Konstantinos, 2023. "Can the tone of central bankers’ speeches discourage potential bank borrowers in the Eurozone?," Journal of International Money and Finance, Elsevier, vol. 139(C).
    23. Vyshnevskyi, Iegor & Jombo, Wytone & Sohn, Wook, 2024. "The clarity of monetary policy communication and financial market volatility in developing economies," Emerging Markets Review, Elsevier, vol. 59(C).
    24. Ilias Filippou & James Mitchell & My T. Nguyen, 2023. "The FOMC versus the Staff: Do Policymakers Add Value in Their Tales?," Working Papers 23-20, Federal Reserve Bank of Cleveland.

    More about this item

    Keywords

    interest rates; monetary policy; central banks and their policies; sentiment analysis;
    All these keywords.

    JEL classification:

    • E43 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Interest Rates: Determination, Term Structure, and Effects
    • E52 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Monetary Policy
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fednsr:97356. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gabriella Bucciarelli (email available below). General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.