IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v32y2016i2p559-570.html
   My bibliography  Save this article

Evaluating qualitative forecasts: The FOMC minutes, 2006–2010

Author

Listed:
  • Stekler, Herman
  • Symington, Hilary

Abstract

We present a methodology for evaluating and interpreting qualitative forecasts. The minutes of the FOMC meetings are used as a case study. This permits us to observe the forecasting process and determine the information that was used in generating the qualitative forecasts. Our results show that the FOMC examined an extensive amount of GDP and sectoral data and the indicators that usually foreshadow economic developments. Nevertheless, the FOMC did not predict the Great Recession in advance or recognize it quickly.

Suggested Citation

  • Stekler, Herman & Symington, Hilary, 2016. "Evaluating qualitative forecasts: The FOMC minutes, 2006–2010," International Journal of Forecasting, Elsevier, vol. 32(2), pages 559-570.
    • Handle: RePEc:eee:intfor:v:32:y:2016:i:2:p:559-570
    DOI: 10.1016/j.ijforecast.2015.02.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207015000588
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2015.02.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Herman O Stekler & Raj M Talwar, 2013. "Forecasting the Downturn of the Great Recession," Business Economics, Palgrave Macmillan;National Association for Business Economics, vol. 48(2), pages 113-120, April.
    2. Balke, Nathan S & Petersen, D'Ann, 2002. "How Well Does the Beige Book Reflect Economic Activity? Evaluating Qualitative Information Quantitatively," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 34(1), pages 114-136, February.
    3. Tara M. Sinclair & H. O. Stekler & Warren Carnow, 2012. "A new approach for evaluating economic forecasts," Economics Bulletin, AccessEcon, vol. 32(3), pages 2332-2342.
    4. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    5. Stephen Hansen & Michael McMahon & Andrea Prat, 2018. "Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 801-870.
    6. Michelle T. Armesto & Rub…N Hern¡Ndez-Murillo & Michael T. Owyang & Jeremy Piger, 2009. "Measuring the Information Content of the Beige Book: A Mixed Data Sampling Approach," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(1), pages 35-55, February.
    7. Gavin, William T. & Mandal, Rachel J., 2003. "Evaluating FOMC forecasts," International Journal of Forecasting, Elsevier, vol. 19(4), pages 655-667.
    8. Kathryn Lundquist & Herman O Stekler, 2012. "Interpreting the Performance of Business Economists During the Great Recession," Business Economics, Palgrave Macmillan;National Association for Business Economics, vol. 47(2), pages 148-154, April.
    9. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    10. Deborah J. Danker & Matthew M. Luecke, 2005. "Background on FOMC meeting minutes," Federal Reserve Bulletin, Board of Governors of the Federal Reserve System (U.S.), vol. 91(Spr), pages 175-179.
    11. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    12. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    13. Martha A. Starr, 2014. "Qualitative And Mixed-Methods Research In Economics: Surprising Growth, Promising Future," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 238-264, April.
    14. Gamber, Edward N. & Smith, Julie K., 2009. "Are the Fed's inflation forecasts still superior to the private sector's?," Journal of Macroeconomics, Elsevier, vol. 31(2), pages 240-251, June.
    15. Sheng, Xuguang (Simon), 2015. "Evaluating the economic forecasts of FOMC members," International Journal of Forecasting, Elsevier, vol. 31(1), pages 165-175.
    16. Hamilton, James D., 2011. "Calling recessions in real time," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1006-1026, October.
    17. Ricardo Nunes, 2013. "Do central banks’ forecasts take into account public opinion and views?," International Finance Discussion Papers 1080, Board of Governors of the Federal Reserve System (U.S.).
    18. Robert Goldfarb & H. O. Stekler & Joel David, 2005. "Methodological issues in forecasting: Insights from the egregious business forecast errors of late 1930," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(4), pages 517-542.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Herman O. Stekler & Hilary Symington, 2014. "How Did The Fomc View The Great Recession As It Was Happening?: Evaluating The Minutes From Fomc Meetings, 2006-2010," Working Papers 2014-005, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    2. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    3. Bespalova, Olga, 2020. "GDP forecasts: Informational asymmetry of the SPF and FOMC minutes," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1531-1540.
    4. El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2016. "Revisiting the relative forecast performances of Fed staff and private forecasters: A dynamic approach," International Journal of Forecasting, Elsevier, vol. 32(2), pages 313-323.
    5. Gamber, Edward N. & Liebner, Jeffrey P. & Smith, Julie K., 2015. "The distribution of inflation forecast errors," Journal of Policy Modeling, Elsevier, vol. 37(1), pages 47-64.
    6. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    7. Paul Hubert, 2015. "Revisiting the Greenbook’s relative forecasting performance," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(1), pages 151-179.
    8. Daniel Culbertson & Tara Sinclair, 2014. "The Failure of Forecasts in the Great Recession," Challenge, Taylor & Francis Journals, vol. 57(6), pages 34-45.
    9. Henning Fischer & Marta García-Bárzana & Peter Tillmann & Peter Winker, 2014. "Evaluating FOMC forecast ranges: an interval data approach," Empirical Economics, Springer, vol. 47(1), pages 365-388, August.
    10. repec:spo:wpmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    11. repec:hal:spmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    12. El-Shagi, Makram & Giesen, Sebastian & Jung, Alexander, 2012. "Does Central Bank Staff Beat Private Forecasters?," IWH Discussion Papers 5/2012, Halle Institute for Economic Research (IWH).
    13. Jones, Adam T. & Ogden, Richard E., 2017. "A day late and a dollar short: The effect of policy uncertainty on fed forecast errors," Economic Analysis and Policy, Elsevier, vol. 54(C), pages 112-122.
    14. Paul Hubert, 2009. "An Empirical Review of Federal Reserve’s Informational Advantage," Documents de Travail de l'OFCE 2009-03, Observatoire Francais des Conjonctures Economiques (OFCE).
    15. repec:hal:spmain:info:hdl:2441/35kgubh40v9gfpnuruelqjnptb is not listed on IDEAS
    16. Mathy, Gabriel & Stekler, Herman, 2017. "Expectations and forecasting during the Great Depression: Real-time evidence from the business press," Journal of Macroeconomics, Elsevier, vol. 53(C), pages 1-15.
    17. Liu, Dandan & Smith, Julie K., 2014. "Inflation forecasts and core inflation measures: Where is the information on future inflation?," The Quarterly Review of Economics and Finance, Elsevier, vol. 54(1), pages 133-137.
    18. Gamber, Edward N. & Smith, Julie K., 2009. "Are the Fed's inflation forecasts still superior to the private sector's?," Journal of Macroeconomics, Elsevier, vol. 31(2), pages 240-251, June.
    19. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    20. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    21. Jung, Alexander & El-Shagi, Makram & Giesen, Sebastian, 2014. "Does the federal reserve staff still beat private forecasters?," Working Paper Series 1635, European Central Bank.
    22. Weber, Christoph S., 2019. "The effect of central bank transparency on exchange rate volatility," Journal of International Money and Finance, Elsevier, vol. 95(C), pages 165-181.
    23. Ilias Filippou & James Mitchell & My T. Nguyen, 2023. "The FOMC versus the Staff: Do Policymakers Add Value in Their Tales?," Working Papers 23-20, Federal Reserve Bank of Cleveland.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:32:y:2016:i:2:p:559-570. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.