IDEAS home Printed from https://ideas.repec.org/a/eee/jebusi/v83y2016icp23-43.html
   My bibliography  Save this article

The accuracy of forecasts prepared for the Federal Open Market Committee

Author

Listed:
  • Chang, Andrew C.
  • Hanson, Tyler J.

Abstract

We analyze forecasts of consumption, nonresidential investment, residential investment, government spending, exports, imports, inventories, gross domestic product, inflation, and unemployment prepared by the staff of the Board of Governors of the Federal Reserve System for meetings of the Federal Open Market Committee from 1997 to 2008, called the Greenbooks. We compare the root mean squared error, mean absolute error, and the proportion of directional errors of Greenbook forecasts of these macroeconomic indicators with the errors from three forecasting benchmarks: a random walk, a first-order autoregressive model, and a Bayesian model averaged forecast from a suite of univariate time-series models commonly taught to first-year economics graduate students. We estimate our forecasting benchmarks both on end-of-sample vintage and real-time vintage data. We find that Greenbook forecasts significantly outperform our benchmark forecasts for horizons less than one quarter ahead. However, by the one-year forecast horizon, typically at least one of our forecasting benchmarks performs as well as Greenbook forecasts. Greenbook forecasts of personal consumption expenditures and unemployment tend to do relatively well, while Greenbook forecasts of inventory investment, government expenditures, and inflation tend to do poorly.

Suggested Citation

  • Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
  • Handle: RePEc:eee:jebusi:v:83:y:2016:i:c:p:23-43
    DOI: 10.1016/j.jeconbus.2015.12.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148619515000661
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconbus.2015.12.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Evan F. Koenig & Sheila Dolmas & Jeremy Piger, 2003. "The Use and Abuse of Real-Time Data in Economic Forecasting," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 618-628, August.
    2. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    3. Jonathan H. Wright, 2009. "Forecasting US inflation by Bayesian model averaging," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(2), pages 131-144.
    4. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    5. James Morley & Jeremy Piger, 2012. "The Asymmetric Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 208-221, February.
    6. Sinclair, Tara M. & Stekler, H.O. & Carnow, Warren, 2015. "Evaluating a vector of the Fed’s forecasts," International Journal of Forecasting, Elsevier, vol. 31(1), pages 157-164.
    7. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    8. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    9. Michael P. Clements & Ana Beatriz Galvão, 2013. "Real‐Time Forecasting Of Inflation And Output Growth With Autoregressive Models In The Presence Of Data Revisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(3), pages 458-477, April.
    10. Joutz, Fred & Stekler, H. O., 2000. "An evaluation of the predictions of the Federal Reserve," International Journal of Forecasting, Elsevier, vol. 16(1), pages 17-38.
    11. Baghestani, Hamid, 2011. "Federal Reserve and private forecasts of growth in investment," Journal of Economics and Business, Elsevier, vol. 63(4), pages 290-305, July.
    12. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    13. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    14. Campbell, Sean D. & Sharpe, Steven A., 2009. "Anchoring Bias in Consensus Forecasts and Its Effect on Market Prices," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 44(2), pages 369-390, April.
    15. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, March.
    16. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    17. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    18. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    19. Hamid Baghestani, 2013. "Evaluating Federal Reserve predictions of growth in consumer spending," Applied Economics, Taylor & Francis Journals, vol. 45(13), pages 1637-1646, May.
    20. Dieter Hess & Sebastian Orbe, 2013. "Irrationality or Efficiency of Macroeconomic Survey Forecasts? Implications from the Anchoring Bias Test," Review of Finance, European Finance Association, vol. 17(6), pages 2097-2131.
    21. Arai, Natsuki, 2014. "Using forecast evaluation to improve the accuracy of the Greenbook forecast," International Journal of Forecasting, Elsevier, vol. 30(1), pages 12-19.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andrew C. Chang & Trace J. Levinson, 2023. "Raiders of the lost high‐frequency forecasts: New data and evidence on the efficiency of the Fed's forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(1), pages 88-104, January.
    2. Andrew C. Chang & Phillip Li, 2018. "Measurement Error In Macroeconomic Data And Economics Research: Data Revisions, Gross Domestic Product, And Gross Domestic Income," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1846-1869, July.
    3. Andrew C. Chang & Trace J. Levinson, 2020. "Raiders of the Lost High-Frequency Forecasts: New Data and Evidence on the Efficiency of the Fed's Forecasting," Finance and Economics Discussion Series 2020-090, Board of Governors of the Federal Reserve System (U.S.).
    4. Tomaz Cajner & Leland D. Crane & Ryan A. Decker & Adrian Hamins-Puertolas & Christopher J. Kurz & Tyler Radler, 2018. "Using Payroll Processor Microdata to Measure Aggregate Labor Market Activity," Finance and Economics Discussion Series 2018-005, Board of Governors of the Federal Reserve System (U.S.).
    5. Thomas L. Hogan, 2022. "The calculus of dissent: Bias and diversity in FOMC projections," Public Choice, Springer, vol. 191(1), pages 105-135, April.
    6. Lillian R. Gaeto & Sandeep Mazumder, 2019. "Measuring the Accuracy of Federal Reserve Forecasts," Southern Economic Journal, John Wiley & Sons, vol. 85(3), pages 960-984, January.
    7. Andrew C. Chang, 2018. "The Fed's Asymmetric Forecast Errors," Finance and Economics Discussion Series 2018-026, Board of Governors of the Federal Reserve System (U.S.).
    8. Andrew C. Chang, 2018. "Nothing is Certain Except Death and Taxes : The Lack of Policy Uncertainty from Expiring \"Temporary\" Taxes," Finance and Economics Discussion Series 2018-041, Board of Governors of the Federal Reserve System (U.S.).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew C. Chang & Tyler J. Hanson, 2015. "The Accuracy of Forecasts Prepared for the Federal Open Market Committee," Finance and Economics Discussion Series 2015-62, Board of Governors of the Federal Reserve System (U.S.).
    2. Andrew C. Chang & Trace J. Levinson, 2023. "Raiders of the lost high‐frequency forecasts: New data and evidence on the efficiency of the Fed's forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(1), pages 88-104, January.
    3. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    4. Arai, Natsuki, 2020. "Investigating the inefficiency of the CBO’s budgetary projections," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1290-1300.
    5. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    6. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    7. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    8. Arai, Natsuki & Iizuka, Nobuo & Yamamoto, Yohei, 2022. "The Efficiency of the Government’s Revenue Projections," Discussion paper series HIAS-E-122, Hitotsubashi Institute for Advanced Study, Hitotsubashi University.
    9. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    10. Hamid Baghestani, 2013. "Evaluating Federal Reserve predictions of growth in consumer spending," Applied Economics, Taylor & Francis Journals, vol. 45(13), pages 1637-1646, May.
    11. Patrick Schmidt & Matthias Katzfuss & Tilmann Gneiting, 2021. "Interpretation of point forecasts with unknown directive," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 728-743, September.
    12. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    13. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    14. Julieta Caunedo & Riccardo Dicecio & Ivana Komunjer & Michael T. Owyang, 2020. "Asymmetry, Complementarities, and State Dependence in Federal Reserve Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 52(1), pages 205-228, February.
    15. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    16. Julien Champagne & Guillaume Poulin-Bellisle & Rodrigo Sekkel, 2018. "Evaluating the Bank of Canada Staff Economic Projections Using a New Database of Real-Time Data and Forecasts," Staff Working Papers 18-52, Bank of Canada.
    17. Carola Conces Binder & Rodrigo Sekkel, 2023. "Central Bank Forecasting: A Survey," Staff Working Papers 23-18, Bank of Canada.
    18. Timo Dimitriadis & Andrew J. Patton & Patrick W. Schmidt, 2019. "Testing Forecast Rationality for Measures of Central Tendency," Papers 1910.12545, arXiv.org, revised Jun 2023.
    19. Yoichi Tsuchiya, 2021. "The value added of the Bank of Japan's range forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(5), pages 817-833, August.
    20. G. Kontogeorgos & K. Lambrias, 2022. "Evaluating the Eurosystem/ECB staff macroeconomic projections: The first 20 years," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 213-229, March.

    More about this item

    Keywords

    Bayesian model averaging; Federal Open Market Committee; Forecast accuracy; Greenbook; National income and product accounts; Real-time data;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • F17 - International Economics - - Trade - - - Trade Forecasting and Simulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jebusi:v:83:y:2016:i:c:p:23-43. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-economics-and-business .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.