IDEAS home Printed from https://ideas.repec.org/p/rba/rbardp/rdp2017-01.html
   My bibliography  Save this paper

Gauging the Uncertainty of the Economic Outlook Using Historical Forecasting Errors: The Federal Reserve's Approach

Author

Listed:
  • David Reifschneider

    (Board of Governors of the Federal Reserve System)

  • Peter Tulip

    (Reserve Bank of Australia)

Abstract

Since November 2007, the Federal Open Market Committee (FOMC) of the US Federal Reserve has regularly published participants' qualitative assessments of the uncertainty attending their individual forecasts of real activity and inflation, expressed relative to that seen on average in the past. The benchmarks used for these historical comparisons are the average root mean squared forecast errors (RMSEs) made by various private and government forecasters over the past twenty years. This paper documents how these benchmarks are constructed and discusses some of their properties. We draw several conclusions. First, if past performance is a reasonable guide to future accuracy, considerable uncertainty surrounds all macroeconomic projections, including those of FOMC participants. Second, different forecasters have similar accuracy. Third, estimates of uncertainty about future real activity and interest rates are now considerably greater than prior to the financial crisis; in contrast, estimates of inflation accuracy have changed little. Finally, fan charts – constructed as plus-or-minus one RMSE intervals about the median FOMC forecast, under the expectation that future projection errors will be unbiased and symmetrically distributed, and that the intervals cover about 70 percent of possible outcomes – provide a reasonable approximation to future uncertainty, especially when viewed in conjuction with the FOMC's qualitative assessments. That said, an assumption of symmetry about the interest rate outlook is problematic if the expected path of the federal funds rate is expected to remain low.

Suggested Citation

  • David Reifschneider & Peter Tulip, 2017. "Gauging the Uncertainty of the Economic Outlook Using Historical Forecasting Errors: The Federal Reserve's Approach," RBA Research Discussion Papers rdp2017-01, Reserve Bank of Australia.
  • Handle: RePEc:rba:rbardp:rdp2017-01
    as

    Download full text from publisher

    File URL: https://www.rba.gov.au/publications/rdp/2017/pdf/rdp2017-01.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Fair, Ray C., 2014. "How might a central bank report uncertainty?," Economics Discussion Papers 2014-25, Kiel Institute for the World Economy (IfW Kiel).
    2. Holston, Kathryn & Laubach, Thomas & Williams, John C., 2017. "Measuring the natural rate of interest: International trends and determinants," Journal of International Economics, Elsevier, vol. 108(S1), pages 59-75.
    3. Alejandro Justiniano & Giorgio E. Primiceri, 2008. "The Time-Varying Volatility of Macroeconomic Fluctuations," American Economic Review, American Economic Association, vol. 98(3), pages 604-641, June.
    4. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    5. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    6. Michael D. Bauer & Glenn D. Rudebusch, 2016. "Monetary Policy Expectations at the Zero Lower Bound," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 48(7), pages 1439-1465, October.
    7. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    8. Todd E. Clark, 2011. "Real-Time Density Forecasts From Bayesian Vector Autoregressions With Stochastic Volatility," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 327-341, July.
    9. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    10. Lukas Vogel, 2007. "How do the OECD Growth Projections for the G7 Economies Perform?: A Post-Mortem," OECD Economics Department Working Papers 573, OECD Publishing.
    11. William T. Gavin & Rachel J. Mandal, 2001. "Forecasting inflation and growth: do private forecasts match those of policymakers?," Review, Federal Reserve Bank of St. Louis, vol. 83(May), pages 11-20.
    12. Croushore Dean, 2010. "An Evaluation of Inflation Forecasts from Surveys Using Real-Time Data," The B.E. Journal of Macroeconomics, De Gruyter, vol. 10(1), pages 1-32, May.
    13. Malte Knüppel & Guido Schultefrankenfeld, 2012. "How Informative Are Central Bank Assessments of Macroeconomic Risks?," International Journal of Central Banking, International Journal of Central Banking, vol. 8(3), pages 87-139, September.
    14. Diebold, Francis X. & Schorfheide, Frank & Shin, Minchul, 2017. "Real-time forecast evaluation of DSGE models with stochastic volatility," Journal of Econometrics, Elsevier, vol. 201(2), pages 322-332.
    15. Wallis, Kenneth F, 1989. "Macroeconomic Forecasting: A Survey," Economic Journal, Royal Economic Society, vol. 99(394), pages 28-61, March.
    16. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    17. Campbell, Sean D., 2007. "Macroeconomic Volatility, Predictability, and Uncertainty in the Great Moderation: Evidence From the Survey of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 191-200, April.
    18. Knüppel, Malte, 2014. "Efficient estimation of forecast uncertainty based on recent forecast errors," International Journal of Forecasting, Elsevier, vol. 30(2), pages 257-267.
    19. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    20. Fair, Ray C, 1980. "Estimating the Expected Predictive Accuracy of Econometric Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 21(2), pages 355-378, June.
    21. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    22. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    23. Fair, Ray C., 2014. "How might a central bank report uncertainty?," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 8, pages 1-22.
    24. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    25. Peter Tulip & Stephanie Wallace, 2012. "Estimates of Uncertainty around the RBA's Forecasts," RBA Research Discussion Papers rdp2012-07, Reserve Bank of Australia.
    26. Knüppel, Malte & Vladu, Andreea L., 2016. "Approximating fixed-horizon forecasts using fixed-event forecasts," Discussion Papers 28/2016, Deutsche Bundesbank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Communicating Monetary Policy Uncertainty
      by Steve Cecchetti and Kim Schoenholtz in Money, Banking and Financial Markets on 2019-04-22 13:01:56

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    2. Berge, Travis J. & Chang, Andrew C. & Sinha, Nitish R., 2019. "Evaluating the conditionality of judgmental forecasts," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1627-1635.
    3. Janet L. Yellen, 2017. "Inflation, Uncertainty, and Monetary Policy : a speech at the \"Prospects for Growth: Reassessing the Fundamentals\" 59th Annual Meeting of the National Association for Business Economics, C," Speech 971, Board of Governors of the Federal Reserve System (U.S.).
    4. Galbraith, John W. & van Norden, Simon, 2019. "Asymmetry in unemployment rate forecast errors," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1613-1626.
    5. Wang, Jiayu & Quiggin, John & Wittwer, Glyn, 2019. "The rebound effect of the Australian proposed light vehicle fuel efficiency standards," Economic Analysis and Policy, Elsevier, vol. 61(C), pages 73-84.
    6. Wright, Jonathan H., 2019. "Some observations on forecasting and policy," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1186-1192.
    7. Sharpe, Steven A. & Sinha, Nitish R. & Hollrah, Christopher A., 2023. "The power of narrative sentiment in economic forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1097-1121.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reifschneider, David & Tulip, Peter, 2019. "Gauging the uncertainty of the economic outlook using historical forecasting errors: The Federal Reserve’s approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1564-1582.
    2. Todd E. Clark & Michael W. McCracken & Elmar Mertens, 2020. "Modeling Time-Varying Uncertainty of Multiple-Horizon Forecast Errors," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 17-33, March.
    3. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    4. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    5. Paul Hubert, 2015. "Revisiting the Greenbook’s relative forecasting performance," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(1), pages 151-179.
    6. repec:hal:spmain:info:hdl:2441/35kgubh40v9gfpnuruelqjnptb is not listed on IDEAS
    7. Todd E. Clark & Francesco Ravazzolo, 2012. "The macroeconomic forecasting performance of autoregressive models with alternative specifications of time-varying volatility," Working Paper 2012/09, Norges Bank.
    8. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    9. Peter Tulip & Stephanie Wallace, 2012. "Estimates of Uncertainty around the RBA's Forecasts," RBA Research Discussion Papers rdp2012-07, Reserve Bank of Australia.
    10. Berge, Travis J. & Chang, Andrew C. & Sinha, Nitish R., 2019. "Evaluating the conditionality of judgmental forecasts," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1627-1635.
    11. Arai, Natsuki, 2014. "Using forecast evaluation to improve the accuracy of the Greenbook forecast," International Journal of Forecasting, Elsevier, vol. 30(1), pages 12-19.
    12. Liu, Dandan & Smith, Julie K., 2014. "Inflation forecasts and core inflation measures: Where is the information on future inflation?," The Quarterly Review of Economics and Finance, Elsevier, vol. 54(1), pages 133-137.
    13. Fabian Krüger & Todd E. Clark & Francesco Ravazzolo, 2017. "Using Entropic Tilting to Combine BVAR Forecasts With External Nowcasts," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 470-485, July.
    14. repec:spo:wpmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    15. repec:hal:spmain:info:hdl:2441/3pot7260lh88lrfhrhvs85lh2f is not listed on IDEAS
    16. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    17. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    18. Pablo Guerróon‐Quintana & Molin Zhong, 2023. "Macroeconomic forecasting in times of crises," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 295-320, April.
    19. Gamber, Edward N. & Smith, Julie K., 2009. "Are the Fed's inflation forecasts still superior to the private sector's?," Journal of Macroeconomics, Elsevier, vol. 31(2), pages 240-251, June.
    20. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    21. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    22. Markus Heinrich & Magnus Reif, 2020. "Real-Time Forecasting Using Mixed-Frequency VARS with Time-Varying Parameters," CESifo Working Paper Series 8054, CESifo.
    23. Carriero, Andrea & Clark, Todd E. & Marcellino, Massimiliano, 2021. "Using time-varying volatility for identification in Vector Autoregressions: An application to endogenous uncertainty," Journal of Econometrics, Elsevier, vol. 225(1), pages 47-73.

    More about this item

    Keywords

    forecast uncertainty; fan charts; interval estimation;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rba:rbardp:rdp2017-01. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Paula Drew (email available below). General contact details of provider: https://edirc.repec.org/data/rbagvau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.