IDEAS home Printed from https://ideas.repec.org/a/fip/fedbne/y2001p35-56n1.html
   My bibliography  Save this article

An evaluation of recent macroeconomic forecast errors

Author

Listed:
  • Scott Schuh

Abstract

Despite a significant decline in the pace of economic growth in the second half of 2000, macroeconomic forecasters underpredicted real GDP growth and overpredicted the unemployment rate by a significant amount, for the fifth consecutive year. On average, real GDP forecasts were about 2 percentage points below the actual data for the 1996-2000 period, and unemployment rate forecasts about 0.5 percentage point above. On a more positive note, forecasters ended their chronic overprediction of inflation during much of this period. Nevertheless, surprisingly large and persistent errors in recent forecasts of GDP, inflation, and unemployment have perplexed macroeconomists and policymakers for quite some time, and they merit closer examination. ; This article evaluates forecast errors in an attempt to understand why recent forecasts have gone awry. The investigation centers on errors in forecasts of real GDP growth, inflation, the unemployment rate, and nominal and real short-term interest rates since 1969. The focus is on one-year-ahead forecasts because well-known lags in the effects of monetary policy require the Federal Reserve to forecast economic activity well ahead when setting its current interest rate target. In addition to studying average forecast errors, the author looks briefly at the time series properties of the work of some individual forecasters.

Suggested Citation

  • Scott Schuh, 2001. "An evaluation of recent macroeconomic forecast errors," New England Economic Review, Federal Reserve Bank of Boston, pages 35-56.
  • Handle: RePEc:fip:fedbne:y:2001:p:35-56:n:1
    as

    Download full text from publisher

    File URL: http://www.bostonfed.org/economic/neer/neer2001/neer101c.htm
    Download Restriction: no

    File URL: http://www.bostonfed.org/economic/neer/neer2001/neer101c.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Evan F. Koenig & Sheila Dolmas & Jeremy Piger, 2003. "The Use and Abuse of Real-Time Data in Economic Forecasting," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 618-628, August.
    2. Victor Zarnowitz & Phillip Braun, 1993. "Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 11-94, National Bureau of Economic Research, Inc.
    3. Loungani, Prakash, 2001. "How accurate are private sector forecasts? Cross-country evidence from consensus forecasts of output growth," International Journal of Forecasting, Elsevier, vol. 17(3), pages 419-432.
    4. Athanasios Orphanides, 2000. "Activist stabilization policy and inflation: the Taylor rule in the 1970s," Finance and Economics Discussion Series 2000-13, Board of Governors of the Federal Reserve System (U.S.).
    5. Lamont, Owen A., 2002. "Macroeconomic forecasts and microeconomic forecasters," Journal of Economic Behavior & Organization, Elsevier, vol. 48(3), pages 265-280, July.
    6. Tom Stark, 1997. "Macroeconomic forecasts and microeconomic forecasters in the Survey of Professional Forecasters," Working Papers 97-10, Federal Reserve Bank of Philadelphia.
    7. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    8. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    9. Dean Croushore & Tom Stark, 2000. "A real-time data set for macroeconomists: does data vintage matter for forecasting?," Working Papers 00-6, Federal Reserve Bank of Philadelphia.
    10. Stephen K. McNees, 1992. "How large are economic forecast errors?," New England Economic Review, Federal Reserve Bank of Boston, issue Jul, pages 25-42.
    11. Victor Zarnowitz & Louis A. Lambros, 1983. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
    12. Terence Lim, 2001. "Rationality and Analysts' Forecast Bias," Journal of Finance, American Finance Association, vol. 56(1), pages 369-385, February.
    13. John C. Robertson & Ellis W. Tallman, 1998. "Data vintages and measuring forecast model performance," Economic Review, Federal Reserve Bank of Atlanta, vol. 83(Q 4), pages 4-20.
    14. James H. Stock & Mark W. Watson, 1993. "Business Cycles, Indicators, and Forecasting," NBER Books, National Bureau of Economic Research, Inc, number stoc93-1, March.
    15. Stock, James H. & Watson, Mark W. (ed.), 1993. "Business Cycles, Indicators, and Forecasting," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226774886, December.
    16. Granger, C. W. J. & Newbold, Paul, 1986. "Forecasting Economic Time Series," Elsevier Monographs, Elsevier, edition 2, number 9780122951831 edited by Shell, Karl.
    17. Zarnowitz, Victor, 1985. "Rational Expectations and Macroeconomic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(4), pages 293-311, October.
    18. Bonham, Carl & Cohen, Richard, 1995. "Testing the Rationality of Price Forecasts: Comment," American Economic Review, American Economic Association, vol. 85(1), pages 284-289, March.
    19. Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Capistrán Carlos & López Moctezuma Gabriel, 2008. "Experts' Macroeconomics Expectations: An Evaluation of Mexican Short-Run Forecasts," Working Papers 2008-11, Banco de México.
    2. Gavin, William T. & Mandal, Rachel J., 2003. "Evaluating FOMC forecasts," International Journal of Forecasting, Elsevier, vol. 19(4), pages 655-667.
    3. Fabiana Gomez & David Pacini, 2015. "Counting Biased Forecasters: An Application of Multiple Testing Techniques," Bristol Economics Discussion Papers 15/661, School of Economics, University of Bristol, UK.
    4. Sweder van Wijnbergen & Tim Willems, 2013. "Imperfect information, lagged labour adjustment, and the Great Moderation," Oxford Economic Papers, Oxford University Press, vol. 65(2), pages 219-239, April.
    5. Stephen Morris & Hyun Song Shin, 2005. "Central Bank Transparency and the Signal Value of Prices," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 36(2), pages 1-66.
    6. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    7. William T. Gavin, 2003. "FOMC forecast: is all the information in the central tendency?," Review, Federal Reserve Bank of St. Louis, vol. 85(May), pages 27-46.
    8. John B. Broughton & Bento J. Lobo, 2018. "Herding and anchoring in macroeconomic forecasts: the case of the PMI," Empirical Economics, Springer, vol. 55(3), pages 1337-1355, November.
    9. Sanders, Dwight R. & Manfredo, Mark R. & Boris, Keith, 2009. "Evaluating information in multiple horizon forecasts: The DOE's energy price forecasts," Energy Economics, Elsevier, vol. 31(2), pages 189-196.
    10. Sergey V. Smirnov & Daria A. Avdeeva, 2016. "Wishful Bias in Predicting Us Recessions: Indirect Evidence," HSE Working papers WP BRP 135/EC/2016, National Research University Higher School of Economics.
    11. Luis Fernando Melo & Héctor Núñez, 2004. "Combinación de Pronósticos de la Inflación en Presencia de cambios Estructurales," Borradores de Economia 286, Banco de la Republica de Colombia.
    12. Luis Fernando Melo Velandia & Héctor M. Núñez Amortegui, 2004. "Combinación de pronósticos de la inflación en presencia de cambios estructurales," Borradores de Economia 2153, Banco de la Republica.
    13. Sergey V. Smirnov, 2014. "Predicting US Recessions: Does a Wishful Bias Exist?," HSE Working papers WP BRP 77/EC/2014, National Research University Higher School of Economics.
    14. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander, Marcus & Christakis, Nicholas A., 2008. "Bias and asymmetric loss in expert forecasts: A study of physician prognostic behavior with respect to patient survival," Journal of Health Economics, Elsevier, vol. 27(4), pages 1095-1108, July.
    2. Ottaviani, Marco & Sorensen, Peter Norman, 2006. "The strategy of professional forecasting," Journal of Financial Economics, Elsevier, vol. 81(2), pages 441-466, August.
    3. Lamont, Owen A., 2002. "Macroeconomic forecasts and microeconomic forecasters," Journal of Economic Behavior & Organization, Elsevier, vol. 48(3), pages 265-280, July.
    4. Rianne Legerstee & Philip Hans Franses, 2015. "Does Disagreement Amongst Forecasters Have Predictive Value?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 34(4), pages 290-302, July.
    5. Paul Bennett & In Sun Geoum & David S. Laster, 1997. "Rational bias in macroeconomic forecasts," Staff Reports 21, Federal Reserve Bank of New York.
    6. Harvey, David I. & Newbold, Paul, 2003. "The non-normality of some macroeconomic forecast errors," International Journal of Forecasting, Elsevier, vol. 19(4), pages 635-653.
    7. Clements, Michael P, 2012. "Subjective and Ex Post Forecast Uncertainty : US Inflation and Output Growth," The Warwick Economics Research Paper Series (TWERPS) 995, University of Warwick, Department of Economics.
    8. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    9. Gavin, William T. & Mandal, Rachel J., 2003. "Evaluating FOMC forecasts," International Journal of Forecasting, Elsevier, vol. 19(4), pages 655-667.
    10. Clements, Michael P., 2006. "Internal consistency of survey respondentsíforecasts: Evidence based on the Survey of Professional Forecasters," Economic Research Papers 269742, University of Warwick - Department of Economics.
    11. Stekler, H.O., 2007. "The future of macroeconomic forecasting: Understanding the forecasting process," International Journal of Forecasting, Elsevier, vol. 23(2), pages 237-248.
    12. Jordi Pons-Novell, 2003. "Strategic bias, herding behaviour and economic forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(1), pages 67-77.
    13. Gamber, Edward N. & Hakes, David R., 2005. "Is monetary policy important for forecasting real growth and inflation?," Journal of Policy Modeling, Elsevier, vol. 27(2), pages 177-187, March.
    14. Gregory, Allan W. & Yetman, James, 2004. "The evolution of consensus in macroeconomic forecasting," International Journal of Forecasting, Elsevier, vol. 20(3), pages 461-473.
    15. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    16. Jalles, João Tovar, 2017. "On the rationality and efficiency of inflation forecasts: Evidence from advanced and emerging market economies," Research in International Business and Finance, Elsevier, vol. 40(C), pages 175-189.
    17. Lahiri, Kajal & Sheng, Xuguang, 2010. "Learning and heterogeneity in GDP and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 26(2), pages 265-292, April.
    18. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    19. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    20. Kajal Lahiri & Fushang Liu, 2006. "Modelling multi‐period inflation uncertainty using a panel of density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1199-1219, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedbne:y:2001:p:35-56:n:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Spozio (email available below). General contact details of provider: https://edirc.repec.org/data/frbbous.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.