IDEAS home Printed from https://ideas.repec.org/a/wly/japmet/v38y2023i1p88-104.html
   My bibliography  Save this article

Raiders of the lost high‐frequency forecasts: New data and evidence on the efficiency of the Fed's forecasting

Author

Listed:
  • Andrew C. Chang
  • Trace J. Levinson

Abstract

We introduce a new dataset of real gross domestic product (GDP) growth and core personal consumption expenditures (PCE) inflation forecasts produced by the staff of the Board of Governors of the Federal Reserve System. In contrast to the eight Greenbook forecasts a year the staff produce for Federal Open Market Committee (FOMC) meetings, our dataset has roughly weekly forecasts. We use these data to study whether the staff forecasts efficiently. Prespecified regressions of forecast errors on forecast revisions show the staff's GDP forecasts exhibit time‐varying inefficiency between FOMC meetings, and also show some evidence for inefficient inflation forecasts.

Suggested Citation

  • Andrew C. Chang & Trace J. Levinson, 2023. "Raiders of the lost high‐frequency forecasts: New data and evidence on the efficiency of the Fed's forecasting," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(1), pages 88-104, January.
  • Handle: RePEc:wly:japmet:v:38:y:2023:i:1:p:88-104
    DOI: 10.1002/jae.2938
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/jae.2938
    Download Restriction: no

    File URL: https://libkey.io/10.1002/jae.2938?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andrew C. Chang & Phillip Li, 2018. "Measurement Error In Macroeconomic Data And Economics Research: Data Revisions, Gross Domestic Product, And Gross Domestic Income," Economic Inquiry, Western Economic Association International, vol. 56(3), pages 1846-1869, July.
    2. Fred Joutz & Michael P. Clements & Herman O. Stekler, 2007. "An evaluation of the forecasts of the federal reserve: a pooled approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(1), pages 121-136.
    3. Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
    4. Sarah A. Janzen & Jeffrey D. Michler, 2021. "Ulysses' pact or Ulysses' raft: Using pre‐analysis plans in experimental and nonexperimental research," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1286-1304, December.
    5. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    6. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    7. Scott R. Baker & Tucker S. McElroy & Xuguang S. Sheng, 2020. "Expectation Formation Following Large, Unexpected Shocks," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 287-303, May.
    8. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    9. J. Steven Landefeld & Eugene P. Seskin & Barbara M. Fraumeni, 2008. "Taking the Pulse of the Economy: Measuring GDP," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 193-216, Spring.
    10. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    11. Joutz, Fred & Stekler, H. O., 2000. "An evaluation of the predictions of the Federal Reserve," International Journal of Forecasting, Elsevier, vol. 16(1), pages 17-38.
    12. S. Borağan Aruoba, 2008. "Data Revisions Are Not Well Behaved," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(2‐3), pages 319-340, March.
    13. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    14. Patton, Andrew J. & Timmermann, Allan, 2010. "Why do forecasters disagree? Lessons from the term structure of cross-sectional dispersion," Journal of Monetary Economics, Elsevier, vol. 57(7), pages 803-820, October.
    15. Dean Croushore & Simon van Norden, 2018. "Fiscal Forecasts at the FOMC: Evidence from the Greenbooks," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 933-945, December.
    16. Andrew C. Chang & Phillip Li, 2017. "A Preanalysis Plan to Replicate Sixty Economics Research Papers That Worked Half of the Time," American Economic Review, American Economic Association, vol. 107(5), pages 60-64, May.
    17. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    18. Barbara Rossi & Tatevik Sekhposyan, 2016. "Forecast Rationality Tests in the Presence of Instabilities, with Applications to Federal Reserve and Survey Forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 507-532, April.
    19. Croushore, Dean & van Norden, Simon, 2019. "Fiscal Surprises at the FOMC," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1583-1595.
    20. Katherine Casey & Rachel Glennerster & Edward Miguel, 2012. "Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(4), pages 1755-1812.
    21. Campbell, Sean D. & Sharpe, Steven A., 2009. "Anchoring Bias in Consensus Forecasts and Its Effect on Market Prices," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 44(2), pages 369-390, April.
    22. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, March.
    23. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    24. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    25. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    26. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    27. Andrew C. Chang & Phillip Li, 2022. "Is Economics Research Replicable? Sixty Published Papers From Thirteen Journals Say “Often Notâ€," Critical Finance Review, now publishers, vol. 11(1), pages 185-206, February.
    28. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    29. Reifschneider, David & Tulip, Peter, 2019. "Gauging the uncertainty of the economic outlook using historical forecasting errors: The Federal Reserve’s approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1564-1582.
    30. Berge, Travis J. & Chang, Andrew C. & Sinha, Nitish R., 2019. "Evaluating the conditionality of judgmental forecasts," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1627-1635.
    31. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    32. Chang, Andrew C., 2018. "A replication recipe: List your ingredients before you start cooking," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 12, pages 1-8.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carola Conces Binder & Rodrigo Sekkel, 2023. "Central Bank Forecasting: A Survey," Staff Working Papers 23-18, Bank of Canada.
    2. Andrew C. Chang & Trace J. Levinson, 2020. "Raiders of the Lost High-Frequency Forecasts: New Data and Evidence on the Efficiency of the Fed's Forecasting," Finance and Economics Discussion Series 2020-090, Board of Governors of the Federal Reserve System (U.S.).
    3. Chang, Andrew C. & Hanson, Tyler J., 2016. "The accuracy of forecasts prepared for the Federal Open Market Committee," Journal of Economics and Business, Elsevier, vol. 83(C), pages 23-43.
    4. Berge, Travis J. & Chang, Andrew C. & Sinha, Nitish R., 2019. "Evaluating the conditionality of judgmental forecasts," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1627-1635.
    5. Arai, Natsuki, 2020. "Investigating the inefficiency of the CBO’s budgetary projections," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1290-1300.
    6. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    7. Yoichi Tsuchiya, 2021. "The value added of the Bank of Japan's range forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(5), pages 817-833, August.
    8. G. Kontogeorgos & K. Lambrias, 2022. "Evaluating the Eurosystem/ECB staff macroeconomic projections: The first 20 years," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 213-229, March.
    9. Paul Hubert, 2015. "Revisiting the Greenbook’s relative forecasting performance," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(1), pages 151-179.
    10. Granziera, Eleonora & Jalasjoki, Pirkka & Paloviita, Maritta, 2021. "The bias and efficiency of the ECB inflation projections: a State dependent analysis," Research Discussion Papers 7/2021, Bank of Finland.
    11. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    12. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    13. Julien Champagne & Guillaume Poulin‐Bellisle & Rodrigo Sekkel, 2020. "Introducing the Bank of Canada staff economic projections database," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(1), pages 114-129, January.
    14. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    15. repec:zbw:bofrdp:2021_007 is not listed on IDEAS
    16. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    17. Eleonora Granziera & Pirkka Jalasjoki & Maritta Paloviita, 2021. "The Bias and Efficiency of the ECB Inflation Projections: a State Dependent Analysis," Working Paper 2021/1, Norges Bank.
    18. Granziera, Eleonora & Jalasjoki, Pirkka & Paloviita, Maritta, 2021. "The bias and efficiency of the ECB inflation projections: A state dependent analysis," Bank of Finland Research Discussion Papers 7/2021, Bank of Finland.
    19. Lillian R. Gaeto & Sandeep Mazumder, 2019. "Measuring the Accuracy of Federal Reserve Forecasts," Southern Economic Journal, John Wiley & Sons, vol. 85(3), pages 960-984, January.
    20. repec:hal:spmain:info:hdl:2441/35kgubh40v9gfpnuruelqjnptb is not listed on IDEAS
    21. Sheng, Xuguang (Simon), 2015. "Evaluating the economic forecasts of FOMC members," International Journal of Forecasting, Elsevier, vol. 31(1), pages 165-175.
    22. Michael P. Clements, 2014. "US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 1-14, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:japmet:v:38:y:2023:i:1:p:88-104. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.