IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v33y2017i3p591-604.html
   My bibliography  Save this article

Model and survey estimates of the term structure of US macroeconomic uncertainty

Author

Listed:
  • Clements, Michael P.
  • Galvão, Ana Beatriz

Abstract

Survey data on macro-forecasters suggest that their assessments of future output growth and inflation uncertainty tend to be too high. We find that model estimates of the term structure of ex ante or perceived macro uncertainty are more in line with ex post RMSE measures than are the survey respondents’ perceptions. At shorter horizons, the models’ assessments of the uncertainty characterising the outlook are lower than those indicated by the survey data histograms, and closer to the RMSE estimates. Recent developments in econometric modelling ensure that the models’ information sets line up with the timing of information available to the survey respondents, thus enabling a fair comparison.

Suggested Citation

  • Clements, Michael P. & Galvão, Ana Beatriz, 2017. "Model and survey estimates of the term structure of US macroeconomic uncertainty," International Journal of Forecasting, Elsevier, vol. 33(3), pages 591-604.
  • Handle: RePEc:eee:intfor:v:33:y:2017:i:3:p:591-604
    DOI: 10.1016/j.ijforecast.2017.01.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207017300092
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2017.01.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    2. Knüppel, Malte, 2014. "Efficient estimation of forecast uncertainty based on recent forecast errors," International Journal of Forecasting, Elsevier, vol. 30(2), pages 257-267.
    3. Marianne Sensier & Dick van Dijk, 2004. "Testing for Volatility Changes in U.S. Macroeconomic Time Series," The Review of Economics and Statistics, MIT Press, vol. 86(3), pages 833-839, August.
    4. Claudia Foroni & Massimiliano Marcellino, 2013. "A survey of econometric methods for mixed-frequency data," Working Paper 2013/06, Norges Bank.
    5. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    6. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    7. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    8. Victor Zarnowitz & Phillip Braun, 1993. "Twenty-two Years of the NBER-ASA Quarterly Economic Outlook Surveys: Aspects and Comparisons of Forecasting Performance," NBER Chapters, in: Business Cycles, Indicators, and Forecasting, pages 11-94, National Bureau of Economic Research, Inc.
    9. Andrew J. Patton & Allan Timmermann, 2011. "Predictability of Output Growth and Inflation: A Multi-Horizon Survey Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 397-410, July.
    10. Michael P. Clements & David F. Hendry, 2005. "Evaluating a Model by Forecast Performance," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 931-956, December.
    11. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    12. Massimiliano Marcellino & Christian Schumacher, 2010. "Factor MIDAS for Nowcasting and Forecasting with Ragged‐Edge Data: A Model Comparison for German GDP," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 72(4), pages 518-550, August.
    13. Thomas Gilbert & Chiara Scotti & Georg H. Strasser & Clara Vega, 2015. "Is the Intrinsic Value of Macroeconomic News Announcements Related to Their Asset Price Impact?," Boston College Working Papers in Economics 874, Boston College Department of Economics, revised 23 Apr 2015.
    14. Andrew Blake & Haroon Mumtaz, 2015. "Applied Bayesian Econometrics for central bankers," Handbooks, Centre for Central Banking Studies, Bank of England, number 36, April.
    15. Michael P. Clements, 2014. "Forecast Uncertainty- Ex Ante and Ex Post : U.S. Inflation and Output Growth," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(2), pages 206-216, April.
    16. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    17. Christopher D. Carroll, 1997. "Buffer-Stock Saving and the Life Cycle/Permanent Income Hypothesis," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(1), pages 1-55.
    18. Victor Zarnowitz, 1969. "The New ASA–NBER Survey of Forecasts by Economic Statisticians," NBER Chapters, in: Supplement to NBER Report Four, pages 1-8, National Bureau of Economic Research, Inc.
    19. Herbst, Edward & Schorfheide, Frank, 2012. "Evaluating DSGE model forecasts of comovements," Journal of Econometrics, Elsevier, vol. 171(2), pages 152-166.
    20. Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
    21. Barbara Rossi & Tatevik Sekhposyan, 2015. "Macroeconomic Uncertainty Indices Based on Nowcast and Forecast Error Distributions," American Economic Review, American Economic Association, vol. 105(5), pages 650-655, May.
    22. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    23. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    24. Joshua C C Chan & Cody Y L Hsiao, 2013. "Estimation of Stochastic Volatility Models with Heavy Tails and Serial Dependence," CAMA Working Papers 2013-74, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    25. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Oxford University Press, vol. 65(3), pages 361-393.
    26. Elena Andreou & Eric Ghysels & Andros Kourtellos, 2013. "Should Macroeconomic Forecasters Use Daily Financial Data and How?," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 240-251, April.
    27. Clements, Michael P., 2014. "Probability distributions or point predictions? Survey forecasts of US output growth and inflation," International Journal of Forecasting, Elsevier, vol. 30(1), pages 99-117.
    28. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    29. Han, Chuan-Hsiang & Molina, German & Fouque, Jean-Pierre, 2014. "McMC estimation of multiscale stochastic volatility models with applications," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 103(C), pages 1-11.
    30. Ang, Andrew & Bekaert, Geert & Wei, Min, 2007. "Do macro variables, asset markets, or surveys forecast inflation better?," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1163-1212, May.
    31. Ghysels, Eric & Santa-Clara, Pedro & Valkanov, Rossen, 2006. "Predicting volatility: getting the most out of return data sampled at different frequencies," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 59-95.
    32. Bauwens, Luc & Lubrano, Michel & Richard, Jean-Francois, 2000. "Bayesian Inference in Dynamic Econometric Models," OUP Catalogue, Oxford University Press, number 9780198773139, Decembrie.
    33. Clements, Michael P & Galvão, Ana Beatriz, 2008. "Macroeconomic Forecasting With Mixed-Frequency Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 546-554.
    34. Eric Ghysels & Arthur Sinko & Rossen Valkanov, 2007. "MIDAS Regressions: Further Results and New Directions," Econometric Reviews, Taylor & Francis Journals, vol. 26(1), pages 53-90.
    35. Hansen, Bruce E, 1997. "Approximate Asymptotic P Values for Structural-Change Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(1), pages 60-67, January.
    36. James H. Stock & Mark W. Watson, 1993. "Business Cycles, Indicators, and Forecasting," NBER Books, National Bureau of Economic Research, Inc, number stoc93-1, March.
    37. Avinash K. Dixit & Robert S. Pindyck, 1994. "Investment under Uncertainty," Economics Books, Princeton University Press, edition 1, number 5474.
    38. Ghysels, Eric & Wright, Jonathan H., 2009. "Forecasting Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 504-516.
    39. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    40. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2016. "A MIDAS approach to modeling first and second moment dynamics," Journal of Econometrics, Elsevier, vol. 193(2), pages 315-334.
    41. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    42. Dean Croushore, 1993. "Introducing: the survey of professional forecasters," Business Review, Federal Reserve Bank of Philadelphia, issue Nov, pages 3-15.
    43. Stock, James H. & Watson, Mark W. (ed.), 1993. "Business Cycles, Indicators, and Forecasting," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226774886, December.
    44. J. Steven Landefeld & Eugene P. Seskin & Barbara M. Fraumeni, 2008. "Taking the Pulse of the Economy: Measuring GDP," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 193-216, Spring.
    45. Michael P. Clements & Ana Beatriz Galvão, 2017. "Predicting Early Data Revisions to U.S. GDP and the Effects of Releases on Equity Markets," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 389-406, July.
    46. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    47. Clements, Michael P, 1995. "Rationality and the Role of Judgement in Macroeconomic Forecasting," Economic Journal, Royal Economic Society, vol. 105(429), pages 410-420, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.
    2. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    3. Oscar Claveria, 2020. "“Measuring and assessing economic uncertainty”," AQR Working Papers 2012003, University of Barcelona, Regional Quantitative Analysis Group, revised Jul 2020.
    4. Petar Soric & Oscar Claveria, 2021. ""Employment uncertainty a year after the irruption of the covid-19 pandemic"," IREA Working Papers 202112, University of Barcelona, Research Institute of Applied Economics, revised May 2021.
    5. Liu, Yang & Sheng, Xuguang Simon, 2019. "The measurement and transmission of macroeconomic uncertainty: Evidence from the U.S. and BRIC countries," International Journal of Forecasting, Elsevier, vol. 35(3), pages 967-979.
    6. Oscar Claveria, 2020. "Business and consumer uncertainty in the face of the pandemic: A sector analysis in European countries," Papers 2012.02091, arXiv.org.
    7. Lee, Hangyu & Kim, Tae Bong, 2023. "The effectiveness of labor market indicators for conducting monetary policy: Evidence from the Korean economy," Economic Modelling, Elsevier, vol. 118(C).
    8. Oscar Claveria & Petar Sorić, 2023. "Labour market uncertainty after the irruption of COVID-19," Empirical Economics, Springer, vol. 64(4), pages 1897-1945, April.
    9. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    10. Oscar Claveria, 2021. "Uncertainty indicators based on expectations of business and consumer surveys," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 48(2), pages 483-505, May.
    11. Oscar Claveria, 2021. "On the Aggregation of Survey-Based Economic Uncertainty Indicators Between Different Agents and Across Variables," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 17(1), pages 1-26, April.
    12. Todd E. Clark & Gergely Ganics & Elmar Mertens, 2022. "What is the Predictive Value of SPF Point and Density Forecasts?," Working Papers 22-37, Federal Reserve Bank of Cleveland.
    13. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    14. Oscar Claveria, 2021. "Forecasting with Business and Consumer Survey Data," Forecasting, MDPI, vol. 3(1), pages 1-22, February.
    15. Huang, Rong & Pilbeam, Keith & Pouliot, William, 2022. "Are macroeconomic forecasters optimists or pessimists? A reassessment of survey based forecasts," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 706-724.
    16. Gary Koop & Stuart McIntyre & James Mitchell, 2020. "UK regional nowcasting using a mixed frequency vector auto‐regressive model with entropic tilting," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 91-119, January.
    17. Oscar Claveria, 2021. "Disagreement on expectations: firms versus consumers," SN Business & Economics, Springer, vol. 1(12), pages 1-23, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael P. Clements & Ana Beatriz Galvão, 2014. "Measuring Macroeconomic Uncertainty: US Inflation and Output Growth," ICMA Centre Discussion Papers in Finance icma-dp2014-04, Henley Business School, University of Reading.
    2. Clements, Michael P., 2014. "Probability distributions or point predictions? Survey forecasts of US output growth and inflation," International Journal of Forecasting, Elsevier, vol. 30(1), pages 99-117.
    3. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    4. Clements, Michael P, 2012. "Subjective and Ex Post Forecast Uncertainty : US Inflation and Output Growth," The Warwick Economics Research Paper Series (TWERPS) 995, University of Warwick, Department of Economics.
    5. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    6. Clements, Michael P., 2019. "Do forecasters target first or later releases of national accounts data?," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1240-1249.
    7. Clements, Michael P., 2010. "Why are survey forecasts superior to model forecasts?," Economic Research Papers 270770, University of Warwick - Department of Economics.
    8. Clements, Michael P., 2012. "Do professional forecasters pay attention to data releases?," International Journal of Forecasting, Elsevier, vol. 28(2), pages 297-308.
    9. Knüppel, Malte, 2018. "Forecast-error-based estimation of forecast uncertainty when the horizon is increased," International Journal of Forecasting, Elsevier, vol. 34(1), pages 105-116.
    10. João Valle e Azevedo & João Tovar Jalles, 2011. "Rational vs. Professional Forecasts," Working Papers w201114, Banco de Portugal, Economics and Research Department.
    11. Michael P. Clements, 2014. "US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 1-14, January.
    12. Michael P. Clements, 2015. "Are Professional Macroeconomic Forecasters Able To Do Better Than Forecasting Trends?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(2-3), pages 349-382, March.
    13. Soojin Jo & Rodrigo Sekkel, 2019. "Macroeconomic Uncertainty Through the Lens of Professional Forecasters," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 436-446, July.
    14. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    15. Clements, Michael P., 2016. "Long-run restrictions and survey forecasts of output, consumption and investment," International Journal of Forecasting, Elsevier, vol. 32(3), pages 614-628.
    16. repec:hal:spmain:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    17. Paul Hubert, 2010. "Monetary Policy, Imperfect Information and the Expectations Channel," Sciences Po publications info:hdl:2441/f4rshpf3v1u, Sciences Po.
    18. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    19. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    20. Rossi, Barbara & Ganics, Gergely & Sekhposyan, Tatevik, 2020. "From Fixed-event to Fixed-horizon Density Forecasts: Obtaining Measures of Multi-horizon Uncertainty from Survey Density Foreca," CEPR Discussion Papers 14267, C.E.P.R. Discussion Papers.
    21. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:33:y:2017:i:3:p:591-604. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.