IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/667.html
   My bibliography  Save this paper

Modeling Time-Varying Uncertainty of Multiple-Horizon Forecast Errors

Author

Listed:
  • Todd E Clark
  • Michael W McCracken
  • Elmar Mertens

Abstract

We develop uncertainty measures for point forecasts from surveys such as the Survey of Professional Forecasters, Blue Chip, or the Federal Open Market Committee's Summary of Economic Projections. At a given point of time, these surveys provide forecasts for macroeconomic variables at multiple horizons. To track time-varying uncertainty in the associated forecast errors, we derive a multiple-horizon speci cation of stochastic volatility. Compared to constant-variance approaches, our stochastic-volatility model improves the accuracy of uncertainty measures for survey forecasts.

Suggested Citation

  • Todd E Clark & Michael W McCracken & Elmar Mertens, 2017. "Modeling Time-Varying Uncertainty of Multiple-Horizon Forecast Errors," BIS Working Papers 667, Bank for International Settlements.
    • Handle: RePEc:bis:biswps:667
    as

    Download full text from publisher

    File URL: https://www.bis.org/publ/work667.pdf
    File Function: Full PDF document
    Download Restriction: no
    File URL: https://www.bis.org/publ/work667.htm
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Knüppel, Malte, 2014. "Efficient estimation of forecast uncertainty based on recent forecast errors," International Journal of Forecasting, Elsevier, vol. 30(2), pages 257-267.
    2. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Oxford University Press, vol. 65(3), pages 361-393.
    3. Vasco Cúrdia & Marco Del Negro & Daniel L. Greenwald, 2014. "Rare Shocks, Great Recessions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1031-1052, November.
    4. Diebold, Francis X. & Schorfheide, Frank & Shin, Minchul, 2017. "Real-time forecast evaluation of DSGE models with stochastic volatility," Journal of Econometrics, Elsevier, vol. 201(2), pages 322-332.
    5. Joshua Abel & Robert Rich & Joseph Song & Joseph Tracy, 2016. "The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 533-550, April.
    6. Whitney K. Newey & Kenneth D. West, 1994. "Automatic Lag Selection in Covariance Matrix Estimation," Review of Economic Studies, Oxford University Press, vol. 61(4), pages 631-653.
    7. Chiu, Ching-Wai (Jeremy) & Mumtaz, Haroon & Pintér, Gábor, 2017. "Forecasting with VAR models: Fat tails and stochastic volatility," International Journal of Forecasting, Elsevier, vol. 33(4), pages 1124-1143.
    8. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    9. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    10. Todd E. Clark, 2011. "Real-Time Density Forecasts From Bayesian Vector Autoregressions With Stochastic Volatility," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 327-341, July.
    11. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    12. repec:taf:jnlbes:v:30:y:2012:i:1:p:1-17 is not listed on IDEAS
    13. Soojin Jo & Rodrigo Sekkel, 2019. "Macroeconomic Uncertainty Through the Lens of Professional Forecasters," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 436-446, July.
    14. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    15. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    16. Todd E. Clark & Francesco Ravazzolo, 2015. "Macroeconomic Forecasting Performance under Alternative Specifications of Time‐Varying Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 551-575, June.
    17. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    18. Rossi, Barbara & Sekhposyan, Tatevik, 2014. "Evaluating predictive densities of US output growth and inflation in a large macroeconomic data set," International Journal of Forecasting, Elsevier, vol. 30(3), pages 662-682.
    19. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    20. Malte Knüppel & Guido Schultefrankenfeld, 2012. "How Informative Are Central Bank Assessments of Macroeconomic Risks?," International Journal of Central Banking, International Journal of Central Banking, vol. 8(3), pages 87-139, September.
    21. Michael P. Clements, 2014. "Forecast Uncertainty- Ex Ante and Ex Post : U.S. Inflation and Output Growth," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(2), pages 206-216, April.
    22. Croushore Dean, 2010. "An Evaluation of Inflation Forecasts from Surveys Using Real-Time Data," The B.E. Journal of Macroeconomics, De Gruyter, vol. 10(1), pages 1-32, May.
    23. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    24. Jacquier, Eric & Polson, Nicholas G. & Rossi, P.E.Peter E., 2004. "Bayesian analysis of stochastic volatility models with fat-tails and correlated errors," Journal of Econometrics, Elsevier, vol. 122(1), pages 185-212, September.
    25. Geoff Kenny & Thomas Kostka & Federico Masera, 2014. "How Informative are the Subjective Density Forecasts of Macroeconomists?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(3), pages 163-185, April.
    26. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," Review of Economic Studies, Oxford University Press, vol. 72(3), pages 821-852.
    27. Kenneth F. Wallis, 2005. "Combining Density and Interval Forecasts: A Modest Proposal," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 983-994, December.
    28. Marco Del Negro & Giorgio E. Primiceri, 2015. "Time Varying Structural Vector Autoregressions and Monetary Policy: A Corrigendum," Review of Economic Studies, Oxford University Press, vol. 82(4), pages 1342-1345.
    29. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    30. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    31. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    32. James H. Stock & Mark W. Watson, 2007. "Erratum to “Why Has U.S. Inflation Become Harder to Forecast?”," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    33. Omori, Yasuhiro & Chib, Siddhartha & Shephard, Neil & Nakajima, Jouchi, 2007. "Stochastic volatility with leverage: Fast and efficient likelihood inference," Journal of Econometrics, Elsevier, vol. 140(2), pages 425-449, October.
    34. Giordani, Paolo & Villani, Mattias, 2010. "Forecasting macroeconomic time series with locally adaptive signal extraction," International Journal of Forecasting, Elsevier, vol. 26(2), pages 312-325, April.
    35. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    36. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Galvao, Ana Beatriz & Mitchell, James, 2020. "Real-Time Perceptions of Historical GDP Data Uncertainty," EMF Research Papers 35, Economic Modelling and Forecasting Group.
    2. Kajal Lahiri & Huaming Peng & Xuguang Sheng, 2015. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," CESifo Working Paper Series 5468, CESifo.
    3. Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona Graduate School of Economics.
    4. Galvão, Ana Beatriz & Garratt, Anthony & Mitchell, James, 2021. "Does judgment improve macroeconomic density forecasts?," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1247-1260.
    5. Adams, Patrick A. & Adrian, Tobias & Boyarchenko, Nina & Giannone, Domenico, 2021. "Forecasting macroeconomic risks," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1173-1191.
    6. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    7. Bas Scheer, 2022. "Addressing Unemployment Rate Forecast Errors in Relation to the Business Cycle," CPB Discussion Paper 434, CPB Netherlands Bureau for Economic Policy Analysis.
    8. Li, Zheng & Zhou, Bo & Hensher, David A., 2022. "Forecasting automobile gasoline demand in Australia using machine learning-based regression," Energy, Elsevier, vol. 239(PD).
    9. Weiqi Zhang & Huong Ha & Hui Ting Evelyn Gay, 2020. "Analysts’ forecasts between last consensus and earning announcement date," Journal of Financial Reporting and Accounting, Emerald Group Publishing, vol. 18(4), pages 779-793, November.
    10. Carriero, Andrea & Clark, Todd & Marcellino, Massimiliano & Mertens, Elmar, 2021. "Addressing COVID-19 Outliers in BVARs with Stochastic Volatility," CEPR Discussion Papers 15964, C.E.P.R. Discussion Papers.
    11. Kiss, Tamás & Mazur, Stepan & Nguyen, Hoang & Österholm, Pär, 2021. "Modelling the Relation between the US Real Economy and the Corporate Bond-Yield Spread in Bayesian VARs with non-Gaussian Disturbances," Working Papers 2021:9, Örebro University, School of Business.
    12. Reifschneider, David & Tulip, Peter, 2019. "Gauging the uncertainty of the economic outlook using historical forecasting errors: The Federal Reserve’s approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1564-1582.
    13. Mirela Miescu, 2019. "Uncertainty shocks in emerging economies," Working Papers 277077821, Lancaster University Management School, Economics Department.
    14. Knüppel, Malte, 2018. "Forecast-error-based estimation of forecast uncertainty when the horizon is increased," International Journal of Forecasting, Elsevier, vol. 34(1), pages 105-116.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Todd E. Clark & Francesco Ravazzolo, 2012. "The macroeconomic forecasting performance of autoregressive models with alternative specifications of time-varying volatility," Working Paper 2012/09, Norges Bank.
    2. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    3. Fabian Krüger & Todd E. Clark & Francesco Ravazzolo, 2017. "Using Entropic Tilting to Combine BVAR Forecasts With External Nowcasts," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 470-485, July.
    4. Markus Heinrich & Magnus Reif, 2018. "Forecasting using mixed-frequency VARs with time-varying parameters," ifo Working Paper Series 273, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    5. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    6. Tallman, Ellis W. & Zaman, Saeed, 2020. "Combining survey long-run forecasts and nowcasts with BVAR forecasts using relative entropy," International Journal of Forecasting, Elsevier, vol. 36(2), pages 373-398.
    7. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    8. Knut Are Aastveit & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2017. "Have Standard VARS Remained Stable Since the Crisis?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(5), pages 931-951, August.
    9. Gao, Shen & Hou, Chenghan & Nguyen, Bao H., 2021. "Forecasting natural gas prices using highly flexible time-varying parameter models," Economic Modelling, Elsevier, vol. 105(C).
    10. Markus Heinrich & Magnus Reif, 2020. "Real-Time Forecasting Using Mixed-Frequency VARS with Time-Varying Parameters," CESifo Working Paper Series 8054, CESifo.
    11. Joshua C.C. Chan & Rodney W. Strachan, 2020. "Bayesian state space models in macroeconometrics," CAMA Working Papers 2020-90, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    12. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    13. Karlsson, Sune & Mazur, Stepan & Nguyen, Hoang, 2021. "Vector autoregression models with skewness and heavy tails," Working Papers 2021:8, Örebro University, School of Business.
    14. Andrea Carriero & Francesco Corsello & Massimiliano Marcellino, 2018. "The global component of inflation volatility," Temi di discussione (Economic working papers) 1170, Bank of Italy, Economic Research and International Relations Area.
    15. Reif Magnus, 2021. "Macroeconomic uncertainty and forecasting macroeconomic aggregates," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 25(2), pages 1-20, April.
    16. Kiss, Tamás & Mazur, Stepan & Nguyen, Hoang & Österholm, Pär, 2021. "Modelling the Relation between the US Real Economy and the Corporate Bond-Yield Spread in Bayesian VARs with non-Gaussian Disturbances," Working Papers 2021:9, Örebro University, School of Business.
    17. Delle Monache, Davide & Petrella, Ivan, 2017. "Adaptive models and heavy tails with an application to inflation forecasting," International Journal of Forecasting, Elsevier, vol. 33(2), pages 482-501.
    18. Benjamin K. Johannsen & Elmar Mertens, 2021. "A Time‐Series Model of Interest Rates with the Effective Lower Bound," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 53(5), pages 1005-1046, August.
    19. Joshua C. C. Chan, 2017. "The Stochastic Volatility in Mean Model With Time-Varying Parameters: An Application to Inflation Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 17-28, January.
    20. Dimitrios P. Louzis, 2019. "Steady‐state modeling and macroeconomic forecasting quality," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(2), pages 285-314, March.

    More about this item

    Keywords

    stochastic volatility; survey forecasts; fan charts;
    All these keywords.

    JEL classification:

    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:667. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christian Beslmeisl (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.