IDEAS home Printed from https://ideas.repec.org/p/fip/fedcwq/92109.html
   My bibliography  Save this paper

Censored Density Forecasts: Production and Evaluation

Author

Listed:
  • James Mitchell
  • Martin Weale

Abstract

This paper develops methods for the production and evaluation of censored density forecasts. The focus is on censored density forecasts that quantify forecast risks in a middle region of the density covering a specified probability, and ignore the magnitude but not the frequency of outlying observations. We propose a fixed-point algorithm that fits a potentially skewed and fat-tailed density to the inner observations, acknowledging that the outlying observations may be drawn from a different but unknown distribution. We also introduce a new test for calibration of censored density forecasts. An application using historical forecast errors from the Federal Reserve Board and the Monetary Policy Committee (MPC) at the Bank of England suggests that the use of censored density functions to represent the pattern of forecast errors results in much greater parameter stability than do uncensored densities. We illustrate the utility of censored density forecasts when quantifying forecast risks after shocks such as the global financial crisis and the COVID-19 pandemic and find that these outperform the official forecasts produced by the MPC.

Suggested Citation

  • James Mitchell & Martin Weale, 2021. "Censored Density Forecasts: Production and Evaluation," Working Papers 21-12R, Federal Reserve Bank of Cleveland, revised 16 Aug 2022.
  • Handle: RePEc:fip:fedcwq:92109
    DOI: 10.26509/frbc-wp-202112r
    as

    Download full text from publisher

    File URL: https://doi.org/10.26509/frbc-wp-202112r
    File Function: Full Text
    Download Restriction: no

    File URL: https://libkey.io/10.26509/frbc-wp-202112r?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Malte Knüppel, 2015. "Evaluating the Calibration of Multi-Step-Ahead Density Forecasts Using Raw Moments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 270-281, April.
    2. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    3. Michele Lenza & Giorgio E. Primiceri, 2022. "How to estimate a vector autoregression after March 2020," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 688-699, June.
    4. James H. Stock & Mark W. Watson, 2016. "Core Inflation and Trend Inflation," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 770-784, October.
    5. Ross Askanazi & Francis X. Diebold & Frank Schorfheide & Minchul Shin, 2018. "On the Comparison of Interval Forecasts," Journal of Time Series Analysis, Wiley Blackwell, vol. 39(6), pages 953-965, November.
    6. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    7. Lucia Alessi & Eric Ghysels & Luca Onorante & Richard Peach & Simon Potter, 2014. "Central Bank Macroeconomic Forecasting During the Global Financial Crisis: The European Central Bank and Federal Reserve Bank of New York Experiences," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(4), pages 483-500, October.
    8. Zhu, Dongming & Galbraith, John W., 2010. "A generalized asymmetric Student-t distribution with application to financial econometrics," Journal of Econometrics, Elsevier, vol. 157(2), pages 297-305, August.
    9. Julian Kozlowski & Laura Veldkamp & Venky Venkateswaran, 2020. "The Tail That Wags the Economy: Beliefs and Persistent Stagnation," Journal of Political Economy, University of Chicago Press, vol. 128(8), pages 2839-2879.
    10. Tobias Adrian & Nina Boyarchenko & Domenico Giannone, 2019. "Vulnerable Growth," American Economic Review, American Economic Association, vol. 109(4), pages 1263-1289, April.
    11. Claudia Czado & Tilmann Gneiting & Leonhard Held, 2009. "Predictive Model Assessment for Count Data," Biometrics, The International Biometric Society, vol. 65(4), pages 1254-1261, December.
    12. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    13. Òscar Jordà & Moritz Schularick & Alan M. Taylor, 2020. "Disasters Everywhere: The Costs of Business Cycles Reconsidered," Staff Reports 925, Federal Reserve Bank of New York.
    14. Kenneth F. Wallis, 1999. "Asymmetric density forecasts of inflation and the Bank of England's fan chart," National Institute Economic Review, National Institute of Economic and Social Research, vol. 167(1), pages 106-112, January.
    15. repec:hal:journl:peer-00834423 is not listed on IDEAS
    16. Wallis, Kenneth F., 1999. "Asymmetric density forecasts of inflation and the Bank of England's fan chart," National Institute Economic Review, National Institute of Economic and Social Research, vol. 167, pages 106-112, January.
    17. Primiceri, Giorgio & Lenza, Michele, 2020. "How to Estimate a VAR after March 2020," CEPR Discussion Papers 15245, C.E.P.R. Discussion Papers.
    18. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    19. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    20. Veldkamp, Laura & Orlik, Anna, 2014. "Understanding Uncertainty Shocks and the Role of Black Swans," CEPR Discussion Papers 10147, C.E.P.R. Discussion Papers.
    21. Adelchi Azzalini & Antonella Capitanio, 2003. "Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t‐distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 367-389, May.
    22. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.
    23. Taylor, James W., 2021. "Evaluating quantile-bounded and expectile-bounded interval forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 800-811.
    24. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    25. Reifschneider, David & Tulip, Peter, 2019. "Gauging the uncertainty of the economic outlook using historical forecasting errors: The Federal Reserve’s approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1564-1582.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rossi, Barbara & Ganics, Gergely & Sekhposyan, Tatevik, 2020. "From Fixed-event to Fixed-horizon Density Forecasts: Obtaining Measures of Multi-horizon Uncertainty from Survey Density Foreca," CEPR Discussion Papers 14267, C.E.P.R. Discussion Papers.
    2. Gergely Ganics & Barbara Rossi & Tatevik Sekhposyan, 2019. "From fixed-event to fixed-horizon density forecasts: Obtaining measures of multi-horizon uncertainty from survey density forecasts," Economics Working Papers 1689, Department of Economics and Business, Universitat Pompeu Fabra.
    3. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    4. Jonas Dovern & Hans Manner, 2020. "Order‐invariant tests for proper calibration of multivariate density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(4), pages 440-456, June.
    5. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    6. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    7. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    8. David Kohns & Tibor Szendrei, 2021. "Decoupling Shrinkage and Selection for the Bayesian Quantile Regression," Papers 2107.08498, arXiv.org.
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Matei Demetrescu & Robinson Kruse-Becher, 2021. "Is U.S. real output growth really non-normal? Testing distributional assumptions in time-varying location-scale models," CREATES Research Papers 2021-07, Department of Economics and Business Economics, Aarhus University.
    11. Kohns, David & Potjagailo, Galina, 2023. "Flexible Bayesian MIDAS: time‑variation, group‑shrinkage and sparsity," Bank of England working papers 1025, Bank of England.
    12. James Mitchell & Aubrey Poon & Dan Zhu, 2022. "Constructing Density Forecasts from Quantile Regressions: Multimodality in Macro-Financial Dynamics," Working Papers 22-12R, Federal Reserve Bank of Cleveland, revised 11 Apr 2023.
    13. Knotek, Edward S. & Zaman, Saeed, 2023. "Real-time density nowcasts of US inflation: A model combination approach," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1736-1760.
    14. Adams, Patrick A. & Adrian, Tobias & Boyarchenko, Nina & Giannone, Domenico, 2021. "Forecasting macroeconomic risks," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1173-1191.
    15. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    16. Bjørnland, Hilde C. & Ravazzolo, Francesco & Thorsrud, Leif Anders, 2017. "Forecasting GDP with global components: This time is different," International Journal of Forecasting, Elsevier, vol. 33(1), pages 153-173.
    17. Gregor Bäurle & Elizabeth Steiner & Gabriel Züllig, 2021. "Forecasting the production side of GDP," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 458-480, April.
    18. Rossi, Barbara & Sekhposyan, Tatevik, 2014. "Evaluating predictive densities of US output growth and inflation in a large macroeconomic data set," International Journal of Forecasting, Elsevier, vol. 30(3), pages 662-682.
    19. Malte Knüppel & Fabian Krüger, 2022. "Forecast uncertainty, disagreement, and the linear pool," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 23-41, January.
    20. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.

    More about this item

    Keywords

    Forecast uncertainty; Outliers; Fan charts; Skewed densities; Best critical region; Density forecasting; Censoring; Forecast evaluation;
    All these keywords.

    JEL classification:

    • C24 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Truncated and Censored Models; Switching Regression Models; Threshold Regression Models
    • C46 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Specific Distributions
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedcwq:92109. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: 4D Library (email available below). General contact details of provider: https://edirc.repec.org/data/frbclus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.