IDEAS home Printed from https://ideas.repec.org/p/chb/bcchwp/881.html
   My bibliography  Save this paper

Back testing fan charts of activity and inflation: the Chilean case

Author

Listed:
  • Jorge Fornero
  • Andrés Gatty

Abstract

Any forecast has associated a measure of predictive uncertainty. The Central Bank of Chile (CBoC) communicates with fan charts the projections’ uncertainty of inflation and GDP growth in the Monetary Policy Report (MPR). This work aims at evaluating ex post their properties with empirical techniques. In general, we find that fan charts have been a relatively accurate in illustrating the true density generated by the conditional mean within forecasting horizons of up to one year. While inflation forecasts are unbiased, forecasts of GDP growth have been optimistic on average. The analysis of a recent sub-sample in which risks for GDP growth was made explicit, we graphically examine whether asymmetric fan charts are more accurate ex –post than symmetric fan charts. For these cases, the median projection seem to have provided a better guide than the mode.

Suggested Citation

  • Jorge Fornero & Andrés Gatty, 2020. "Back testing fan charts of activity and inflation: the Chilean case," Working Papers Central Bank of Chile 881, Central Bank of Chile.
  • Handle: RePEc:chb:bcchwp:881
    as

    Download full text from publisher

    File URL: https://si2.bcentral.cl/public/pdf/documentos-trabajo/pdf/dtbc881.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    2. Jeffrey Frankel, 2011. "Over-optimism in forecasts by official budget agencies and its implications," Oxford Review of Economic Policy, Oxford University Press, vol. 27(4), pages 536-562.
    3. Athanasios Orphanides, 2001. "Monetary Policy Rules Based on Real-Time Data," American Economic Review, American Economic Association, vol. 91(4), pages 964-985, September.
    4. Michael P. Clements, 2004. "Evaluating the Bank of England Density Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 114(498), pages 844-866, October.
    5. Francisco Arroyo Marioli & Francisco Bullano & Jorge Fornero & Roberto Zúñiga, 2020. "Semi-Structural Forecasting Model," Working Papers Central Bank of Chile 866, Central Bank of Chile.
    6. Juan Pablo Medina & Claudio Soto, 2007. "The Chilean Business Cycles Through the Lens of a Stochastic General Equilibrium Model," Working Papers Central Bank of Chile 457, Central Bank of Chile.
    7. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    8. Kenneth F. Wallis, 2004. "An Assessment of Bank of England and National Institute Inflation Forecast Uncertainties," National Institute Economic Review, National Institute of Economic and Social Research, vol. 189(1), pages 64-71, July.
    9. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    10. Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
    11. Pablo Pincheira, 2010. "A Real Time Evaluation of the Central Bank of Chile GDP Growth Forecasts," Money Affairs, Centro de Estudios Monetarios Latinoamericanos, CEMLA, vol. 0(1), pages 37-73, January-J.
    12. David Turner & Thomas Chalaux & Hermes Morgavi, 2018. "Fan charts around GDP projections based on probit models of downturn risk," OECD Economics Department Working Papers 1521, OECD Publishing.
    13. Yi‐Ting Chen, 2011. "Moment tests for density forecast evaluation in the presence of parameter estimation uncertainty," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 30(4), pages 409-450, July.
    14. Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
    15. Dowd, Kevin, 2007. "Too good to be true? The (In)credibility of the UK inflation fan charts," Journal of Macroeconomics, Elsevier, vol. 29(1), pages 91-102, March.
    16. James Mitchell & Kenneth F. Wallis, 2011. "Evaluating density forecasts: forecast combinations, model mixtures, calibration and sharpness," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 1023-1040, September.
    17. Elías Albagli I. & Jorge A. Fornero & Miguel A. Fuentes D. & Roberto Zúñiga V., 2019. "On the effects of confidence and uncertainty on aggregate demand: evidence from Chile," Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 22(3), pages 008-033, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Malte Knüppel, 2015. "Evaluating the Calibration of Multi-Step-Ahead Density Forecasts Using Raw Moments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 270-281, April.
    2. McDonald, Christopher & Thamotheram, Craig & Vahey, Shaun P. & Wakerly, Elizabeth C., 2015. "Assessing the Economic Value of Probabilistic Forecasts in the Presence of an Inflation Target," EMF Research Papers 09, Economic Modelling and Forecasting Group.
    3. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.
    4. Rodríguez, Gabriel, 2017. "Modeling Latin-American stock and Forex markets volatility: Empirical application of a model with random level shifts and genuine long memory," The North American Journal of Economics and Finance, Elsevier, vol. 42(C), pages 393-420.
    5. Marc-Oliver Pohle, 2020. "The Murphy Decomposition and the Calibration-Resolution Principle: A New Perspective on Forecast Evaluation," Papers 2005.01835, arXiv.org.
    6. Jackson, Emerson Abraham & Tamuke, Edmund, 2018. "Probability Forecast Using Fan Chart Analysis: A case of the Sierra Leone Economy," MPRA Paper 88853, University Library of Munich, Germany, revised 04 Sep 2018.
    7. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    8. Wojciech Charemza & Carlos Diaz Vela & Svetlana Makarova, 2013. "Inflation fan charts, monetary policy and skew normal distribution," Discussion Papers in Economics 13/06, Division of Economics, School of Business, University of Leicester.
    9. Wojciech CHAREMZA & Carlos DÍAZ & Svetlana MAKAROVA, 2019. "Conditional Term Structure of Inflation Forecast Uncertainty: The Copula Approach," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(1), pages 5-18, March.
    10. Goodhart Charles A.E., 2005. "The Monetary Policy Committee's Reaction Function: An Exercise in Estimation," The B.E. Journal of Macroeconomics, De Gruyter, vol. 5(1), pages 1-42, August.
    11. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    12. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    13. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2019. "Density Forecasting," BEMPS - Bozen Economics & Management Paper Series BEMPS59, Faculty of Economics and Management at the Free University of Bozen.
    14. Tsyplakov, Alexander, 2014. "Theoretical guidelines for a partially informed forecast examiner," MPRA Paper 55017, University Library of Munich, Germany.
    15. Gian Luigi Mazzi & James Mitchell & Gaetana Montana, 2014. "Density Nowcasts and Model Combination: Nowcasting Euro-Area GDP Growth over the 2008–09 Recession," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(2), pages 233-256, April.
    16. Knüppel, Malte & Schultefrankenfeld, Guido, 2008. "How informative are macroeconomic risk forecasts? An examination of the Bank of England's inflation forecasts," Discussion Paper Series 1: Economic Studies 2008,14, Deutsche Bundesbank.
    17. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    18. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    19. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    20. González-Rivera, Gloria & Yoldas, Emre, 2012. "Autocontour-based evaluation of multivariate predictive densities," International Journal of Forecasting, Elsevier, vol. 28(2), pages 328-342.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:chb:bcchwp:881. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/bccgvcl.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Claudio Sepulveda (email available below). General contact details of provider: https://edirc.repec.org/data/bccgvcl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.