IDEAS home Printed from https://ideas.repec.org/a/eee/ecanpo/v73y2022icp321-330.html
   My bibliography  Save this article

Evaluating the European Central Bank’s uncertainty forecasts

Author

Listed:
  • Tsuchiya, Yoichi

Abstract

While several studies have examined the point forecasts by central banks, few have focused on interval forecasts. This study examines the interval forecasts for inflation and growth made by the European Central Bank (ECB). The ECB states that each of its interval forecasts will cover the corresponding realization with a probability of 57.5%. I show that their actual coverage is always larger, and that the differences from the nominal coverage of 57.5% often turn out to be significant. Yet, tests concerning the dynamics of the actual coverage do not reject the null hypothesis of independence, such that correct conditional coverage cannot be rejected in most cases. Moreover, I find that, in general, the actual coverage of the interval forecasts cannot be predicted by the state of economic uncertainty, but the actual coverage of the 7-month-ahead interval forecast for growth declines if financial market uncertainty increases.

Suggested Citation

  • Tsuchiya, Yoichi, 2022. "Evaluating the European Central Bank’s uncertainty forecasts," Economic Analysis and Policy, Elsevier, vol. 73(C), pages 321-330.
    • Handle: RePEc:eee:ecanpo:v:73:y:2022:i:c:p:321-330
    DOI: 10.1016/j.eap.2021.12.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0313592621001752
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.eap.2021.12.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    2. Alan S. Blinder & Michael Ehrmann & Marcel Fratzscher & Jakob De Haan & David-Jan Jansen, 2008. "Central Bank Communication and Monetary Policy: A Survey of Theory and Evidence," Journal of Economic Literature, American Economic Association, vol. 46(4), pages 910-945, December.
    3. Chatfield, Chris, 1993. "Calculating Interval Forecasts: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 143-144, April.
    4. Yoichi Tsuchiya, 2021. "The predictive power of ECB’s interval forecasts over point forecasts," Applied Economics Letters, Taylor & Francis Journals, vol. 28(16), pages 1413-1418, September.
    5. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-135, April.
    6. Scott H. Irwin & Darrel L. Good, 2004. "Evaluation of USDA Interval Forecasts of Corn and Soybean Prices," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 86(4), pages 990-1004.
    7. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    8. Groen, Jan J.J. & Kapetanios, George & Price, Simon, 2009. "A real time evaluation of Bank of England forecasts of inflation and growth," International Journal of Forecasting, Elsevier, vol. 25(1), pages 74-80.
    9. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    10. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    11. James Mitchell & Stephen G. Hall, 2005. "Evaluating, Comparing and Combining Density Forecasts Using the KLIC with an Application to the Bank of England and NIESR ‘Fan’ Charts of Inflation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 995-1033, December.
    12. Alan S. Blinder & Michael Ehrmann & Marcel Fratzscher & Jakob De Haan & David-Jan Jansen, 2008. "Central Bank Communication and Monetary Policy: A Survey of Theory and Evidence," Journal of Economic Literature, American Economic Association, vol. 46(4), pages 910-945, December.
    13. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    14. Malte Knüppel & Guido Schultefrankenfeld, 2012. "How Informative Are Central Bank Assessments of Macroeconomic Risks?," International Journal of Central Banking, International Journal of Central Banking, vol. 8(3), pages 87-139, September.
    15. repec:pri:cepsud:161blinder is not listed on IDEAS
    16. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    17. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    18. Gianna Boero & Jeremy Smith & KennethF. Wallis, 2008. "Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters," Economic Journal, Royal Economic Society, vol. 118(530), pages 1107-1127, July.
    19. Michael P. Clements, 2004. "Evaluating the Bank of England Density Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 114(498), pages 844-866, October.
    20. Gianna Boero & Jeremy Smith & Kenneth F. Wallis, 2008. "Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters," Economic Journal, Royal Economic Society, vol. 118(530), pages 1107-1127, July.
    21. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    22. Michael P. Clements, 2014. "Forecast Uncertainty- Ex Ante and Ex Post : U.S. Inflation and Output Growth," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(2), pages 206-216, April.
    23. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    24. Kenneth F. Wallis, 2004. "An Assessment of Bank of England and National Institute Inflation Forecast Uncertainties," National Institute Economic Review, National Institute of Economic and Social Research, vol. 189(1), pages 64-71, July.
    25. Wallis, Kenneth F., 2004. "An Assessment of Bank of England and National Institute Inflation Forecast Uncertainties," National Institute Economic Review, National Institute of Economic and Social Research, vol. 189, pages 64-71, July.
    26. Olga Isengildina‐Massa & Julia L. Sharp, 2012. "Evaluation of USDA Interval Forecasts Revisited: Asymmetry and Accuracy of Corn, Soybean, and Wheat Prices," Agribusiness, John Wiley & Sons, Ltd., vol. 28(3), pages 310-323, June.
    27. Reifschneider, David & Tulip, Peter, 2019. "Gauging the uncertainty of the economic outlook using historical forecasting errors: The Federal Reserve’s approach," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1564-1582.
    28. Dowd, Kevin, 2007. "Too good to be true? The (In)credibility of the UK inflation fan charts," Journal of Macroeconomics, Elsevier, vol. 29(1), pages 91-102, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Knüppel, Malte & Schultefrankenfeld, Guido, 2019. "Assessing the uncertainty in central banks’ inflation outlooks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1748-1769.
    2. Galvao, Ana Beatriz & Mitchell, James, 2019. "Measuring Data Uncertainty : An Application using the Bank of England’s “Fan Charts” for Historical GDP Growth," EMF Research Papers 24, Economic Modelling and Forecasting Group.
    3. Victor Lopez-Perez, 2016. "Macroeconomic Forecast Uncertainty In The Euro Area," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 11(1), pages 9-41, March.
    4. Ana Beatriz Galvão & James Mitchell, 2023. "Real‐Time Perceptions of Historical GDP Data Uncertainty," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(3), pages 457-481, June.
    5. Yoichi Tsuchiya, 2021. "The value added of the Bank of Japan's range forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(5), pages 817-833, August.
    6. Herman O. Stekler, 2008. "What Do We Know About G-7 Macro Forecasts?," Working Papers 2008-009, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    7. repec:zbw:bofrdp:037 is not listed on IDEAS
    8. repec:zbw:bofrdp:2022_005 is not listed on IDEAS
    9. Ambrocio, Gene, 2020. "Inflationary household uncertainty shocks," Bank of Finland Research Discussion Papers 5/2020, Bank of Finland.
    10. Ambrocio, Gene, 2017. "The real effects of overconfidence and fundamental uncertainty shocks," Research Discussion Papers 37/2017, Bank of Finland.
    11. Galvão, Ana Beatriz & Garratt, Anthony & Mitchell, James, 2021. "Does judgment improve macroeconomic density forecasts?," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1247-1260.
    12. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    13. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.
    14. Marc-Oliver Pohle, 2020. "The Murphy Decomposition and the Calibration-Resolution Principle: A New Perspective on Forecast Evaluation," Papers 2005.01835, arXiv.org.
    15. repec:zbw:bofrdp:2017_037 is not listed on IDEAS
    16. Liu, Yang & Sheng, Xuguang Simon, 2019. "The measurement and transmission of macroeconomic uncertainty: Evidence from the U.S. and BRIC countries," International Journal of Forecasting, Elsevier, vol. 35(3), pages 967-979.
    17. Tatjana Dahlhaus & Tatevik Sekhposyan, 2018. "Monetary Policy Uncertainty: A Tale of Two Tails," Staff Working Papers 18-50, Bank of Canada.
    18. Carola Conces Binder & Rodrigo Sekkel, 2023. "Central Bank Forecasting: A Survey," Staff Working Papers 23-18, Bank of Canada.
    19. Ambrocio, Gene, 2020. "Inflationary household uncertainty shocks," Research Discussion Papers 5/2020, Bank of Finland.
    20. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    21. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    22. Beckmann, Joscha & Czudaj, Robert L., 2023. "Perceived monetary policy uncertainty," Journal of International Money and Finance, Elsevier, vol. 130(C).
    23. Binder, Carola C., 2017. "Measuring uncertainty based on rounding: New method and application to inflation expectations," Journal of Monetary Economics, Elsevier, vol. 90(C), pages 1-12.

    More about this item

    Keywords

    Inflation; Monetary policy; Interval forecasts; Forecast evaluation; Uncertainty index;
    All these keywords.

    JEL classification:

    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecanpo:v:73:y:2022:i:c:p:321-330. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/economic-analysis-and-policy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.