IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v36y2020i4p1488-1500.html
   My bibliography  Save this article

Forecasting and forecast narratives: The Bank of England Inflation Reports

Author

Listed:
  • Clements, Michael P.
  • Reade, J. James

Abstract

We analyze the narratives that accompany the numerical forecasts in the Bank of England’s Quarterly Inflation Reports, 1997–2018. We focus on whether the narratives contain useful information about the future course of key macro variables over and above the point predictions, in terms of whether the narratives can be used to enhance the accuracy of the numerical forecasts. We also consider whether the narratives are able to predict future changes in the numerical forecasts. We find that a measure of sentiment derived from the narratives can predict the errors in the numerical forecasts of output growth, but not of inflation. We find no evidence that past changes in sentiment predict subsequent changes in the point forecasts of output growth or of inflation, but do find that the adjustments to the numerical output growth forecasts have a systematic element.

Suggested Citation

  • Clements, Michael P. & Reade, J. James, 2020. "Forecasting and forecast narratives: The Bank of England Inflation Reports," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1488-1500.
  • Handle: RePEc:eee:intfor:v:36:y:2020:i:4:p:1488-1500
    DOI: 10.1016/j.ijforecast.2019.08.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207019302377
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2019.08.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Clements, Michael P. & Hendry, David F., 2006. "Forecasting with Breaks," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 12, pages 605-657, Elsevier.
    2. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    3. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    4. Blix, Mårten, 1999. "Forecasting Swedish Inflation With a Markov Switching VAR," Working Paper Series 76, Sveriges Riksbank (Central Bank of Sweden).
    5. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    6. Pesaran, M. Hashem & Weale, Martin, 2006. "Survey Expectations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 14, pages 715-776, Elsevier.
    7. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    8. Jennifer Castle & David Hendry & Nicholas W.P. Fawcett, 2011. "Forecasting breaks and forecasting during breaks," Economics Series Working Papers 535, University of Oxford, Department of Economics.
    9. Andrew Patton & Allan Timmermann, 2012. "Forecast Rationality Tests Based on Multi-Horizon Bounds," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 1-17.
    10. Michael P. Clements & David F. Hendry, 2005. "Evaluating a Model by Forecast Performance," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 931-956, December.
    11. Carlo Rosa & Giovanni Verga, 2008. "The Impact of Central Bank Announcements on Asset Prices in Real Time," International Journal of Central Banking, International Journal of Central Banking, vol. 4(2), pages 175-217, June.
    12. Michael P. Clements, 2004. "Evaluating the Bank of England Density Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 114(498), pages 844-866, October.
    13. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    14. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    15. Hansen, Stephen & McMahon, Michael, 2016. "Shocking language: Understanding the macroeconomic effects of central bank communication," Journal of International Economics, Elsevier, vol. 99(S1), pages 114-133.
    16. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    17. Jones, Jacob T. & Sinclair, Tara M. & Stekler, Herman O., 2020. "A textual analysis of Bank of England growth forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1478-1487.
    18. Jennifer L. Castle & David F. Hendry & Andrew B. Martinez, 2017. "Evaluating Forecasts, Narratives and Policy Using a Test of Invariance," Econometrics, MDPI, vol. 5(3), pages 1-27, September.
    19. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1, July.
    20. Clements, Michael P. & Hendry, David F. (ed.), 2011. "The Oxford Handbook of Economic Forecasting," OUP Catalogue, Oxford University Press, number 9780195398649.
    21. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    22. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    23. Clements, Michael P & Galvão, Ana Beatriz, 2008. "Macroeconomic Forecasting With Mixed-Frequency Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 546-554.
    24. Eric Ghysels & Arthur Sinko & Rossen Valkanov, 2007. "MIDAS Regressions: Further Results and New Directions," Econometric Reviews, Taylor & Francis Journals, vol. 26(1), pages 53-90.
    25. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    26. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    27. Fair, Ray C & Shiller, Robert J, 1990. "Comparing Information in Forecasts from Econometric Models," American Economic Review, American Economic Association, vol. 80(3), pages 375-389, June.
    28. Fawcett, Nicholas & Koerber, Lena & Masolo, Riccardo & Waldron, Matthew, 2015. "Evaluating UK point and density forecasts from an estimated DSGE model: the role of off-model information over the financial crisis," Bank of England working papers 538, Bank of England.
    29. Carlos Capistrán & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2‐3), pages 365-396, March.
    30. David O. Lucca & Francesco Trebbi, 2009. "Measuring Central Bank Communication: An Automated Approach with Application to FOMC Statements," NBER Working Papers 15367, National Bureau of Economic Research, Inc.
    31. Stekler, Herman & Symington, Hilary, 2016. "Evaluating qualitative forecasts: The FOMC minutes, 2006–2010," International Journal of Forecasting, Elsevier, vol. 32(2), pages 559-570.
    32. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    33. Michael P. Clements, 2015. "Are Professional Macroeconomic Forecasters Able To Do Better Than Forecasting Trends?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(2-3), pages 349-382, March.
    34. Nelson, Charles R, 1972. "The Prediction Performance of the FRB-MIT-PENN Model of the U.S. Economy," American Economic Review, American Economic Association, vol. 62(5), pages 902-917, December.
    35. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Müller, Karsten, 2020. "German forecasters' narratives: How informative are German business cycle forecast reports?," Working Papers 23, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    2. Simionescu, Mihaela, 2022. "Econometrics of sentiments- sentometrics and machine learning: The improvement of inflation predictions in Romania using sentiment analysis," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    3. Jennifer L. Castle & David F. Hendry & Andrew B. Martinez, 2017. "Evaluating Forecasts, Narratives and Policy Using a Test of Invariance," Econometrics, MDPI, vol. 5(3), pages 1-27, September.
    4. Karsten Müller, 2022. "German forecasters’ narratives: How informative are German business cycle forecast reports?," Empirical Economics, Springer, vol. 62(5), pages 2373-2415, May.
    5. Dimitriadis, Timo & Liu, Xiaochun & Schnaitmann, Julie, 2020. "Encompassing tests for value at risk and expected shortfall multi-step forecasts based on inference on the boundary," Hohenheim Discussion Papers in Business, Economics and Social Sciences 11-2020, University of Hohenheim, Faculty of Business, Economics and Social Sciences.
    6. Ilias Filippou & James Mitchell & My T. Nguyen, 2023. "The FOMC versus the Staff: Do Policymakers Add Value in Their Tales?," Working Papers 23-20, Federal Reserve Bank of Cleveland.
    7. Niţoi, Mihai & Pochea, Maria-Miruna & Radu, Ştefan-Constantin, 2023. "Unveiling the sentiment behind central bank narratives: A novel deep learning index," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    8. Jennifer Castle & David Hendry, 2016. "Policy Analysis, Forediction, and Forecast Failure," Economics Series Working Papers 809, University of Oxford, Department of Economics.
    9. Rambaccussing, Dooruj & Kwiatkowski, Andrzej, 2020. "Forecasting with news sentiment: Evidence with UK newspapers," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1501-1516.
    10. Dooruj Rambaccussing & Craig Menzies & Andrzej Kwiatkowski, 2022. "Look who’s Talking: Individual Committee members’ impact on inflation expectations," Dundee Discussion Papers in Economics 305, Economic Studies, University of Dundee.
    11. Jones, Jacob T. & Sinclair, Tara M. & Stekler, Herman O., 2020. "A textual analysis of Bank of England growth forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1478-1487.
    12. Foltas, Alexander, 2023. "Quantifying priorities in business cycle reports: Analysis of recurring textual patterns around peaks and troughs," Working Papers 44, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    13. Sharpe, Steven A. & Sinha, Nitish R. & Hollrah, Christopher A., 2023. "The power of narrative sentiment in economic forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1097-1121.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    2. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    3. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    4. repec:spo:wpecon:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    5. Ericsson, Neil R., 2017. "How biased are U.S. government forecasts of the federal debt?," International Journal of Forecasting, Elsevier, vol. 33(2), pages 543-559.
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. repec:hal:wpspec:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    8. repec:hal:spmain:info:hdl:2441/f4rshpf3v1umfa09lat09b1bg is not listed on IDEAS
    9. Paul Hubert, 2010. "Monetary policy, imperfect information and the expectations channel [Politique monétaire,information imparfaite et canal des anticipations]," SciencePo Working papers Main tel-04095385, HAL.
    10. Paul Hubert, 2010. "Monetary Policy, Imperfect Information and the Expectations Channel," Sciences Po publications info:hdl:2441/f4rshpf3v1u, Sciences Po.
    11. repec:lan:wpaper:470 is not listed on IDEAS
    12. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    13. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    14. Ericsson, Neil R., 2017. "Economic forecasting in theory and practice: An interview with David F. Hendry," International Journal of Forecasting, Elsevier, vol. 33(2), pages 523-542.
    15. repec:lan:wpaper:425 is not listed on IDEAS
    16. repec:lan:wpaper:539557 is not listed on IDEAS
    17. repec:lan:wpaper:413 is not listed on IDEAS
    18. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    19. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    20. McCracken,M.W. & West,K.D., 2001. "Inference about predictive ability," Working papers 14, Wisconsin Madison - Social Systems.
    21. Jones, Jacob T. & Sinclair, Tara M. & Stekler, Herman O., 2020. "A textual analysis of Bank of England growth forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1478-1487.
    22. Pedersen, Michael, 2015. "What affects the predictions of private forecasters? The role of central bank forecasts in Chile," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1043-1055.
    23. Bespalova, Olga, 2020. "GDP forecasts: Informational asymmetry of the SPF and FOMC minutes," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1531-1540.
    24. Cepni, Oguzhan & Clements, Michael P., 2024. "How local is the local inflation factor? Evidence from emerging European countries," International Journal of Forecasting, Elsevier, vol. 40(1), pages 160-183.
    25. Clements, Michael P. & Galvão, Ana Beatriz, 2017. "Model and survey estimates of the term structure of US macroeconomic uncertainty," International Journal of Forecasting, Elsevier, vol. 33(3), pages 591-604.
    26. Clements, Michael P., 2019. "Do forecasters target first or later releases of national accounts data?," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1240-1249.
    27. Simionescu, Mihaela, 2022. "Econometrics of sentiments- sentometrics and machine learning: The improvement of inflation predictions in Romania using sentiment analysis," Technological Forecasting and Social Change, Elsevier, vol. 182(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:36:y:2020:i:4:p:1488-1500. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.