IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v62y2022i5d10.1007_s00181-021-02100-9.html
   My bibliography  Save this article

German forecasters’ narratives: How informative are German business cycle forecast reports?

Author

Listed:
  • Karsten Müller

    (University of Applied Sciences Merseburg)

Abstract

Based on German business cycle forecast reports covering 10 German institutions for the period 1993–2017, the paper analyses the information content of German forecasters’ narratives for German business cycle forecasts. The paper applies textual analysis to convert qualitative text data into quantitative sentiment indices. First, a sentiment analysis utilizes dictionary methods and text regression methods, using recursive estimation. Next, the paper analyses the different characteristics of sentiments. In a third step, sentiment indices are used to test the efficiency of numerical forecasts. Using 12-month-ahead fixed horizon forecasts, fixed-effects panel regression results suggest some informational content of sentiment indices for growth and inflation forecasts. Finally, a forecasting exercise analyses the predictive power of sentiment indices for GDP growth and inflation. The results suggest weak evidence, at best, for in-sample and out-of-sample predictive power of the sentiment indices.

Suggested Citation

  • Karsten Müller, 2022. "German forecasters’ narratives: How informative are German business cycle forecast reports?," Empirical Economics, Springer, vol. 62(5), pages 2373-2415, May.
  • Handle: RePEc:spr:empeco:v:62:y:2022:i:5:d:10.1007_s00181-021-02100-9
    DOI: 10.1007/s00181-021-02100-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-021-02100-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00181-021-02100-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ines Fortin & Sebastian P. Koch & Klaus Weyerstrass, 2020. "Evaluation of economic forecasts for Austria," Empirical Economics, Springer, vol. 58(1), pages 107-137, January.
    2. Paul C. Tetlock & Maytal Saar‐Tsechansky & Sofus Macskassy, 2008. "More Than Words: Quantifying Language to Measure Firms' Fundamentals," Journal of Finance, American Finance Association, vol. 63(3), pages 1437-1467, June.
    3. Pierdzioch, Christian & Rülke, Jan-Christoph, 2015. "On the directional accuracy of forecasts of emerging market exchange rates," International Review of Economics & Finance, Elsevier, vol. 38(C), pages 369-376.
    4. Matthew Gentzkow & Bryan Kelly & Matt Taddy, 2019. "Text as Data," Journal of Economic Literature, American Economic Association, vol. 57(3), pages 535-574, September.
    5. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    6. Travis J. Berge & Òscar Jordà, 2011. "Evaluating the Classification of Economic Activity into Recessions and Expansions," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(2), pages 246-277, April.
    7. Clements, Michael P. & Reade, J. James, 2020. "Forecasting and forecast narratives: The Bank of England Inflation Reports," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1488-1500.
    8. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    9. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    10. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    11. Peter Tillmann & Andreas Walter, 2018. "ECB vs Bundesbank: Diverging Tones and Policy Effectiveness," MAGKS Papers on Economics 201820, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    12. Katja Heinisch & Rolf Scheufele, 2018. "Bottom-up or direct? Forecasting German GDP in a data-rich environment," Empirical Economics, Springer, vol. 54(2), pages 705-745, March.
    13. Ullrich Heilemann & Herman O. Stekler, 2013. "Has The Accuracy of Macroeconomic Forecasts for Germany Improved?," German Economic Review, Verein für Socialpolitik, vol. 14(2), pages 235-253, May.
    14. Gaibulloev, Khusrav & Sandler, Todd & Sul, Donggyu, 2014. "Dynamic Panel Analysis under Cross-Sectional Dependence," Political Analysis, Cambridge University Press, vol. 22(2), pages 258-273, April.
    15. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    16. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    17. Michael J. Lamla & Sarah M. Lein & Jan-Egbert Sturm, 2020. "Media reporting and business cycles: empirical evidence based on news data," Empirical Economics, Springer, vol. 59(3), pages 1085-1105, September.
    18. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    19. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    20. Jörg Döpke & Ulrich Fritsche, 2006. "Growth and inflation forecasts for Germany a panel-based assessment of accuracy and efficiency," Empirical Economics, Springer, vol. 31(3), pages 777-798, September.
    21. Jonas Dovern & Ulrich Fritsche & Jiri Slacalek, 2012. "Disagreement Among Forecasters in G7 Countries," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1081-1096, November.
    22. Christopher A. Hollrah & Steven A. Sharpe & Nitish R. Sinha, 2020. "The Power of Narratives in Economic Forecasts," Finance and Economics Discussion Series 2020-001, Board of Governors of the Federal Reserve System (U.S.).
    23. Jones, Jacob T. & Sinclair, Tara M. & Stekler, Herman O., 2020. "A textual analysis of Bank of England growth forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1478-1487.
    24. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    25. Estrella, Arturo & Hardouvelis, Gikas A, 1991. "The Term Structure as a Predictor of Real Economic Activity," Journal of Finance, American Finance Association, vol. 46(2), pages 555-576, June.
    26. Björn Kauder & Niklas Potrafke & Christoph Schinke, 2017. "Manipulating Fiscal Forecasts: Evidence from the German States," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 73(2), pages 213-236, June.
    27. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    28. Liu, Weiling & Moench, Emanuel, 2016. "What predicts US recessions?," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1138-1150.
    29. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    30. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    31. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    32. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    33. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    34. Kathryn Lundquist & Herman O Stekler, 2012. "Interpreting the Performance of Business Economists During the Great Recession," Business Economics, Palgrave Macmillan;National Association for Business Economics, vol. 47(2), pages 148-154, April.
    35. Gabriel Mathy & Herman Stekler, 2018. "Was the deflation of the depression anticipated? An inference using real-time data," Journal of Economic Methodology, Taylor & Francis Journals, vol. 25(2), pages 117-125, April.
    36. Beck, Nathaniel & Katz, Jonathan N., 1995. "What To Do (and Not to Do) with Time-Series Cross-Section Data," American Political Science Review, Cambridge University Press, vol. 89(3), pages 634-647, September.
    37. Jörg Döpke & Ulrich Fritsche & Boriss Siliverstovs, 2010. "Evaluating German business cycle forecasts under an asymmetric loss function," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(1), pages 1-18.
    38. Diego García, 2013. "Sentiment during Recessions," Journal of Finance, American Finance Association, vol. 68(3), pages 1267-1300, June.
    39. Tobback, Ellen & Naudts, Hans & Daelemans, Walter & Junqué de Fortuny, Enric & Martens, David, 2018. "Belgian economic policy uncertainty index: Improvement through text mining," International Journal of Forecasting, Elsevier, vol. 34(2), pages 355-365.
    40. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    41. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    42. Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," The Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July.
    43. Stekler, Herman & Symington, Hilary, 2016. "Evaluating qualitative forecasts: The FOMC minutes, 2006–2010," International Journal of Forecasting, Elsevier, vol. 32(2), pages 559-570.
    44. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    45. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    46. Jonas Dovern & Ulrich Fritsche, 2008. "Estimating Fundamental Cross-Section Dispersion from Fixed Event Forecasts," Discussion Papers of DIW Berlin 787, DIW Berlin, German Institute for Economic Research.
    47. Ulrich Fritsche & Ullrich Heilemann, 2010. "Too Many Cooks? The German Joint Diagnosis and Its Production," Macroeconomics and Finance Series 201001, University of Hamburg, Department of Socioeconomics.
    48. Döhrn Roland & Schmidt Christoph M., 2011. "Information or Institution?: On the Determinants of Forecast Accuracy," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(1), pages 9-27, February.
    49. Ullrich Heilemann & Karsten Müller, 2018. "Wenig Unterschiede – Zur Treffsicherheit Internationaler Prognosen und Prognostiker [Few differences—on the accuracy of international forecasts and forecaster]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 12(3), pages 195-233, December.
    50. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    51. Björn Kauder & Niklas Potrafke & Christoph Schinke, 2017. "Manipulating Fiscal Forecasts: Evidence from the German States," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 73(2), pages 213-236, June.
    52. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    53. Nicolas Pröllochs & Stefan Feuerriegel & Dirk Neumann, 2018. "Statistical inferences for polarity identification in natural language," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-21, December.
    54. Dimpfl Thomas & Kleiman Vladislav, 2019. "Investor Pessimism and the German Stock Market: Exploring Google Search Queries," German Economic Review, De Gruyter, vol. 20(1), pages 1-28, February.
    55. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    56. Jegadeesh, Narasimhan & Wu, Di, 2013. "Word power: A new approach for content analysis," Journal of Financial Economics, Elsevier, vol. 110(3), pages 712-729.
    57. Krüger, Jens & Hoss, Julian, 2012. "German Business Cycle Forecasts, Asymmetric Loss and Financial Variables," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 63652, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    58. Batchelor, R A, 1990. "All Forecasters Are Equal," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 143-144, January.
    59. Manela, Asaf & Moreira, Alan, 2017. "News implied volatility and disaster concerns," Journal of Financial Economics, Elsevier, vol. 123(1), pages 137-162.
    60. Döpke, Jörg & Fritsche, Ulrich & Müller, Karsten, 2019. "Has macroeconomic forecasting changed after the Great Recession? Panel-based evidence on forecast accuracy and forecaster behavior from Germany," Journal of Macroeconomics, Elsevier, vol. 62(C).
    61. Krüger, Jens J. & Hoss, Julian, 2012. "German business cycle forecasts, asymmetric loss and financial variables," Economics Letters, Elsevier, vol. 114(3), pages 284-287.
    62. Robert Goldfarb & H. O. Stekler & Joel David, 2005. "Methodological issues in forecasting: Insights from the egregious business forecast errors of late 1930," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(4), pages 517-542.
    63. Ashiya, Masahiro, 2006. "Forecast accuracy and product differentiation of Japanese Institutional Forecasters," International Journal of Forecasting, Elsevier, vol. 22(2), pages 395-401.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Müller, Karsten, 2020. "German forecasters' narratives: How informative are German business cycle forecast reports?," Working Papers 23, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    2. Döpke, Jörg & Fritsche, Ulrich & Müller, Karsten, 2019. "Has macroeconomic forecasting changed after the Great Recession? Panel-based evidence on forecast accuracy and forecaster behavior from Germany," Journal of Macroeconomics, Elsevier, vol. 62(C).
    3. Jörg Döpke & Ulrich Fritsche & Karsten Müller, 2018. "Has Macroeconomic Forecasting changed after the Great Recession? - Panel-based Evidence on Accuracy and Forecaster Behaviour from Germany," Macroeconomics and Finance Series 201803, University of Hamburg, Department of Socioeconomics.
    4. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    5. Simionescu, Mihaela, 2022. "Econometrics of sentiments- sentometrics and machine learning: The improvement of inflation predictions in Romania using sentiment analysis," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    6. Behrens, Christoph, 2020. "German trade forecasts since 1970: An evaluation using the panel dimension," Working Papers 26, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    7. Sharpe, Steven A. & Sinha, Nitish R. & Hollrah, Christopher A., 2023. "The power of narrative sentiment in economic forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1097-1121.
    8. Döpke Jörg & Fritsche Ulrich & Waldhof Gabi, 2019. "Theories, Techniques and the Formation of German Business Cycle Forecasts : Evidence from a survey of professional forecasters," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 239(2), pages 203-241, April.
    9. Eleni Kalamara & Arthur Turrell & Chris Redl & George Kapetanios & Sujit Kapadia, 2022. "Making text count: Economic forecasting using newspaper text," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 896-919, August.
    10. Jones, Jacob T. & Sinclair, Tara M. & Stekler, Herman O., 2020. "A textual analysis of Bank of England growth forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1478-1487.
    11. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    12. Döpke Jörg & Fritsche Ulrich & Waldhof Gabi, 2019. "Theories, Techniques and the Formation of German Business Cycle Forecasts : Evidence from a survey of professional forecasters," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 239(2), pages 203-241, April.
    13. Andres Algaba & David Ardia & Keven Bluteau & Samuel Borms & Kris Boudt, 2020. "Econometrics Meets Sentiment: An Overview Of Methodology And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 34(3), pages 512-547, July.
    14. Christopher A. Hollrah & Steven A. Sharpe & Nitish R. Sinha, 2020. "The Power of Narratives in Economic Forecasts," Finance and Economics Discussion Series 2020-001, Board of Governors of the Federal Reserve System (U.S.).
    15. Döpke, Jörg & Fritsche, Ulrich & Waldhof, Gaby, 2017. "Theories, techniques and the formation of German business cycle forecasts. Evidence from a survey among professional forecasters," Working Papers 2, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    16. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    17. repec:lan:wpaper:470 is not listed on IDEAS
    18. , & Stein, Tobias, 2021. "Equity premium predictability over the business cycle," CEPR Discussion Papers 16357, C.E.P.R. Discussion Papers.
    19. Consoli, Sergio & Pezzoli, Luca Tiozzo & Tosetti, Elisa, 2021. "Emotions in macroeconomic news and their impact on the European bond market," Journal of International Money and Finance, Elsevier, vol. 118(C).
    20. Anand, Abhinav & Basu, Sankarshan & Pathak, Jalaj & Thampy, Ashok, 2021. "The impact of sentiment on emerging stock markets," International Review of Economics & Finance, Elsevier, vol. 75(C), pages 161-177.
    21. Daniel Borup & Jonas N. Eriksen & Mads M. Kjær & Martin Thyrsgaard, 2020. "Predicting bond return predictability," CREATES Research Papers 2020-09, Department of Economics and Business Economics, Aarhus University.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:62:y:2022:i:5:d:10.1007_s00181-021-02100-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.