IDEAS home Printed from https://ideas.repec.org/a/eee/jmacro/v62y2019ics0164070418303550.html
   My bibliography  Save this article

Has macroeconomic forecasting changed after the Great Recession? Panel-based evidence on forecast accuracy and forecaster behavior from Germany

Author

Listed:
  • Döpke, Jörg
  • Fritsche, Ulrich
  • Müller, Karsten

Abstract

We analyze the forecast accuracy for the periods before and after the Great Recession using a panel of annual data for 17 growth and inflation forecasts from 14 German institutions. We find only small differences in the quantitative accuracy measures between the two periods. The qualitative measures of forecast accuracy have slightly worsened and forecasters’ behavior has changed after the crisis. Errors in predicting directional change, however, have changed significantly between the two periods under investigation. Tests for the efficiency of the forecasts over the entire sample indicate that growth and inflation forecasts are inefficient. We find a changed correlation between forecast errors of inflation and growth after the crisis, which might hint at a changed forecaster behavior. The estimated loss functions before and after the crisis support this interpretation, suggesting a stronger incentive to avoid overestimation of growth and underestimation of inflation after the crisis. Estimating loss functions for a 10-year rolling window also reveal shifts in the level and direction of loss asymmetry.

Suggested Citation

  • Döpke, Jörg & Fritsche, Ulrich & Müller, Karsten, 2019. "Has macroeconomic forecasting changed after the Great Recession? Panel-based evidence on forecast accuracy and forecaster behavior from Germany," Journal of Macroeconomics, Elsevier, vol. 62(C).
  • Handle: RePEc:eee:jmacro:v:62:y:2019:i:c:s0164070418303550
    DOI: 10.1016/j.jmacro.2019.103135
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0164070418303550
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmacro.2019.103135?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    2. Belke, Ansgar & Klose, Jens, 2013. "Modifying Taylor reaction functions in the presence of the zero‐lower‐bound — Evidence for the ECB and the Fed," Economic Modelling, Elsevier, vol. 35(C), pages 515-527.
    3. Ullrich Heilemann & Herman O. Stekler, 2013. "Has The Accuracy of Macroeconomic Forecasts for Germany Improved?," German Economic Review, Verein für Socialpolitik, vol. 14(2), pages 235-253, May.
    4. Gaibulloev, Khusrav & Sandler, Todd & Sul, Donggyu, 2014. "Dynamic Panel Analysis under Cross-Sectional Dependence," Political Analysis, Cambridge University Press, vol. 22(2), pages 258-273, April.
    5. Moritz Schularick & Alan M. Taylor, 2012. "Credit Booms Gone Bust: Monetary Policy, Leverage Cycles, and Financial Crises, 1870-2008," American Economic Review, American Economic Association, vol. 102(2), pages 1029-1061, April.
    6. Laurence Ball & Sandeep Mazumder, 2011. "Inflation Dynamics and the Great Recession," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 42(1 (Spring), pages 337-405.
    7. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    8. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    9. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
    10. Ricardo Reis, 2018. "Is something really wrong with macroeconomics?," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 34(1-2), pages 132-155.
    11. Holston, Kathryn & Laubach, Thomas & Williams, John C., 2017. "Measuring the natural rate of interest: International trends and determinants," Journal of International Economics, Elsevier, vol. 108(S1), pages 59-75.
    12. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    13. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    14. Bryan Campbell & Eric Ghysels, 1997. "An Empirical Analysis of the Canadian Budget Process," Canadian Journal of Economics, Canadian Economics Association, vol. 30(3), pages 553-576, August.
    15. Lawrence J. Christiano & Martin S. Eichenbaum & Mathias Trabandt, 2015. "Understanding the Great Recession," American Economic Journal: Macroeconomics, American Economic Association, vol. 7(1), pages 110-167, January.
    16. Claudio Borio & Boris Hofmann, 2017. "Is Monetary Policy Less Effective When Interest Rates Are Persistently Low?," RBA Annual Conference Volume (Discontinued), in: Jonathan Hambur & John Simon (ed.),Monetary Policy and Financial Stability in a World of Low Interest Rates, Reserve Bank of Australia.
    17. Beck, Nathaniel & Katz, Jonathan N., 1995. "What To Do (and Not to Do) with Time-Series Cross-Section Data," American Political Science Review, Cambridge University Press, vol. 89(3), pages 634-647, September.
    18. Serena Ng & Jonathan H. Wright, 2013. "Facts and Challenges from the Great Recession for Forecasting and Macroeconomic Modeling," Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1120-1154, December.
    19. √Íscar Jord√Ä & Moritz Schularick & Alan M. Taylor, 2013. "When Credit Bites Back," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45(s2), pages 3-28, December.
    20. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    21. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    22. Kabukçuoğlu, Ayşe & Martínez-García, Enrique, 2018. "Inflation as a global phenomenon—Some implications for inflation modeling and forecasting," Journal of Economic Dynamics and Control, Elsevier, vol. 87(C), pages 46-73.
    23. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    24. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    25. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    26. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    27. Björn Kauder & Niklas Potrafke & Christoph Schinke, 2017. "Manipulating Fiscal Forecasts: Evidence from the German States," FinanzArchiv: Public Finance Analysis, Mohr Siebeck, Tübingen, vol. 73(2), pages 213-236, June.
    28. Ulrike Malmendier & Stefan Nagel, 2011. "Depression Babies: Do Macroeconomic Experiences Affect Risk Taking?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 373-416.
    29. Francesco Bianchi & Andrea Civelli, 2015. "Globalization and Inflation: Evidence from a Time Varying VAR," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 18(2), pages 406-433, April.
    30. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    31. Garcí­a, Juan Angel, 2003. "An introduction to the ECB's survey of professional forecasters," Occasional Paper Series 8, European Central Bank.
    32. Wang, Yiyao & Lee, Tae-Hwy, 2014. "Asymmetric loss in the Greenbook and the Survey of Professional Forecasters," International Journal of Forecasting, Elsevier, vol. 30(2), pages 235-245.
    33. Döhrn Roland & Schmidt Christoph M., 2011. "Information or Institution?: On the Determinants of Forecast Accuracy," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 231(1), pages 9-27, February.
    34. Ji, Yangyang & Xiao, Wei, 2016. "Government spending multipliers and the zero lower bound," Journal of Macroeconomics, Elsevier, vol. 48(C), pages 87-100.
    35. Dopke, Jorg & Fritsche, Ulrich, 2006. "When do forecasters disagree? An assessment of German growth and inflation forecast dispersion," International Journal of Forecasting, Elsevier, vol. 22(1), pages 125-135.
    36. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    37. Ahmad, Saad & Civelli, Andrea, 2016. "Globalization and inflation: A threshold investigation," Journal of Macroeconomics, Elsevier, vol. 48(C), pages 283-304.
    38. Artur Tarassow & Sven Schreiber, 2018. "FEP - the forecast evaluation package for gretl," IMK Working Paper 190-2018, IMK at the Hans Boeckler Foundation, Macroeconomic Policy Institute.
    39. Tara Sinclair & H. O. Stekler & L. Kitzinger, 2010. "Directional forecasts of GDP and inflation: a joint evaluation with an application to Federal Reserve predictions," Applied Economics, Taylor & Francis Journals, vol. 42(18), pages 2289-2297.
    40. Juan Angel Garcia, 2003. "An introduction to the ECB’s survey of professional forecasters," Occasional Paper Series 08, European Central Bank.
    41. Jörg Döpke & Ulrich Fritsche, 2006. "Growth and inflation forecasts for Germany a panel-based assessment of accuracy and efficiency," Empirical Economics, Springer, vol. 31(3), pages 777-798, September.
    42. Christopher D. Carroll, 2003. "Macroeconomic Expectations of Households and Professional Forecasters," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 269-298.
    43. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    44. Servaas Storm & C.W.M. Naastepad, 2015. "Crisis and Recovery in the German Economy: The Real Lessons," Working Papers Series 10, Institute for New Economic Thinking.
    45. Olivier Blanchard, 2016. "The Phillips Curve: Back to the '60s?," American Economic Review, American Economic Association, vol. 106(5), pages 31-34, May.
    46. Joseph E Stiglitz, 2018. "Where modern macroeconomics went wrong," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 34(1-2), pages 70-106.
    47. Nigel Pain & Christine Lewis & Thai-Thanh Dang & Yosuke Jin & Pete Richardson, 2014. "OECD Forecasts During and After the Financial Crisis: A Post Mortem," OECD Economics Department Working Papers 1107, OECD Publishing.
    48. Jane Ihrig & Steven B. Kamin & Deborah Lindner & Jaime Marquez, 2010. "Some Simple Tests of the Globalization and Inflation Hypothesis," International Finance, Wiley Blackwell, vol. 13(3), pages 343-375, December.
    49. Campos, Nauro F. & Fidrmuc, Jarko & Korhonen, Iikka, 2019. "Business cycle synchronisation and currency unions: A review of the econometric evidence using meta-analysis," International Review of Financial Analysis, Elsevier, vol. 61(C), pages 274-283.
    50. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    51. Jennifer L. Castle & Michael P. Clements & David F. Hendry, 2016. "An Overview of Forecasting Facing Breaks," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 12(1), pages 3-23, September.
    52. Manuel Arellano & Stephen Bond, 1991. "Some Tests of Specification for Panel Data: Monte Carlo Evidence and an Application to Employment Equations," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(2), pages 277-297.
    53. Windmeijer, Frank, 2005. "A finite sample correction for the variance of linear efficient two-step GMM estimators," Journal of Econometrics, Elsevier, vol. 126(1), pages 25-51, May.
    54. Frenkel, Michael & Lis, Eliza M. & Rülke, Jan-Christoph, 2011. "Has the economic crisis of 2007-2009 changed the expectation formation process in the Euro area?," Economic Modelling, Elsevier, vol. 28(4), pages 1808-1814, July.
    55. Storm, Servaas & Naastepad, C.W.M., 2015. "Crisis and recovery in the German economy: The real lessons," Structural Change and Economic Dynamics, Elsevier, vol. 32(C), pages 11-24.
    56. Christine Lewis & Nigel Pain, 2014. "Lessons from OECD forecasts during and after the financial crisis," OECD Journal: Economic Studies, OECD Publishing, vol. 2014(1), pages 9-39.
    57. Ulrich Fritsche & Johannes Puckelwald, 2018. "Deciphering Professional Forecasters’ Stories - Analyzing a Corpus of Textual Predictions for the German Economy," Macroeconomics and Finance Series 201804, University of Hamburg, Department of Socioeconomics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Müller, Karsten, 2020. "German forecasters' narratives: How informative are German business cycle forecast reports?," Working Papers 23, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    2. Karsten Müller, 2022. "German forecasters’ narratives: How informative are German business cycle forecast reports?," Empirical Economics, Springer, vol. 62(5), pages 2373-2415, May.
    3. Christina Anderl & Guglielmo Maria Caporale, 2023. "Forecasting inflation with a zero lower bound or negative interest rates: Evidence from point and density forecasts," Manchester School, University of Manchester, vol. 91(3), pages 171-232, June.
    4. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    5. Tom Krebs & Isabella Weber, 2024. "Can Price Controls be Optimal? The Economics of the Energy Shock in Germany," Working Papers 3, Forum New Economy.
    6. Glocker, Christian & Kaniovski, Serguei, 2020. "Structural modeling and forecasting using a cluster of dynamic factor models," MPRA Paper 101874, University Library of Munich, Germany.
    7. Jakub Rybacki & Michał Gniazdowski, 2023. "Macroeconomic forecasting in Poland: lessons from the external shocks," Bank i Kredyt, Narodowy Bank Polski, vol. 54(1), pages 45-64.
    8. Heinisch, Katja & Behrens, Christoph & Döpke, Jörg & Foltas, Alexander & Fritsche, Ulrich & Köhler, Tim & Müller, Karsten & Puckelwald, Johannes & Reichmayr, Hannes, 2023. "The IWH Forecasting Dashboard: From forecasts to evaluation and comparison," IWH Technical Reports 1/2023, Halle Institute for Economic Research (IWH).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jörg Döpke & Ulrich Fritsche & Karsten Müller, 2018. "Has Macroeconomic Forecasting changed after the Great Recession? - Panel-based Evidence on Accuracy and Forecaster Behaviour from Germany," Macroeconomics and Finance Series 201803, University of Hamburg, Department of Socioeconomics.
    2. Behrens, Christoph, 2020. "German trade forecasts since 1970: An evaluation using the panel dimension," Working Papers 26, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    3. Karsten Müller, 2022. "German forecasters’ narratives: How informative are German business cycle forecast reports?," Empirical Economics, Springer, vol. 62(5), pages 2373-2415, May.
    4. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    5. Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    6. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    7. Simón Sosvilla-Rivero & María del Carmen Ramos-Herrera, 2018. "Inflation, real economic growth and unemployment expectations: an empirical analysis based on the ECB survey of professional forecasters," Applied Economics, Taylor & Francis Journals, vol. 50(42), pages 4540-4555, September.
    8. Sergey V. Smirnov & Daria A. Avdeeva, 2016. "Wishful Bias in Predicting Us Recessions: Indirect Evidence," HSE Working papers WP BRP 135/EC/2016, National Research University Higher School of Economics.
    9. Behrens, Christoph, 2019. "Evaluating the Joint Efficiency of German Trade Forecasts. A nonparametric multivariate approach," Working Papers 9, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    10. Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
    11. Jones, Jacob T. & Sinclair, Tara M. & Stekler, Herman O., 2020. "A textual analysis of Bank of England growth forecasts," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1478-1487.
    12. Sergey V. Smirnov, 2014. "Predicting US Recessions: Does a Wishful Bias Exist?," HSE Working papers WP BRP 77/EC/2014, National Research University Higher School of Economics.
    13. Yoichi Tsuchiya, 2022. "Evaluating plant managers’ production plans over business cycles: asymmetric loss and rationality," SN Business & Economics, Springer, vol. 2(8), pages 1-29, August.
    14. Lehmann Robert & Wollmershäuser Timo, 2020. "The macroeconomic projections of the German government: A comparison to an independent forecasting institution," German Economic Review, De Gruyter, vol. 21(2), pages 235-270, June.
    15. Bürgi, Constantin, 2017. "Bias, rationality and asymmetric loss functions," Economics Letters, Elsevier, vol. 154(C), pages 113-116.
    16. Ulrich Fritsche & Artur Tarassow, 2017. "Vergleichende Evaluation der Konjunkturprognosen des Instituts für Makroökonomie und Konjunkturforschung an der Hans-Böckler-Stiftung für den Zeitraum 2005-2014," IMK Studies 54-2017, IMK at the Hans Boeckler Foundation, Macroeconomic Policy Institute.
    17. Müller, Karsten, 2020. "German forecasters' narratives: How informative are German business cycle forecast reports?," Working Papers 23, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    18. Ager, P. & Kappler, M. & Osterloh, S., 2009. "The accuracy and efficiency of the Consensus Forecasts: A further application and extension of the pooled approach," International Journal of Forecasting, Elsevier, vol. 25(1), pages 167-181.
    19. Pedersen, Michael, 2015. "What affects the predictions of private forecasters? The role of central bank forecasts in Chile," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1043-1055.
    20. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.

    More about this item

    Keywords

    Macroeconomic forecasting; Forecast error evaluation; Germany;
    All these keywords.

    JEL classification:

    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmacro:v:62:y:2019:i:c:s0164070418303550. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622617 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.