IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v35y2019i3p1143-1159.html
   My bibliography  Save this article

Forecasts in times of crises

Author

Listed:
  • Eicher, Theo S.
  • Kuenzel, David J.
  • Papageorgiou, Chris
  • Christofides, Charis

Abstract

Financial crises pose unique challenges for forecast accuracy. Using the IMF’s Monitoring of Fund Arrangements (MONA) database, we conduct the most comprehensive evaluation of IMF forecasts to date for countries in times of crises. We examine 29 macroeconomic variables in terms of bias, efficiency, and information content to find that IMF forecasts add substantial informational value, as they consistently outperform naive forecast approaches. However, we also document that there is room for improvement: two-thirds of the key macroeconomic variables that we examine are forecast inefficiently, and six variables (growth of nominal GDP, public investment, private investment, the current account, net transfers, and government expenditures) exhibit significant forecast biases. The forecasts for low-income countries are the main drivers of forecast biases and inefficiency, perhaps reflecting larger shocks and lower data quality. When we decompose the forecast errors into their sources, we find that forecast errors for private consumption growth are the key contributor to GDP growth forecast errors. Similarly, forecast errors for non-interest expenditure growth and tax revenue growth are crucial determinants of the forecast errors in the growth of fiscal budgets. Forecast errors for balance of payments growth are influenced significantly by forecast errors in goods import growth. The results highlight which macroeconomic aggregates require further attention in future forecast models for countries in crises.

Suggested Citation

  • Eicher, Theo S. & Kuenzel, David J. & Papageorgiou, Chris & Christofides, Charis, 2019. "Forecasts in times of crises," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1143-1159.
  • Handle: RePEc:eee:intfor:v:35:y:2019:i:3:p:1143-1159
    DOI: 10.1016/j.ijforecast.2019.04.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207019300597
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2019.04.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    2. Tara M. Sinclair & Fred Joutz & Herman O. Stekler, 2008. "Are 'unbiased' forecasts really unbiased? Another look at the Fed forecasts," Working Papers 2008-010, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    3. Palm, F. & Zellner, A., 1991. "To combine or not to combine? issues of combining forecasts," LIDAM Discussion Papers CORE 1991022, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    4. Sinclair, Tara M. & Joutz, Fred & Stekler, H.O., 2010. "Can the Fed predict the state of the economy?," Economics Letters, Elsevier, vol. 108(1), pages 28-32, July.
    5. Mr. Charalambos Christofides & Mr. Atish R. Ghosh & Ms. Uma Ramakrishnan & Mr. Alun H. Thomas & Ms. Laura Papi & Mr. Juan Zalduendo & Mr. Jun I Kim, 2005. "The Design of IMF-Supported Programs," IMF Occasional Papers 2005/007, International Monetary Fund.
    6. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-533, October.
    7. Olivier J. Blanchard & Daniel Leigh, 2013. "Growth Forecast Errors and Fiscal Multipliers," American Economic Review, American Economic Association, vol. 103(3), pages 117-120, May.
    8. Mr. Mikhail Golosov & Mr. John R King, 2002. "Tax Revenue Forecasts in IMF-Supported Programs," IMF Working Papers 2002/236, International Monetary Fund.
    9. Sinclair, Tara M. & Stekler, H.O., 2013. "Examining the quality of early GDP component estimates," International Journal of Forecasting, Elsevier, vol. 29(4), pages 736-750.
    10. Karen E. Dynan & Douglas W. Elmendorf, 2001. "Do provisional estimates of output miss economic turning points?," Finance and Economics Discussion Series 2001-52, Board of Governors of the Federal Reserve System (U.S.).
    11. Swanson, Norman R. & van Dijk, Dick, 2006. "Are Statistical Reporting Agencies Getting It Right? Data Rationality and Business Cycle Asymmetry," Journal of Business & Economic Statistics, American Statistical Association, vol. 24, pages 24-42, January.
    12. Lahiri, Kajal & Sheng, Xuguang, 2010. "Learning and heterogeneity in GDP and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 26(2), pages 265-292, April.
    13. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    14. Frederick Joutz & H. O. Stekler, 1998. "Data revisions and forecasting," Applied Economics, Taylor & Francis Journals, vol. 30(8), pages 1011-1016.
    15. Mr. Morris Goldstein, 1986. "The Global Effects of Fund-Supported Adjustment Programs," IMF Occasional Papers 1986/002, International Monetary Fund.
    16. Schnader, M H & Stekler, H O, 1990. "Evaluating Predictions of Change," The Journal of Business, University of Chicago Press, vol. 63(1), pages 99-107, January.
    17. Reza Baqir & Rodney Ramcharan & Ratna Sahay, 2005. "IMF Programs and Growth: Is Optimism Defensible?," IMF Staff Papers, Palgrave Macmillan, vol. 52(2), pages 260-286, September.
    18. Alberto Musso & Steven Phillips, 2002. "Comparing Projections and Outcomes of IMF-Supported Programs," IMF Staff Papers, Palgrave Macmillan, vol. 49(1), pages 1-3.
    19. Ruben Atoyan & Patrick Conway, 2011. "Projecting macroeconomic outcomes: Evidence from the IMF," The Review of International Organizations, Springer, vol. 6(3), pages 415-441, September.
    20. Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," The Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July.
    21. Stephen K. McNees, 1986. "Estimating GNP: the trade-off between timeliness and accuracy," New England Economic Review, Federal Reserve Bank of Boston, issue Jan, pages 3-10.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yan Carrière-Swallow & José Marzluf, 2023. "Macrofinancial Causes of Optimism in Growth Forecasts," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 509-537, June.
    2. Rybacki, Jakub & Gniazdowski, Michał, 2021. "Macroeconomic Forecasting in Poland: Lessons From the COVID-19 Outbreak," MPRA Paper 107682, University Library of Munich, Germany.
    3. An, Zidong & Ball, Laurence & Jalles, Joao & Loungani, Prakash, 2019. "Do IMF forecasts respect Okun’s law? Evidence for advanced and developing economies," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1131-1142.
    4. Eicher, Theo S. & Kawai, Reina, 2023. "IMF trade forecasts for crisis countries: Bias, inefficiency, and their origins," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1615-1639.
    5. Blanco Cossio,Fernando Andres,Sachdeva,Niharika, 2021. "The Cyclicality of IFC Investments : To Be, or Not to Be, Procyclical," Policy Research Working Paper Series 9746, The World Bank.
    6. Yoichi Tsuchiya, 2021. "Thirty‐year assessment of Asian Development Bank's forecasts," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 35(2), pages 18-40, November.
    7. Kuruc, Kevin, 2022. "Are IMF rescue packages effective? A synthetic control analysis of macroeconomic crises," Journal of Monetary Economics, Elsevier, vol. 127(C), pages 38-53.
    8. Eicher, Theo S. & Rollinson, Yuan Gao, 2023. "The accuracy of IMF crises nowcasts," International Journal of Forecasting, Elsevier, vol. 39(1), pages 431-449.
    9. Jakub Rybacki & Michał Gniazdowski, 2023. "Macroeconomic forecasting in Poland: lessons from the external shocks," Bank i Kredyt, Narodowy Bank Polski, vol. 54(1), pages 45-64.
    10. Klaus-Peter Hellwig, 2018. "Overfitting in Judgment-based Economic Forecasts: The Case of IMF Growth Projections," IMF Working Papers 2018/260, International Monetary Fund.
    11. Andras Chabin & Sébastien Lamproye & Milan Výškrabka, 2020. "Are We More Accurate? Revisiting the European Commission’s Macroeconomic Forecasts," European Economy - Discussion Papers 128, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eicher, Theo S. & Kawai, Reina, 2023. "IMF trade forecasts for crisis countries: Bias, inefficiency, and their origins," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1615-1639.
    2. Sinclair, Tara M. & Stekler, H.O., 2013. "Examining the quality of early GDP component estimates," International Journal of Forecasting, Elsevier, vol. 29(4), pages 736-750.
    3. Sinclair, Tara M., 2019. "Characteristics and implications of Chinese macroeconomic data revisions," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1108-1117.
    4. Tara M. Sinclair & H.O. Stekler, 2011. "Differences in Early GDP Component Estimates Between Recession and Expansion," Working Papers 2011-05, The George Washington University, Institute for International Economic Policy.
    5. Eicher, Theo S. & Rollinson, Yuan Gao, 2023. "The accuracy of IMF crises nowcasts," International Journal of Forecasting, Elsevier, vol. 39(1), pages 431-449.
    6. Baghestani, Hamid & AbuAl-Foul, Bassam M., 2017. "Comparing Federal Reserve, Blue Chip, and time series forecasts of US output growth," Journal of Economics and Business, Elsevier, vol. 89(C), pages 47-56.
    7. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    8. Sinclair, Tara M. & Joutz, Fred & Stekler, H.O., 2010. "Can the Fed predict the state of the economy?," Economics Letters, Elsevier, vol. 108(1), pages 28-32, July.
    9. Oliver Blaskowitz & Helmut Herwartz, 2008. "Testing directional forecast value in the presence of serial correlation," SFB 649 Discussion Papers SFB649DP2008-073, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    10. Hamid Baghestani, 2017. "Do US consumer survey data help beat the random walk in forecasting mortgage rates?," Cogent Economics & Finance, Taylor & Francis Journals, vol. 5(1), pages 1343017-134, January.
    11. Ines Fortin & Sebastian P. Koch & Klaus Weyerstrass, 2020. "Evaluation of economic forecasts for Austria," Empirical Economics, Springer, vol. 58(1), pages 107-137, January.
    12. Sinclair, Tara M. & Stekler, H.O. & Carnow, Warren, 2015. "Evaluating a vector of the Fed’s forecasts," International Journal of Forecasting, Elsevier, vol. 31(1), pages 157-164.
    13. Mihaela Simionescu, 2014. "Directional accuracy for inflation and unemployment rate predictions in Romania," International Journal of Business and Economic Sciences Applied Research (IJBESAR), International Hellenic University (IHU), Kavala Campus, Greece (formerly Eastern Macedonia and Thrace Institute of Technology - EMaTTech), vol. 7(2), pages 129-138, September.
    14. Lixiong Yang, 2020. "State-dependent biases and the quality of China’s preliminary GDP announcements," Empirical Economics, Springer, vol. 59(6), pages 2663-2687, December.
    15. Baghestani, Hamid, 2011. "Federal Reserve and private forecasts of growth in investment," Journal of Economics and Business, Elsevier, vol. 63(4), pages 290-305, July.
    16. Xie, Zixiong & Hsu, Shih-Hsun, 2016. "Time varying biases and the state of the economy," International Journal of Forecasting, Elsevier, vol. 32(3), pages 716-725.
    17. Fritsche, Ulrich & Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2015. "Forecasting the Brazilian real and the Mexican peso: Asymmetric loss, forecast rationality, and forecaster herding," International Journal of Forecasting, Elsevier, vol. 31(1), pages 130-139.
    18. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    19. Ullrich Heilemann & Herman Stekler, 2010. "Perspectives on Evaluating Macroeconomic Forecasts," Working Papers 2010-002, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    20. Lim, Terence & Lo, Andrew W. & Merton, Robert C. & Scholes, Myron S., 2006. "The Derivatives Sourcebook," Foundations and Trends(R) in Finance, now publishers, vol. 1(5–6), pages 365-572, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:35:y:2019:i:3:p:1143-1159. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.