IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v39y2023i4p1615-1639.html
   My bibliography  Save this article

IMF trade forecasts for crisis countries: Bias, inefficiency, and their origins

Author

Listed:
  • Eicher, Theo S.
  • Kawai, Reina

Abstract

External sector surveillance and stabilization are core missions of the International Monetary Fund (IMF). Since 1992, the IMF approved over 600 crisis country loan programs, conditional on reforms and performance targets that are contingent on IMF crisis assessments and recovery forecasts. The literature evaluating IMF crisis forecasts has primarily focused on GDP, inflation, and fiscal budgets, but IMF programs often originate with the balance of payments crises. Our evaluation of IMF imports/exports/exchange rates in crisis countries reveals a surprising dichotomy: import forecasts are largely efficient and unbiased, while exports and exchange rate forecasts exhibit substantial biases and inefficiencies. We show forecast errors in the full sample are driven by deeply flawed IMF forecasts for LICs in crisis. Fixed exchange rate LICs (predominantly African franc zone countries) receive systematically inefficient import forecasts. Exchange rate forecasts for LICs with flexible exchange rates are so inefficient that they cannot outperform a naïve random walk, and over 30 percent of the forecasts cannot match the exchange rate’s directional movement during the first year of the recovery. Examining the sources of biases and inefficiencies, we highlight effects of conditionality and geopolitics that were not fully accounted for in IMF forecasts, specifically those relating to arrears (domestic and foreign), fiscal finance (balance and credit limits), policy reforms (trade and government), (civil) wars, and elections.

Suggested Citation

  • Eicher, Theo S. & Kawai, Reina, 2023. "IMF trade forecasts for crisis countries: Bias, inefficiency, and their origins," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1615-1639.
  • Handle: RePEc:eee:intfor:v:39:y:2023:i:4:p:1615-1639
    DOI: 10.1016/j.ijforecast.2022.07.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207022001042
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2022.07.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chatterjee Pratiti, 2019. "Asymmetric impact of uncertainty in recessions: are emerging countries more vulnerable?," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 23(2), pages 1-27, April.
    2. Sinclair, Tara M. & Joutz, Fred & Stekler, H.O., 2010. "Can the Fed predict the state of the economy?," Economics Letters, Elsevier, vol. 108(1), pages 28-32, July.
    3. Henriksson, Roy D & Merton, Robert C, 1981. "On Market Timing and Investment Performance. II. Statistical Procedures for Evaluating Forecasting Skills," The Journal of Business, University of Chicago Press, vol. 54(4), pages 513-533, October.
    4. Chinn, Menzie D. & Ito, Hiro, 2006. "What matters for financial development? Capital controls, institutions, and interactions," Journal of Development Economics, Elsevier, vol. 81(1), pages 163-192, October.
    5. Oleg Itskhoki, 2021. "The Story of the Real Exchange Rate," Annual Review of Economics, Annual Reviews, vol. 13(1), pages 423-455, August.
    6. Verbeek, Jos, 1999. "The World Bank's Unified Survey projections : how accurate are they? an ex-post evaluation of US91-US97," Policy Research Working Paper Series 2071, The World Bank.
    7. Alexander E. Kentikelenis & Thomas H. Stubbs & Lawrence P. King, 2016. "IMF conditionality and development policy space, 1985–2014," Review of International Political Economy, Taylor & Francis Journals, vol. 23(4), pages 543-582, July.
    8. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    9. Kareem Ismail & Mr. Roberto Perrelli & Jessie Yang, 2020. "Optimism Bias in Growth Forecasts—The Role of Planned Policy Adjustments," IMF Working Papers 2020/229, International Monetary Fund.
    10. Allan Timmermann, 2007. "An Evaluation of the World Economic Outlook Forecasts," IMF Staff Papers, Palgrave Macmillan, vol. 54(1), pages 1-33, May.
    11. Frank-Oliver Aldenhoff, 2007. "Are economic forecasts of the International Monetary Fund politically biased? A public choice analysis," The Review of International Organizations, Springer, vol. 2(3), pages 239-260, September.
    12. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    13. Schnader, M H & Stekler, H O, 1990. "Evaluating Predictions of Change," The Journal of Business, University of Chicago Press, vol. 63(1), pages 99-107, January.
    14. Eicher, Theo S. & Kuenzel, David J. & Papageorgiou, Chris & Christofides, Charis, 2019. "Forecasts in times of crises," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1143-1159.
    15. Michael Mussa & Miguel Savastano, 2000. "The IMF Approach to Economic Stabilization," NBER Chapters, in: NBER Macroeconomics Annual 1999, Volume 14, pages 79-128, National Bureau of Economic Research, Inc.
    16. Przeworski, Adam & Vreeland, James Raymond, 2000. "The effect of IMF programs on economic growth," Journal of Development Economics, Elsevier, vol. 62(2), pages 385-421, August.
    17. Alberto Musso & Steven Phillips, 2002. "Comparing Projections and Outcomes of IMF-Supported Programs," IMF Staff Papers, Palgrave Macmillan, vol. 49(1), pages 1-3.
    18. Thomas Stubbs & Bernhard Reinsberg & Alexander Kentikelenis & Lawrence King, 2020. "How to evaluate the effects of IMF conditionality," The Review of International Organizations, Springer, vol. 15(1), pages 29-73, January.
    19. Boz, Emine & Casas, Camila & Georgiadis, Georgios & Gopinath, Gita & Le Mezo, Helena & Mehl, Arnaud & Nguyen, Tra, 2020. "Patterns in invoicing currency in global trade," Working Paper Series 2456, European Central Bank.
    20. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    21. Holden, Karen C & Peel, D A & Sandhu, B, 1987. "The Accuracy of OECD Forecasts," Empirical Economics, Springer, vol. 12(3), pages 175-186.
    22. Artis, M. J. & Zhang, W., 1990. "BVAR forecasts for the G-7," International Journal of Forecasting, Elsevier, vol. 6(3), pages 349-362, October.
    23. Axel Dreher & Silvia Marchesi & James Vreeland, 2008. "The political economy of IMF forecasts," Public Choice, Springer, vol. 137(1), pages 145-171, October.
    24. Frenkel, Michael & Rülke, Jan-Christoph & Zimmermann, Lilli, 2013. "Do private sector forecasters chase after IMF or OECD forecasts?," Journal of Macroeconomics, Elsevier, vol. 37(C), pages 217-229.
    25. Arora, Harjit K. & Smyth, David J., 1990. "Forecasting the developing world : An accuracy analysis of the IMF's forecasts," International Journal of Forecasting, Elsevier, vol. 6(3), pages 393-400, October.
    26. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    27. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    28. Frederik Kunze, 2020. "Predicting exchange rates in Asia: New insights on the accuracy of survey forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(2), pages 313-333, March.
    29. Yan Carrière-Swallow & José Marzluf, 2023. "Macrofinancial Causes of Optimism in Growth Forecasts," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 509-537, June.
    30. Ruben Atoyan & Patrick Conway, 2011. "Projecting macroeconomic outcomes: Evidence from the IMF," The Review of International Organizations, Springer, vol. 6(3), pages 415-441, September.
    31. Merton, Robert C, 1981. "On Market Timing and Investment Performance. I. An Equilibrium Theory of Value for Market Forecasts," The Journal of Business, University of Chicago Press, vol. 54(3), pages 363-406, July.
    32. Christine Lewis & Nigel Pain, 2014. "Lessons from OECD forecasts during and after the financial crisis," OECD Journal: Economic Studies, OECD Publishing, vol. 2014(1), pages 9-39.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    2. Eicher, Theo S. & Rollinson, Yuan Gao, 2023. "The accuracy of IMF crises nowcasts," International Journal of Forecasting, Elsevier, vol. 39(1), pages 431-449.
    3. Eicher, Theo S. & Kuenzel, David J. & Papageorgiou, Chris & Christofides, Charis, 2019. "Forecasts in times of crises," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1143-1159.
    4. repec:lan:wpaper:413 is not listed on IDEAS
    5. repec:lan:wpaper:470 is not listed on IDEAS
    6. repec:lan:wpaper:425 is not listed on IDEAS
    7. repec:lan:wpaper:539557 is not listed on IDEAS
    8. Yoichi Tsuchiya, 2021. "Thirty‐year assessment of Asian Development Bank's forecasts," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 35(2), pages 18-40, November.
    9. Katja Heinisch & Axel Lindner, 2019. "For how long do IMF forecasts of world economic growth stay up-to-date?," Applied Economics Letters, Taylor & Francis Journals, vol. 26(3), pages 255-260, February.
    10. Baghestani, Hamid & AbuAl-Foul, Bassam M., 2017. "Comparing Federal Reserve, Blue Chip, and time series forecasts of US output growth," Journal of Economics and Business, Elsevier, vol. 89(C), pages 47-56.
    11. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    12. Fritsche, Ulrich & Pierdzioch, Christian & Rülke, Jan-Christoph & Stadtmann, Georg, 2015. "Forecasting the Brazilian real and the Mexican peso: Asymmetric loss, forecast rationality, and forecaster herding," International Journal of Forecasting, Elsevier, vol. 31(1), pages 130-139.
    13. Bespalova, Olga, 2018. "Forecast Evaluation in Macroeconomics and International Finance. Ph.D. thesis, George Washington University, Washington, DC, USA," MPRA Paper 117706, University Library of Munich, Germany.
    14. Baghestani, Hamid & Toledo, Hugo, 2017. "Do analysts' forecasts of term spread differential help predict directional change in exchange rates?," International Review of Economics & Finance, Elsevier, vol. 47(C), pages 62-69.
    15. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    16. Yan Carrière-Swallow & José Marzluf, 2023. "Macrofinancial Causes of Optimism in Growth Forecasts," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 509-537, June.
    17. Hamid Baghestani, 2017. "Do US consumer survey data help beat the random walk in forecasting mortgage rates?," Cogent Economics & Finance, Taylor & Francis Journals, vol. 5(1), pages 1343017-134, January.
    18. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    19. Sandrine Lardic & Auguste Mpacko Priso, 1999. "Une comparaison des prévisions des experts à celles issues des modèles B VAR," Économie et Prévision, Programme National Persée, vol. 140(4), pages 161-180.
    20. Baghestani, Hamid & Toledo, Hugo, 2019. "Oil prices and real exchange rates in the NAFTA region," The North American Journal of Economics and Finance, Elsevier, vol. 48(C), pages 253-264.
    21. Baghestani, Hamid, 2011. "Federal Reserve and private forecasts of growth in investment," Journal of Economics and Business, Elsevier, vol. 63(4), pages 290-305, July.
    22. Xie, Zixiong & Hsu, Shih-Hsun, 2016. "Time varying biases and the state of the economy," International Journal of Forecasting, Elsevier, vol. 32(3), pages 716-725.
    23. Ash, J. C. K. & Smyth, D. J. & Heravi, S. M., 1998. "Are OECD forecasts rational and useful?: a directional analysis," International Journal of Forecasting, Elsevier, vol. 14(3), pages 381-391, September.
    24. Sanders, Dwight R. & Manfredo, Mark R., 2003. "USDA Livestock Price Forecasts: A Comprehensive Evaluation," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 28(2), pages 1-19, August.

    More about this item

    Keywords

    Forecast evaluation; Economic crisis; Trade Forecasts; Exchange rate forecasts; IMF Crisis Forecasts;
    All these keywords.

    JEL classification:

    • O19 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - International Linkages to Development; Role of International Organizations
    • O11 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Macroeconomic Analyses of Economic Development
    • F47 - International Economics - - Macroeconomic Aspects of International Trade and Finance - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:39:y:2023:i:4:p:1615-1639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.