IDEAS home Printed from https://ideas.repec.org/a/eee/ecosys/v33y2009i4p376-388.html
   My bibliography  Save this article

How reliable are forecasts of GDP growth and inflation for countries with limited coverage?

Author

Listed:
  • Krkoska, Libor
  • Teksoz, Utku

Abstract

This paper analyses the performance of GDP growth and inflation forecasts for 25 transition countries between 1994 and 2007, as provided by 13 international institutions, including multilateral, private and academic forecasters. The empirical results show that there is a positive correlation between the number of forecasters covering a given country and the forecast accuracy. Simple combined forecasts are shown to be unbiased and more accurate than most of the individual forecasters, although also inefficient. However, only a few institutions provide efficient and unbiased forecasts, with just one out of 13 forecasters providing both unbiased and efficient forecasts of both GDP growth and inflation in the observed period. The directional analysis shows a correct forecast of the change in the forecast indicator in over two thirds of cases. However, the eventual outcome is within the range of available forecasts in less than half of the cases, with more than 40% of outcomes for GDP growth above the highest forecast. Encouragingly, forecasts are shown to be improving over time and becoming more accurate with the increase in the number of forecasting institutions - forecast accuracy measured by mean absolute error improves by 0.3 percentage points for growth and by 0.2 percentage points for inflation for each additional institution providing forecasts.

Suggested Citation

  • Krkoska, Libor & Teksoz, Utku, 2009. "How reliable are forecasts of GDP growth and inflation for countries with limited coverage?," Economic Systems, Elsevier, vol. 33(4), pages 376-388, December.
  • Handle: RePEc:eee:ecosys:v:33:y:2009:i:4:p:376-388
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0939-3625(09)00042-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    2. Pesaran, M Hashem & Timmermann, Allan, 1992. "A Simple Nonparametric Test of Predictive Performance," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 561-565, October.
    3. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    4. Ash, J. C. K. & Smyth, D. J. & Heravi, S. M., 1990. "The accuracy of OECD forecasts of the international economy : Demand, output and prices," International Journal of Forecasting, Elsevier, vol. 6(3), pages 379-392, October.
    5. Loungani, Prakash, 2001. "How accurate are private sector forecasts? Cross-country evidence from consensus forecasts of output growth," International Journal of Forecasting, Elsevier, vol. 17(3), pages 419-432.
    6. Krkoska, Libor & Teksoz, Utku, 2007. "Accuracy of GDP growth forecasts for transition countries: Ten years of forecasting assessed," International Journal of Forecasting, Elsevier, vol. 23(1), pages 29-45.
    7. Mr. Allan Timmermann, 2006. "An Evaluation of the World Economic Outlook Forecasts," IMF Working Papers 2006/059, International Monetary Fund.
    8. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    9. Vassiliki Koutsogeorgopoulou, 2000. "A Post-Mortem on Economic Outlook Projections," OECD Economics Department Working Papers 274, OECD Publishing.
    10. Ash, J. C. K. & Smyth, D. J. & Heravi, S. M., 1998. "Are OECD forecasts rational and useful?: a directional analysis," International Journal of Forecasting, Elsevier, vol. 14(3), pages 381-391, September.
    11. Roy Batchelor, 2001. "How useful are the forecasts of intergovernmental agencies? The IMF and OECD versus the consensus," Applied Economics, Taylor & Francis Journals, vol. 33(2), pages 225-235.
    12. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    13. Harvey, David I. & Newbold, Paul, 2003. "The non-normality of some macroeconomic forecast errors," International Journal of Forecasting, Elsevier, vol. 19(4), pages 635-653.
    14. Roy Batchelor & Pami Dua, 1995. "Forecaster Diversity and the Benefits of Combining Forecasts," Management Science, INFORMS, vol. 41(1), pages 68-75, January.
    15. Mr. Michael J. Artis, 1996. "How Accurate Are the Imf's Short-Term Forecasts? Another Examination of the World Economic Outlook," IMF Working Papers 1996/089, International Monetary Fund.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dušan Marković & Igor Mladenović & Miloš Milovančević, 2017. "RETRACTED ARTICLE: Estimation of the most influential science and technology factors for economic growth forecasting by soft computing technique," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(3), pages 1133-1146, May.
    2. Chen, Qiwei & Costantini, Mauro & Deschamps, Bruno, 2016. "How accurate are professional forecasts in Asia? Evidence from ten countries," International Journal of Forecasting, Elsevier, vol. 32(1), pages 154-167.
    3. Sokolov-Mladenović, Svetlana & Milovančević, Milos & Mladenović, Igor, 2017. "Evaluation of trade influence on economic growth rate by computational intelligence approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 358-362.
    4. Petra Karanikić & Igor Mladenović & Svetlana Sokolov-Mladenović & Meysam Alizamir, 2017. "RETRACTED ARTICLE: Prediction of economic growth by extreme learning approach based on science and technology transfer," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(3), pages 1395-1401, May.
    5. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    6. Marković, Dušan & Petković, Dalibor & Nikolić, Vlastimir & Milovančević, Miloš & Petković, Biljana, 2017. "Soft computing prediction of economic growth based in science and technology factors," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 217-220.
    7. Talavera, Oleksandr & Tsapin, Andriy & Zholud, Oleksandr, 2012. "Macroeconomic uncertainty and bank lending: The case of Ukraine," Economic Systems, Elsevier, vol. 36(2), pages 279-293.
    8. Maksimović, Goran & Milosavljević, Valentina & Ćirković, Bratislav & Milošević, Božidar & Jović, Srđan & Alizamir, Meysam, 2017. "Analyzing of economic growth based on electricity consumption from different sources," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 484(C), pages 37-40.
    9. Đokić, Aleksandar & Jović, Srđan, 2017. "Evaluation of agriculture and industry effect on economic health by ANFIS approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 396-399.
    10. Kordanuli, Bojana & Barjaktarović, Lidija & Jeremić, Ljiljana & Alizamir, Meysam, 2017. "Appraisal of artificial neural network for forecasting of economic parameters," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 515-519.
    11. Yoichi Tsuchiya, 2021. "Thirty‐year assessment of Asian Development Bank's forecasts," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 35(2), pages 18-40, November.
    12. Milačić, Ljubiša & Jović, Srđan & Vujović, Tanja & Miljković, Jovica, 2017. "Application of artificial neural network with extreme learning machine for economic growth estimation," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 285-288.
    13. Igor Mladenović & Miloš Milovančević & Svetlana Sokolov-Mladenović, 2017. "RETRACTED ARTICLE: Analyzing of innovations influence on economic growth by fuzzy system," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(3), pages 1297-1304, May.
    14. Maksimović, Goran & Jović, Srđan & Jovanović, Radomir, 2017. "Economic growth rate management by soft computing approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 465(C), pages 520-524.
    15. de Mendonça, Helder Ferreira & de Deus, Joseph David Barroso Vasconcelos, 2019. "Central bank forecasts and private expectations: An empirical assessment from three emerging economies," Economic Modelling, Elsevier, vol. 83(C), pages 234-244.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Krkoska, Libor & Teksoz, Utku, 2007. "Accuracy of GDP growth forecasts for transition countries: Ten years of forecasting assessed," International Journal of Forecasting, Elsevier, vol. 23(1), pages 29-45.
    2. Yoichi Tsuchiya, 2021. "Thirty‐year assessment of Asian Development Bank's forecasts," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 35(2), pages 18-40, November.
    3. Gultekin Isiklar & Kajal Lahiri & Prakash Loungani, 2006. "How quickly do forecasters incorporate news? Evidence from cross‐country surveys," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(6), pages 703-725, September.
    4. Ullrich Heilemann & Karsten Müller, 2018. "Wenig Unterschiede – Zur Treffsicherheit Internationaler Prognosen und Prognostiker [Few differences—on the accuracy of international forecasts and forecaster]," AStA Wirtschafts- und Sozialstatistisches Archiv, Springer;Deutsche Statistische Gesellschaft - German Statistical Society, vol. 12(3), pages 195-233, December.
    5. Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
    6. Ashiya, Masahiro, 2007. "Forecast accuracy of the Japanese government: Its year-ahead GDP forecast is too optimistic," Japan and the World Economy, Elsevier, vol. 19(1), pages 68-85, January.
    7. Vuchelen, Jef & Gutierrez, Maria-Isabel, 2005. "A direct test of the information content of the OECD growth forecasts," International Journal of Forecasting, Elsevier, vol. 21(1), pages 103-117.
    8. Masahiro Ashiya, 2006. "Testing the rationality of forecast revisions made by the IMF and the OECD," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 25-36.
    9. H.O. Stekler & Huixia Zhang, 2013. "An evaluation of Chinese economic forecasts," Journal of Chinese Economic and Business Studies, Taylor & Francis Journals, vol. 11(4), pages 251-259, November.
    10. Herman O. Stekler, 2008. "What Do We Know About G-7 Macro Forecasts?," Working Papers 2008-009, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    11. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    12. Ager, P. & Kappler, M. & Osterloh, S., 2009. "The accuracy and efficiency of the Consensus Forecasts: A further application and extension of the pooled approach," International Journal of Forecasting, Elsevier, vol. 25(1), pages 167-181.
    13. Mr. Martin Mühleisen & Ms. Kornelia Krajnyak & Mr. Stephan Danninger & Mr. David Hauner & Mr. Bennett W Sutton, 2005. "How Do Canadian Budget Forecasts Compare with Those of Other Industrial Countries?," IMF Working Papers 2005/066, International Monetary Fund.
    14. Mihaela SIMIONESCU, 2014. "Improving The Inflation Rate Forecasts Of Romanian Experts Using A Fixed-Effects Models Approach," Review of Economic and Business Studies, Alexandru Ioan Cuza University, Faculty of Economics and Business Administration, issue 13, pages 87-102, June.
    15. Ildeberta Abreu, 2011. "International organisations’ vs. private analysts’ forecasts: an evaluation," Working Papers w201120, Banco de Portugal, Economics and Research Department.
    16. Mitchell, Karlyn & Pearce, Douglas K., 2007. "Professional forecasts of interest rates and exchange rates: Evidence from the Wall Street Journal's panel of economists," Journal of Macroeconomics, Elsevier, vol. 29(4), pages 840-854, December.
    17. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    18. Grant Allan, 2012. "Evaluating the usefulness of forecasts of relative growth," Working Papers 1214, University of Strathclyde Business School, Department of Economics.
    19. Xie, Zixiong & Hsu, Shih-Hsun, 2016. "Time varying biases and the state of the economy," International Journal of Forecasting, Elsevier, vol. 32(3), pages 716-725.
    20. Jef Vuchelen & Maria-Isabel Gutierrez, 2005. "Do the OECD 24 month horizon growth forecasts for the G7-countries contain information?," Applied Economics, Taylor & Francis Journals, vol. 37(8), pages 855-862.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosys:v:33:y:2009:i:4:p:376-388. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://edirc.repec.org/data/osteide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.