IDEAS home Printed from https://ideas.repec.org/a/pal/imfecr/v60y2012i1p75-113.html
   My bibliography  Save this article

How to Evaluate an Early-Warning System: Toward a Unified Statistical Framework for Assessing Financial Crises Forecasting Methods

Author

Listed:
  • Bertrand Candelon
  • Elena-Ivona Dumitrescu
  • Christophe Hurlin

Abstract

This paper proposes an original and unified toolbox to evaluate financial crisis early-warning systems (EWS). It presents four main advantages. First, it is a model free method which can be used to assess the forecasts issued from different EWS (probit, logit, Markov switching models, or combinations of models). Second, this toolbox can be applied to any type of crisis EWS (currency, banking, sovereign debt, and so on). Third, it does not only provide various criteria to evaluate the (absolute) validity of EWS forecasts but also proposes some tests to compare the relative performance of alternative EWS. Fourth, this toolbox can be used to evaluate both in-sample and out-of-sample forecasts. Applied to a logit model for 12 emerging countries we show that the yield spread is a key variable for predicting currency crises exclusively for South-Asian countries. Besides, the optimal cut-off correctly allows us to identify now on average more than 2/3 of the crisis and calm periods.

Suggested Citation

  • Bertrand Candelon & Elena-Ivona Dumitrescu & Christophe Hurlin, 2012. "How to Evaluate an Early-Warning System: Toward a Unified Statistical Framework for Assessing Financial Crises Forecasting Methods," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 60(1), pages 75-113, April.
  • Handle: RePEc:pal:imfecr:v:60:y:2012:i:1:p:75-113
    as

    Download full text from publisher

    File URL: http://www.palgrave-journals.com/imfer/journal/v60/n1/pdf/imfer20124a.pdf
    File Function: Link to full text PDF
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: http://www.palgrave-journals.com/imfer/journal/v60/n1/full/imfer20124a.html
    File Function: Link to full text HTML
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sarlin, Peter, 2013. "On policymakers’ loss functions and the evaluation of early warning systems," Economics Letters, Elsevier, vol. 119(1), pages 1-7.
    2. António R. Antunes & Diana Bonfim & Nuno Monteiro & Paulo M.M. Rodrigues, 2016. "Forecasting banking crises with dynamic panel probit models," Working Papers w201613, Banco de Portugal, Economics and Research Department.
    3. Candelon, Bertrand & Dumitrescu, Elena-Ivona & Hurlin, Christophe, 2014. "Currency crisis early warning systems: Why they should be dynamic," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1016-1029.
    4. Ahmed, Jameel & Straetmans, Stefan, 2015. "Predicting exchange rate cycles utilizing risk factors," Journal of Empirical Finance, Elsevier, vol. 34(C), pages 112-130.
    5. repec:mje:mjejnl:v:12:y:2016:i:3:p:19-37 is not listed on IDEAS
    6. Danielsson, Jon & Valenzuela, Marcela & Zer, Ilknur, 2016. "Learning from history: volatility and financial crises," LSE Research Online Documents on Economics 66046, London School of Economics and Political Science, LSE Library.
    7. Fabio Comelli, 2014. "Comparing Parametric and Non-parametric Early Warning Systems for Currency Crises in Emerging Market Economies," Review of International Economics, Wiley Blackwell, vol. 22(4), pages 700-721, September.
    8. Pablo Hernández de Cos & Enrique Moral-Benito & Gerrit B. Koester & Christiane Nickel, 2014. "Signalling fiscal stress in the euro area: A country-specific early warning system," Working Papers 1418, Banco de España;Working Papers Homepage.
    9. Ryota Nakatani, 2014. "The Effects of Financial and Real Shocks, Structural Vulnerability and Monetary Policy on Exchange Rates from the Perspective of Currency Crises Models," UTokyo Price Project Working Paper Series 043, University of Tokyo, Graduate School of Economics.
    10. Xavier De Scheemaekere & Kim Oosterlinck & Ariane Szafarz, 2014. "Issues in Identifying Economic Crises: Insights from History," Working Papers CEB 14-014, ULB -- Universite Libre de Bruxelles.
    11. Qin, Xiao & Liu, Liya, 2014. "Extremes, return level and identification of currency crises," Economic Modelling, Elsevier, vol. 37(C), pages 439-450.
    12. repec:mes:emfitr:v:53:y:2017:i:11:p:2545-2561 is not listed on IDEAS
    13. Ons Jedidi & Jean-Sébastien Pentecôte, 2015. "Prédire les crises bancaires : un système d’alerte robuste," Revue française d'économie, Presses de Sciences-Po, vol. 0(3), pages 189-225.
    14. Fabio Comelli, 2013. "Comparing Parametric and Non-parametric Early Warning Systems for Currency Crises in Emerging Market Economies," IMF Working Papers 13/134, International Monetary Fund.
    15. Fabio Comelli, 2014. "Comparing the Performance of Logit and Probit Early Warning Systems for Currency Crises in Emerging Market Economies," IMF Working Papers 14/65, International Monetary Fund.
    16. Yanping Zhao & Jakob Haan & Bert Scholtens & Haizhen Yang, 2014. "Leading Indicators of Currency Crises: Are They the Same in Different Exchange Rate Regimes?," Open Economies Review, Springer, vol. 25(5), pages 937-957, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:imfecr:v:60:y:2012:i:1:p:75-113. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Rebekah McClure). General contact details of provider: http://www.palgrave-journals.com/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.