IDEAS home Printed from https://ideas.repec.org/p/hal/wpaper/halshs-00450050.html
   My bibliography  Save this paper

How to evaluate an Early Warning System ?

Author

Listed:
  • Bertrand Candelon

    (LEO - Laboratoire d'économie d'Orleans [2008-2011] - UO - Université d'Orléans - CNRS - Centre National de la Recherche Scientifique)

  • Elena-Ivona Dumitrescu

    (LEO - Laboratoire d'économie d'Orleans [2008-2011] - UO - Université d'Orléans - CNRS - Centre National de la Recherche Scientifique)

  • Christophe Hurlin

    (LEO - Laboratoire d'économie d'Orleans [2008-2011] - UO - Université d'Orléans - CNRS - Centre National de la Recherche Scientifique)

Abstract

This paper proposes an original and uni ed toolbox to evaluate nancial crisis Early Warning Systems (EWS). It presents four main advantages. First, it is a model free method which can be used to asses the forecasts issued from di erent EWS (probit, logit, markov switching models, or combinations of models). Second, this toolbox can be applied to any type of crisis EWS (currency, banking, sovereign debt, etc.). Third, it does not only provide various criteria to evaluate the (absolute) validity of EWS forecasts but also proposes some tests to compare the relative performance of alternative EWS. Fourth, our toolbox can be used to evaluate both in-sample and out-of-sample forecasts. Applied to a logit model for twelve emerging countries we show that the yield spread is a key variable to predict currency crises exclusively for South-Asian countries. Besides, the optimal cut-o correctly allows us to identify now on average more than 2/3 of the crisis and calm periods.

Suggested Citation

  • Bertrand Candelon & Elena-Ivona Dumitrescu & Christophe Hurlin, 2012. "How to evaluate an Early Warning System ?," Working Papers halshs-00450050, HAL.
    • Handle: RePEc:hal:wpaper:halshs-00450050
    Note: View the original document on HAL open archive server: https://shs.hal.science/halshs-00450050v2
    as

    Download full text from publisher

    File URL: https://shs.hal.science/halshs-00450050v2/document
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kaminsky, Graciela L & Reinhart, Carmen M, 1998. "Financial Crises in Asia and Latin America: Then and Now," American Economic Review, American Economic Association, vol. 88(2), pages 444-448, May.
    2. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    3. Franc Klaassen, 2002. "Improving GARCH volatility forecasts with regime-switching GARCH," Empirical Economics, Springer, vol. 27(2), pages 363-394.
    4. Barry Eichengreen & Andrew K. Rose & Charles Wyplosz, 1996. "Contagious Currency Crises," NBER Working Papers 5681, National Bureau of Economic Research, Inc.
    5. Baillie, Richard T & Bollerslev, Tim, 2002. "The Message in Daily Exchange Rates: A Conditional-Variance Tale," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 60-68, January.
    6. Kaminsky, Graciela L. & Schmukler, Sergio L., 1999. "What triggers market jitters?: A chronicle of the Asian crisis," Journal of International Money and Finance, Elsevier, vol. 18(4), pages 537-560, August.
    7. Jeffrey D. Sachs & Aaron Tornell & Andrés Velasco, 1996. "Financial Crises in Emerging Markets: The Lessons from 1995," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 27(1), pages 147-216.
    8. Hali J. Edison, 2003. "Do indicators of financial crises work? An evaluation of an early warning system," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 8(1), pages 11-53.
    9. Graciela Kaminsky & Saul Lizondo & Carmen M. Reinhart, 1998. "Leading Indicators of Currency Crises," IMF Staff Papers, Palgrave Macmillan, vol. 45(1), pages 1-48, March.
    10. Eichengreen, Barry & Rose, Andrew K & Wyplosz, Charles, 1994. "Speculative Attacks on Pegged Exchange Rates: An Empirical Exploration with Special Reference to the European Monetary System," CEPR Discussion Papers 1060, C.E.P.R. Discussion Papers.
    11. Aaron Tornell, 1999. "Common Fundamentals in the Tequila and Asian Crises," Harvard Institute of Economic Research Working Papers 1868, Harvard - Institute of Economic Research.
    12. Parkinson, Michael, 1980. "The Extreme Value Method for Estimating the Variance of the Rate of Return," The Journal of Business, University of Chicago Press, vol. 53(1), pages 61-65, January.
    13. Laurent E. Calvet, 2004. "How to Forecast Long-Run Volatility: Regime Switching and the Estimation of Multifractal Processes," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 49-83.
    14. Nelson, Daniel B & Cao, Charles Q, 1992. "Inequality Constraints in the Univariate GARCH Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(2), pages 229-235, April.
    15. Corsetti, Giancarlo & Pesenti, Paolo & Roubini, Nouriel, 1999. "Paper tigers?: A model of the Asian crisis," European Economic Review, Elsevier, vol. 43(7), pages 1211-1236, June.
    16. Asger Lunde & Peter Reinhard Hansen, 2001. "A Forecast Comparison of Volatility Models: Does Anything Beat a GARCH(1,1)?," Working Papers 2001-04, Brown University, Department of Economics.
    17. Morris Goldstein & Graciela Kaminsky & Carmen Reinhart, 2017. "Methodology and Empirical Results," World Scientific Book Chapters, in: TRADE CURRENCIES AND FINANCE, chapter 11, pages 397-436, World Scientific Publishing Co. Pte. Ltd..
    18. Chou, Ray Yeutien, 2005. "Forecasting Financial Volatilities with Extreme Values: The Conditional Autoregressive Range (CARR) Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 561-582, June.
    19. Steven Radelet & Jeffrey D. Sachs, 1998. "The East Asian Financial Crisis: Diagnosis, Remedies, Prospects," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 29(1), pages 1-90.
    20. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    21. Kumar, Mohan & Moorthy, Uma & Perraudin, William, 2003. "Predicting emerging market currency crashes," Journal of Empirical Finance, Elsevier, vol. 10(4), pages 427-454, September.
    22. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    23. Gray, Stephen F., 1996. "Modeling the conditional distribution of interest rates as a regime-switching process," Journal of Financial Economics, Elsevier, vol. 42(1), pages 27-62, September.
    24. Frankel, Jeffrey A. & Rose, Andrew K., 1996. "Currency crashes in emerging markets: An empirical treatment," Journal of International Economics, Elsevier, vol. 41(3-4), pages 351-366, November.
    25. Susmel, Raul, 2000. "Switching Volatility in Private International Equity Markets," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 5(4), pages 265-283, October.
    26. Bussiere, Matthieu & Fratzscher, Marcel, 2006. "Towards a new early warning system of financial crises," Journal of International Money and Finance, Elsevier, vol. 25(6), pages 953-973, October.
    27. Cai, Jun, 1994. "A Markov Model of Switching-Regime ARCH," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(3), pages 309-316, July.
    28. Bera, Anil K & Higgins, Matthew L, 1993. "ARCH Models: Properties, Estimation and Testing," Journal of Economic Surveys, Wiley Blackwell, vol. 7(4), pages 305-366, December.
    29. Hamilton, James D. & Susmel, Raul, 1994. "Autoregressive conditional heteroskedasticity and changes in regime," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 307-333.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brunetti, Celso & Scotti, Chiara & Mariano, Roberto S. & Tan, Augustine H.H., 2008. "Markov switching GARCH models of currency turmoil in Southeast Asia," Emerging Markets Review, Elsevier, vol. 9(2), pages 104-128, June.
    2. Celso Brunetti & Roberto S. Mariano & Chiara Scotti & Augustine H. H. Tan, 2003. "Markov Switching Garch Models of Currency Crises in Southeast Asia," PIER Working Paper Archive 03-008, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    3. Ari, Ali, 2012. "Early warning systems for currency crises: The Turkish case," Economic Systems, Elsevier, vol. 36(3), pages 391-410.
    4. Pavel Trunin & M. Kamenskih, 2007. "Monitoring Financial Stability In Developing Economies (Case of Russia)," Research Paper Series, Gaidar Institute for Economic Policy, issue 111.
    5. Lin, Chin-Shien & Khan, Haider A. & Chang, Ruei-Yuan & Wang, Ying-Chieh, 2008. "A new approach to modeling early warning systems for currency crises: Can a machine-learning fuzzy expert system predict the currency crises effectively?," Journal of International Money and Finance, Elsevier, vol. 27(7), pages 1098-1121, November.
    6. Victor Yotzov, 2014. "Prognostic Power of Early Warning Signals for Financial Crises – Theoretical Approaches and Empirical Results," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 2, pages 3-38.
    7. Bussiere, Matthieu & Fratzscher, Marcel, 2006. "Towards a new early warning system of financial crises," Journal of International Money and Finance, Elsevier, vol. 25(6), pages 953-973, October.
    8. Mustapha Djennas & Mohamed Benbouziane & Meriem Djennas, 2011. "An Approach of Combining Empirical Mode Decomposition and Neural Network Learning for Currency Crisis Forecasting," Working Papers 627, Economic Research Forum, revised 09 Jan 2011.
    9. Mr. Abdul d Abiad, 2003. "Early Warning Systems: A Survey and a Regime-Switching Approach," IMF Working Papers 2003/032, International Monetary Fund.
    10. Bussiere, Matthieu & Fratzscher, Marcel, 2006. "Towards a new early warning system of financial crises," Journal of International Money and Finance, Elsevier, vol. 25(6), pages 953-973, October.
    11. Cumperayot, Phornchanok & Kouwenberg, Roy, 2013. "Early warning systems for currency crises: A multivariate extreme value approach," Journal of International Money and Finance, Elsevier, vol. 36(C), pages 151-171.
    12. Simone Bertoli & Giampiero Gallo & Giorgio Ricchiuti, 2010. "Exchange market pressure: some caveats in empirical applications," Applied Economics, Taylor & Francis Journals, vol. 42(19), pages 2435-2448.
    13. Ari, Ali, 2008. "An Early Warning Signals Approach for Currency Crises: The Turkish Case," MPRA Paper 25858, University Library of Munich, Germany, revised 2009.
    14. Jeffrey A. Frankel & George Saravelos, 2010. "Are Leading Indicators of Financial Crises Useful for Assessing Country Vulnerability? Evidence from the 2008-09 Global Crisis," NBER Working Papers 16047, National Bureau of Economic Research, Inc.
    15. Ahec Šonje, Amina & Babić, Ante & Mlinarević, Katarina, 2003. "Determinants of currency disturbances in transition economies of Central and Eastern Europe," MPRA Paper 83140, University Library of Munich, Germany, revised Mar 2003.
    16. Matthieu Bussière, 2013. "Balance of payment crises in emerging markets: how early were the ‘early’ warning signals?," Applied Economics, Taylor & Francis Journals, vol. 45(12), pages 1601-1623, April.
    17. repec:cuf:journl:y:2014:v:15:i:2:abiad is not listed on IDEAS
    18. Ali Ari & Raif Cergibozan, 2016. "A Comparison of Currency Crisis Dating Methods: Turkey 1990-2014," Montenegrin Journal of Economics, Economic Laboratory for Transition Research (ELIT), vol. 12(3), pages 19-37.
    19. Illing, Mark & Liu, Ying, 2006. "Measuring financial stress in a developed country: An application to Canada," Journal of Financial Stability, Elsevier, vol. 2(3), pages 243-265, October.
    20. Frankel, Jeffrey, 2010. "Monetary Policy in Emerging Markets," Handbook of Monetary Economics, in: Benjamin M. Friedman & Michael Woodford (ed.), Handbook of Monetary Economics, edition 1, volume 3, chapter 25, pages 1439-1520, Elsevier.
    21. Jeffrey A. Frankel & Shang-Jin Wei, 2004. "Managing Macroeconomic Crises," NBER Working Papers 10907, National Bureau of Economic Research, Inc.

    More about this item

    Keywords

    currency crisis; Early Warning System; credit-scoring; crise de change; Système d'Alerte Avancé;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:wpaper:halshs-00450050. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.