IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/421.html
   My bibliography  Save this paper

Evaluating early warning indicators of banking crises: Satisfying policy requirements

Author

Listed:
  • Mathias Drehmann

Abstract

Early warning indicators (EWIs) of banking crises should ideally be evaluated on the basis of their performance relative to the macroprudential policy maker's decision problem. We translate several practical aspects of this problem - such as difficulties in assessing the costs and benefits of various policy measures as well as requirements for the timing and stability of EWIs - into statistical evaluation criteria. Applying the criteria to a set of potential EWIs, we find that the credit-to-GDP gap and a new indicator, the debt service ratio (DSR), consistently outperform other measures. The credit-to-GDP gap is the best indicator at longer horizons, whereas the DSR dominates at shorter horizons.

Suggested Citation

  • Mathias Drehmann, 2013. "Evaluating early warning indicators of banking crises: Satisfying policy requirements," BIS Working Papers 421, Bank for International Settlements.
  • Handle: RePEc:bis:biswps:421
    as

    Download full text from publisher

    File URL: http://www.bis.org/publ/work421.pdf
    File Function: Full PDF document
    Download Restriction: no

    File URL: http://www.bis.org/publ/work421.htm
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Granger, Clive W.J. & Machina, Mark J., 2006. "Forecasting and Decision Theory," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 2, pages 81-98, Elsevier.
    2. Carmen M. Reinhart & Kenneth S. Rogoff, 2009. "Varieties of Crises and Their Dates," Introductory Chapters, in: This Time Is Different: Eight Centuries of Financial Folly, Princeton University Press.
    3. Joon Y. Park & Peter C. B. Phillips, 2000. "Nonstationary Binary Choice," Econometrica, Econometric Society, vol. 68(5), pages 1249-1280, September.
    4. Claudio Borio, 2011. "Implementing the Macroprudential Approach to Financial Regulation and Supervision," Chapters, in: Christopher J. Green & Eric J. Pentecost & Tom Weyman-Jones (ed.), The Financial Crisis and the Regulation of Finance, chapter 7, Edward Elgar Publishing.
    5. Cohen, Jacqueline & Garman, Samuel & Gorr, Wilpen, 2009. "Empirical calibration of time series monitoring methods using receiver operating characteristic curves," International Journal of Forecasting, Elsevier, vol. 25(3), pages 484-497, July.
    6. Travis J. Berge & Òscar Jordà, 2011. "Evaluating the Classification of Economic Activity into Recessions and Expansions," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(2), pages 246-277, April.
    7. Santiago Fernandez de Lis & Alicia Garcia-Herrero, 2013. "Dynamic Provisioning: A Buffer Rather Than a Countercyclical Tool?," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Spring 20), pages 35-67, January.
    8. Bussiere, Matthieu & Fratzscher, Marcel, 2006. "Towards a new early warning system of financial crises," Journal of International Money and Finance, Elsevier, vol. 25(6), pages 953-973, October.
    9. Joon-Ho Hahm & Hyun Song Shin & Kwanho Shin, 2013. "Noncore Bank Liabilities and Financial Vulnerability," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45, pages 3-36, August.
    10. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    11. Reinhart, Karmen & Rogoff, Kenneth, 2009. ""This time is different": panorama of eight centuries of financial crises," Economic Policy, Russian Presidential Academy of National Economy and Public Administration, vol. 1, pages 77-114, March.
    12. Andrews, Donald W K & Chen, Hong-Yuan, 1994. "Approximately Median-Unbiased Estimation of Autoregressive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(2), pages 187-204, April.
    13. Pierre-Olivier Gourinchas & Maurice Obstfeld, 2012. "Stories of the Twentieth Century for the Twenty-First," American Economic Journal: Macroeconomics, American Economic Association, vol. 4(1), pages 226-265, January.
    14. Claudio Borio & Mathias Drehmann, 2009. "Assessing the risk of banking crises - revisited," BIS Quarterly Review, Bank for International Settlements, March.
    15. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    16. Mathias Drehmann & Mikael Juselius, 2012. "Do debt service costs affect macroeconomic and financial stability?," BIS Quarterly Review, Bank for International Settlements, September.
    17. Carmen M. Reinhart & Kenneth S. Rogoff, 2014. "This Time is Different: A Panoramic View of Eight Centuries of Financial Crises," Annals of Economics and Finance, Society for AEF, vol. 15(2), pages 215-268, November.
    18. Orphanides, Athanasios, 2003. "Monetary policy evaluation with noisy information," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 605-631, April.
    19. Stuart G. Baker, 2000. "Identifying Combinations of Cancer Markers for Further Study as Triggers of Early Intervention," Biometrics, The International Biometric Society, vol. 56(4), pages 1082-1087, December.
    20. Elliott, Graham & Lieli, Robert P., 2013. "Predicting binary outcomes," Journal of Econometrics, Elsevier, vol. 174(1), pages 15-26.
    21. Claudio Borio & Patrick McGuire, 2004. "Twin peaks in equity and housing prices?," BIS Quarterly Review, Bank for International Settlements, March.
    22. Baker, Stuart G. & Kramer, Barnett S., 2007. "Peirce, Youden, and Receiver Operating Characteristic Curves," The American Statistician, American Statistical Association, vol. 61, pages 343-346, November.
    23. Sinan Gönül & Dilek Önkal & Paul Goodwin, 2009. "Expectations, use and judgmental adjustment of external financial and economic forecasts: an empirical investigation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 19-37.
    24. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    25. Christian Dembiermont & Mathias Drehmann & Siriporn Muksakunratana, 2013. "How much does the private sector really borrow - a new database for total credit to the private non-financial sector," BIS Quarterly Review, Bank for International Settlements, March.
    26. Margaret S. Pepe & Gary Longton & Holly Janes, 2009. "Estimation and comparison of receiver operating characteristic curves," Stata Journal, StataCorp LP, vol. 9(1), pages 1-16, March.
    27. Claudio Borio & Philip Lowe, 2002. "Assessing the risk of banking crises," BIS Quarterly Review, Bank for International Settlements, December.
    28. Òscar Jordà & Moritz Schularick & Alan M Taylor, 2011. "Financial Crises, Credit Booms, and External Imbalances: 140 Years of Lessons," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 59(2), pages 340-378, June.
    29. Rochelle M. Edge & Ralf R. Meisenzahl, 2011. "The unreliability of credit-to-GDP ratio gaps in real-time: Implications for countercyclical capital buffers," Finance and Economics Discussion Series 2011-37, Board of Governors of the Federal Reserve System (U.S.).
    30. Morten O. Ravn & Harald Uhlig, 2002. "On adjusting the Hodrick-Prescott filter for the frequency of observations," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 371-375.
    31. Mathias Drehmann & Claudio Borio & Kostas Tsatsaronis, 2011. "Anchoring Countercyclical Capital Buffers: The role of Credit Aggregates," International Journal of Central Banking, International Journal of Central Banking, vol. 7(4), pages 189-240, December.
    32. Mr. Luc Laeven & Mr. Fabian Valencia, 2012. "Systemic Banking Crises Database: An Update," IMF Working Papers 2012/163, International Monetary Fund.
    33. Martin W. McIntosh & Margaret Sullivan Pepe, 2002. "Combining Several Screening Tests: Optimality of the Risk Score," Biometrics, The International Biometric Society, vol. 58(3), pages 657-664, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alessi, Lucia & Detken, Carsten, 2018. "Identifying excessive credit growth and leverage," Journal of Financial Stability, Elsevier, vol. 35(C), pages 215-225.
    2. Yildirim, Yusuf & Sanyal, Anirban, 2022. "Evaluating the Effectiveness of Early Warning Indicators: An Application of Receiver Operating Characteristic Curve Approach to Panel Data," MPRA Paper 112079, University Library of Munich, Germany.
    3. André K. Anundsen & Karsten Gerdrup & Frank Hansen & Kasper Kragh‐Sørensen, 2016. "Bubbles and Crises: The Role of House Prices and Credit," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1291-1311, November.
    4. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    5. Jon Danielsson & Marcela Valenzuela & Ilknur Zer, 2018. "Learning from History: Volatility and Financial Crises," Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2774-2805.
    6. Mathias Drehmann & Kostas Tsatsaronis, 2014. "The credit-to-GDP gap and countercyclical capital buffers: questions and answers," BIS Quarterly Review, Bank for International Settlements, March.
    7. Mathias Drehmann, 2013. "Total credit as an early warning indicator for systemic banking crises," BIS Quarterly Review, Bank for International Settlements, June.
    8. Schudel, Willem, 2015. "Shifting horizons: assessing macro trends before, during, and following systemic banking crises," Working Paper Series 1766, European Central Bank.
    9. Gertler, Pavel & Hofmann, Boris, 2018. "Monetary facts revisited," Journal of International Money and Finance, Elsevier, vol. 86(C), pages 154-170.
    10. Geršl, Adam & Jašová, Martina, 2018. "Credit-based early warning indicators of banking crises in emerging markets," Economic Systems, Elsevier, vol. 42(1), pages 18-31.
    11. Bordo, M.D. & Meissner, C.M., 2016. "Fiscal and Financial Crises," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 355-412, Elsevier.
    12. Kauko, Karlo, 2014. "How to foresee banking crises? A survey of the empirical literature," Economic Systems, Elsevier, vol. 38(3), pages 289-308.
    13. Hartwig, Benny & Meinerding, Christoph & Schüler, Yves S., 2021. "Identifying indicators of systemic risk," Journal of International Economics, Elsevier, vol. 132(C).
    14. Cesa-Bianchi, Ambrogio & Eguren Martin, Fernando & Thwaites, Gregory, 2019. "Foreign booms, domestic busts: The global dimension of banking crises," Journal of Financial Intermediation, Elsevier, vol. 37(C), pages 58-74.
    15. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2019. "Does machine learning help us predict banking crises?," Journal of Financial Stability, Elsevier, vol. 45(C).
    16. Ebrahimi Kahou, Mahdi & Lehar, Alfred, 2017. "Macroprudential policy: A review," Journal of Financial Stability, Elsevier, vol. 29(C), pages 92-105.
    17. Mathias Drehmann & James Yetman, 2021. "Which Credit Gap Is Better at Predicting Financial Crises? A Comparison of Univariate Filters," International Journal of Central Banking, International Journal of Central Banking, vol. 17(70), pages 1-31, October.
    18. Catão, Luis A.V. & Milesi-Ferretti, Gian Maria, 2014. "External liabilities and crises," Journal of International Economics, Elsevier, vol. 94(1), pages 18-32.
    19. Eberhardt, Markus & Presbitero, Andrea F., 2021. "Commodity prices and banking crises," Journal of International Economics, Elsevier, vol. 131(C).
    20. Tölö, Eero, 2020. "Predicting systemic financial crises with recurrent neural networks," Journal of Financial Stability, Elsevier, vol. 49(C).

    More about this item

    Keywords

    EWIs; ROC; area under the curve; macroprudential policy;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:421. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christian Beslmeisl (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.