IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/421.html
   My bibliography  Save this paper

Evaluating early warning indicators of banking crises: Satisfying policy requirements

Author

Listed:
  • Mathias Drehmann

Abstract

Early warning indicators (EWIs) of banking crises should ideally be evaluated on the basis of their performance relative to the macroprudential policy maker's decision problem. We translate several practical aspects of this problem - such as difficulties in assessing the costs and benefits of various policy measures as well as requirements for the timing and stability of EWIs - into statistical evaluation criteria. Applying the criteria to a set of potential EWIs, we find that the credit-to-GDP gap and a new indicator, the debt service ratio (DSR), consistently outperform other measures. The credit-to-GDP gap is the best indicator at longer horizons, whereas the DSR dominates at shorter horizons.

Suggested Citation

  • Mathias Drehmann, 2013. "Evaluating early warning indicators of banking crises: Satisfying policy requirements," BIS Working Papers 421, Bank for International Settlements.
    • Handle: RePEc:bis:biswps:421
    as

    Download full text from publisher

    File URL: http://www.bis.org/publ/work421.pdf
    File Function: Full PDF document
    Download Restriction: no
    File URL: http://www.bis.org/publ/work421.htm
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Claudio Borio, 2011. "Implementing the Macroprudential Approach to Financial Regulation and Supervision," Chapters, in: Christopher J. Green & Eric J. Pentecost & Tom Weyman-Jones (ed.), The Financial Crisis and the Regulation of Finance, chapter 7, Edward Elgar Publishing.
    2. Andrews, Donald W K & Chen, Hong-Yuan, 1994. "Approximately Median-Unbiased Estimation of Autoregressive Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(2), pages 187-204, April.
    3. Carmen M. Reinhart & Kenneth S. Rogoff, 2014. "This Time is Different: A Panoramic View of Eight Centuries of Financial Crises," Annals of Economics and Finance, Society for AEF, vol. 15(2), pages 215-268, November.
    4. Carmen M. Reinhart & Graciela L. Kaminsky, 1999. "The Twin Crises: The Causes of Banking and Balance-of-Payments Problems," American Economic Review, American Economic Association, vol. 89(3), pages 473-500, June.
    5. Carmen M. Reinhart & Kenneth S. Rogoff, 2009. "Varieties of Crises and Their Dates," Introductory Chapters, in: This Time Is Different: Eight Centuries of Financial Folly, Princeton University Press.
    6. Baker, Stuart G. & Kramer, Barnett S., 2007. "Peirce, Youden, and Receiver Operating Characteristic Curves," The American Statistician, American Statistical Association, vol. 61, pages 343-346, November.
    7. Sinan Gönül & Dilek Önkal & Paul Goodwin, 2009. "Expectations, use and judgmental adjustment of external financial and economic forecasts: an empirical investigation," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(1), pages 19-37.
    8. Christian Dembiermont & Mathias Drehmann & Siriporn Muksakunratana, 2013. "How much does the private sector really borrow - a new database for total credit to the private non-financial sector," BIS Quarterly Review, Bank for International Settlements, March.
    9. Rochelle M. Edge & Ralf R. Meisenzahl, 2011. "The unreliability of credit-to-GDP ratio gaps in real-time: Implications for countercyclical capital buffers," Finance and Economics Discussion Series 2011-37, Board of Governors of the Federal Reserve System (U.S.).
    10. Òscar Jordà & Moritz Schularick & Alan M Taylor, 2011. "Financial Crises, Credit Booms, and External Imbalances: 140 Years of Lessons," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 59(2), pages 340-378, June.
    11. Morten O. Ravn & Harald Uhlig, 2002. "On adjusting the Hodrick-Prescott filter for the frequency of observations," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 371-375.
    12. Joon-Ho Hahm & Hyun Song Shin & Kwanho Shin, 2013. "Noncore Bank Liabilities and Financial Vulnerability," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 45, pages 3-36, August.
    13. Mathias Drehmann & Mikael Juselius, 2012. "Do debt service costs affect macroeconomic and financial stability?," BIS Quarterly Review, Bank for International Settlements, September.
    14. Orphanides, Athanasios, 2003. "Monetary policy evaluation with noisy information," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 605-631, April.
    15. Stuart G. Baker, 2000. "Identifying Combinations of Cancer Markers for Further Study as Triggers of Early Intervention," Biometrics, The International Biometric Society, vol. 56(4), pages 1082-1087, December.
    16. Margaret S. Pepe & Gary Longton & Holly Janes, 2009. "Estimation and comparison of receiver operating characteristic curves," Stata Journal, StataCorp LP, vol. 9(1), pages 1-16, March.
    17. Pierre-Olivier Gourinchas & Maurice Obstfeld, 2012. "Stories of the Twentieth Century for the Twenty-First," American Economic Journal: Macroeconomics, American Economic Association, vol. 4(1), pages 226-265, January.
    18. Mathias Drehmann & Claudio Borio & Kostas Tsatsaronis, 2011. "Anchoring Countercyclical Capital Buffers: The role of Credit Aggregates," International Journal of Central Banking, International Journal of Central Banking, vol. 7(4), pages 189-240, December.
    19. Mr. Fabian Valencia & Mr. Luc Laeven, 2012. "Systemic Banking Crises Database: An Update," IMF Working Papers 2012/163, International Monetary Fund.
    20. Martin W. McIntosh & Margaret Sullivan Pepe, 2002. "Combining Several Screening Tests: Optimality of the Risk Score," Biometrics, The International Biometric Society, vol. 58(3), pages 657-664, September.
    21. Santiago Fernandez de Lis & Alicia Garcia-Herrero, 2013. "Dynamic Provisioning: A Buffer Rather Than a Countercyclical Tool?," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Spring 20), pages 35-67, January.
    22. Elliott, Graham & Lieli, Robert P., 2013. "Predicting binary outcomes," Journal of Econometrics, Elsevier, vol. 174(1), pages 15-26.
    23. Claudio Borio & Patrick McGuire, 2004. "Twin peaks in equity and housing prices?," BIS Quarterly Review, Bank for International Settlements, March.
    24. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    25. Granger, Clive W.J. & Machina, Mark J., 2006. "Forecasting and Decision Theory," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 2, pages 81-98, Elsevier.
    26. Joon Y. Park & Peter C. B. Phillips, 2000. "Nonstationary Binary Choice," Econometrica, Econometric Society, vol. 68(5), pages 1249-1280, September.
    27. Cohen, Jacqueline & Garman, Samuel & Gorr, Wilpen, 2009. "Empirical calibration of time series monitoring methods using receiver operating characteristic curves," International Journal of Forecasting, Elsevier, vol. 25(3), pages 484-497, July.
    28. Travis J. Berge & Òscar Jordà, 2011. "Evaluating the Classification of Economic Activity into Recessions and Expansions," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(2), pages 246-277, April.
    29. Rochelle M. Edge & Ralf R. Meisenzahl, 2011. "The Unreliability of Credit-to-GDP Ratio Gaps in Real Time: Implications for Countercyclical Capital Buffers," International Journal of Central Banking, International Journal of Central Banking, vol. 7(4), pages 261-298, December.
    30. Bussiere, Matthieu & Fratzscher, Marcel, 2006. "Towards a new early warning system of financial crises," Journal of International Money and Finance, Elsevier, vol. 25(6), pages 953-973, October.
    31. Claudio Borio & Mathias Drehmann, 2009. "Assessing the risk of banking crises - revisited," BIS Quarterly Review, Bank for International Settlements, March.
    32. Claudio Borio & Philip Lowe, 2002. "Assessing the risk of banking crises," BIS Quarterly Review, Bank for International Settlements, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alessi, Lucia & Detken, Carsten, 2018. "Identifying excessive credit growth and leverage," Journal of Financial Stability, Elsevier, vol. 35(C), pages 215-225.
    2. Mathias Drehmann & Kostas Tsatsaronis, 2014. "The credit-to-GDP gap and countercyclical capital buffers: questions and answers," BIS Quarterly Review, Bank for International Settlements, March.
    3. Yusuf Yıldırım & Anirban Sanyal, 2022. "Evaluating the Effectiveness of Early Warning Indicators: An Application of Receiver Operating Characteristic Curve Approach to Panel Data," Scientific Annals of Economics and Business (continues Analele Stiintifice), Alexandru Ioan Cuza University, Faculty of Economics and Business Administration, vol. 69(4), pages 557-597, December.
    4. André K. Anundsen & Karsten Gerdrup & Frank Hansen & Kasper Kragh‐Sørensen, 2016. "Bubbles and Crises: The Role of House Prices and Credit," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1291-1311, November.
    5. Mathias Drehmann & James Yetman, 2021. "Which Credit Gap Is Better at Predicting Financial Crises? A Comparison of Univariate Filters," International Journal of Central Banking, International Journal of Central Banking, vol. 17(70), pages 1-31, October.
    6. Schudel, Willem, 2015. "Shifting horizons: assessing macro trends before, during, and following systemic banking crises," Working Paper Series 1766, European Central Bank.
    7. Jon Danielsson & Marcela Valenzuela & Ilknur Zer, 2018. "Learning from History: Volatility and Financial Crises," The Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2774-2805.
    8. Geršl, Adam & Jašová, Martina, 2018. "Credit-based early warning indicators of banking crises in emerging markets," Economic Systems, Elsevier, vol. 42(1), pages 18-31.
    9. Mathias Drehmann, 2013. "Total credit as an early warning indicator for systemic banking crises," BIS Quarterly Review, Bank for International Settlements, June.
    10. Xianglong Liu, 2023. "Towards Better Banking Crisis Prediction: Could an Automatic Variable Selection Process Improve the Performance?," The Economic Record, The Economic Society of Australia, vol. 99(325), pages 288-312, June.
    11. Antunes, António & Bonfim, Diana & Monteiro, Nuno & Rodrigues, Paulo M.M., 2018. "Forecasting banking crises with dynamic panel probit models," International Journal of Forecasting, Elsevier, vol. 34(2), pages 249-275.
    12. Ebrahimi Kahou, Mahdi & Lehar, Alfred, 2017. "Macroprudential policy: A review," Journal of Financial Stability, Elsevier, vol. 29(C), pages 92-105.
    13. Markus Behn & Carsten Detken & Tuomas Peltonen & Willem Schudel, 2017. "Predicting Vulnerabilities in the EU Banking Sector: The Role of Global and Domestic Factors," International Journal of Central Banking, International Journal of Central Banking, vol. 13(4), pages 147-189, December.
    14. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    15. Detken, Carsten & Peltonen, Tuomas A. & Schudel, Willem & Behn, Markus, 2013. "Setting countercyclical capital buffers based on early warning models: would it work?," Working Paper Series 1604, European Central Bank.
    16. Patrizio Lainà & Juho Nyholm & Peter Sarlin, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, John Wiley & Sons, vol. 24(1), pages 18-35, January.
    17. Hartwig, Benny & Meinerding, Christoph & Schüler, Yves S., 2021. "Identifying indicators of systemic risk," Journal of International Economics, Elsevier, vol. 132(C).
    18. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    19. Gertler, Pavel & Hofmann, Boris, 2018. "Monetary facts revisited," Journal of International Money and Finance, Elsevier, vol. 86(C), pages 154-170.
    20. Casabianca, Elizabeth Jane & Catalano, Michele & Forni, Lorenzo & Giarda, Elena & Passeri, Simone, 2022. "A machine learning approach to rank the determinants of banking crises over time and across countries," Journal of International Money and Finance, Elsevier, vol. 129(C).

    More about this item

    Keywords

    EWIs; ROC; area under the curve; macroprudential policy;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:421. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Martin Fessler (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.