IDEAS home Printed from https://ideas.repec.org/p/bdi/wptemi/td_1337_21.html
   My bibliography  Save this paper

A liquidity risk early warning indicator for Italian banks: a machine learning approach

Author

Listed:
  • Maria Ludovica Drudi

    (Bank of Italy)

  • Stefano Nobili

    (Bank of Italy)

Abstract

The paper develops an early warning system to identify banks that could face liquidity crises. To obtain a robust system for measuring banks’ liquidity vulnerabilities, we compare the predictive performance of three models – logistic LASSO, random forest and Extreme Gradient Boosting – and of their combination. Using a comprehensive dataset of liquidity crisis events between December 2014 and January 2020, our early warning models’ signals are calibrated according to the policymaker's preferences between type I and II errors. Unlike most of the literature, which focuses on default risk and typically proposes a forecast horizon ranging from 4 to 6 quarters, we analyse liquidity risk and we consider a 3-month forecast horizon. The key finding is that combining different estimation procedures improves model performance and yields accurate out-of-sample predictions. The results show that the combined models achieve an extremely low percentage of false negatives, lower than the values usually reported in the literature, while at the same time limiting the number of false positives.

Suggested Citation

  • Maria Ludovica Drudi & Stefano Nobili, 2021. "A liquidity risk early warning indicator for Italian banks: a machine learning approach," Temi di discussione (Economic working papers) 1337, Bank of Italy, Economic Research and International Relations Area.
  • Handle: RePEc:bdi:wptemi:td_1337_21
    as

    Download full text from publisher

    File URL: https://www.bancaditalia.it/pubblicazioni/temi-discussione/2021/2021-1337/en_tema_1337.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Graciela Kaminsky & Saul Lizondo & Carmen M. Reinhart, 1998. "Leading Indicators of Currency Crises," IMF Staff Papers, Palgrave Macmillan, vol. 45(1), pages 1-48, March.
    2. Fabrizio Ferriani & Wanda Cornacchia & Paolo Farroni & Eliana Ferrara & Francesco Guarino & Francesco Pisanti, 2019. "An early warning system for less significant Italian banks," Questioni di Economia e Finanza (Occasional Papers) 480, Bank of Italy, Economic Research and International Relations Area.
    3. Frankel, Jeffrey A. & Rose, Andrew K., 1996. "Currency Crashes in Emerging Markets: Empirical Indicators," Center for International and Development Economics Research (CIDER) Working Papers 233424, University of California-Berkeley, Department of Economics.
    4. Frankel, Jeffrey A. & Rose, Andrew K., 1996. "Currency crashes in emerging markets: An empirical treatment," Journal of International Economics, Elsevier, vol. 41(3-4), pages 351-366, November.
    5. Alessi, Lucia & Detken, Carsten, 2018. "Identifying excessive credit growth and leverage," Journal of Financial Stability, Elsevier, vol. 35(C), pages 215-225.
    6. John Y. Campbell & Jens Hilscher & Jan Szilagyi, 2008. "In Search of Distress Risk," Journal of Finance, American Finance Association, vol. 63(6), pages 2899-2939, December.
    7. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2018. "An evaluation of early warning models for systemic banking crises: Does machine learning improve predictions?," Discussion Papers 48/2018, Deutsche Bundesbank.
    8. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.
    9. Iñaki Aldasoro & Claudio Borio & Mathias Drehmann, 2018. "Early warning indicators of banking crises: expanding the family," BIS Quarterly Review, Bank for International Settlements, March.
    10. Mr. Marc C Dobler & Mr. Simon T Gray & Diarmuid Murphy & Bozena Radzewicz-Bak, 2016. "The Lender of Last Resort Function after the Global Financial Crisis," IMF Working Papers 2016/010, International Monetary Fund.
    11. Douglas W. Diamond & Philip H. Dybvig, 2000. "Bank runs, deposit insurance, and liquidity," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 24(Win), pages 14-23.
    12. Ms. Brenda Gonzalez-Hermosillo, 1999. "Determinants of Ex-Ante Banking System Distress: A Macro-Micro Empirical Exploration of Some Recent Episodes," IMF Working Papers 1999/033, International Monetary Fund.
    13. Lessmann, Stefan & Baesens, Bart & Seow, Hsin-Vonn & Thomas, Lyn C., 2015. "Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research," European Journal of Operational Research, Elsevier, vol. 247(1), pages 124-136.
    14. Demirguc, Asli & Detragiache, Enrica, 2000. "Monitoring Banking Sector Fragility: A Multivariate Logit Approach," The World Bank Economic Review, World Bank, vol. 14(2), pages 287-307, May.
    15. Kraft, Evan & Galac, Tomislav, 2007. "Deposit interest rates, asset risk and bank failure in Croatia," Journal of Financial Stability, Elsevier, vol. 2(4), pages 312-336, March.
    16. Alessi, Lucia & Detken, Carsten, 2011. "Quasi real time early warning indicators for costly asset price boom/bust cycles: A role for global liquidity," European Journal of Political Economy, Elsevier, vol. 27(3), pages 520-533, September.
    17. John Krainer & Jose A. Lopez, 2003. "Using equity market information to monitor banking institutions," FRBSF Economic Letter, Federal Reserve Bank of San Francisco, issue jan24.
    18. Tanaka, Katsuyuki & Kinkyo, Takuji & Hamori, Shigeyuki, 2016. "Random forests-based early warning system for bank failures," Economics Letters, Elsevier, vol. 148(C), pages 118-121.
    19. Eleonora Iachini & Stefano Nobili, 2014. "An indicator of systemic liquidity risk in the Italian financial markets," Questioni di Economia e Finanza (Occasional Papers) 217, Bank of Italy, Economic Research and International Relations Area.
    20. Lang, Jan Hannes & Peltonen, Tuomas A. & Sarlin, Peter, 2018. "A framework for early-warning modeling with an application to banks," Working Paper Series 2182, European Central Bank.
    21. Martin, Daniel, 1977. "Early warning of bank failure : A logit regression approach," Journal of Banking & Finance, Elsevier, vol. 1(3), pages 249-276, November.
    22. Flannery, Mark J, 1998. "Using Market Information in Prudential Bank Supervision: A Review of the U.S. Empirical Evidence," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 30(3), pages 273-305, August.
    23. Bräuning, Michael & Malikkidou, Despo & Scricco, Giorgio & Scalone, Stefano, 2019. "A new approach to Early Warning Systems for small European banks," Working Paper Series 2348, European Central Bank.
    24. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    25. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    26. Julapa Jagtiani & James Kolari & Catharine Lemieux & G. Hwan Shin, 2003. "Early warning models for bank supervision: Simpler could be better," Economic Perspectives, Federal Reserve Bank of Chicago, vol. 27(Q III), pages 49-60.
    27. Markus Holopainen & Peter Sarlin, 2017. "Toward robust early-warning models: a horse race, ensembles and model uncertainty," Quantitative Finance, Taylor & Francis Journals, vol. 17(12), pages 1933-1963, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alonso-Robisco, Andrés & Carbó, José Manuel, 2022. "Can machine learning models save capital for banks? Evidence from a Spanish credit portfolio," International Review of Financial Analysis, Elsevier, vol. 84(C).
    2. Francesco Cusano & Giuseppe Marinelli & Stefano Piermattei, 2022. "Learning from revisions: an algorithm to detect errors in banks’ balance sheet statistical reporting," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4025-4059, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fabrizio Ferriani & Wanda Cornacchia & Paolo Farroni & Eliana Ferrara & Francesco Guarino & Francesco Pisanti, 2019. "An early warning system for less significant Italian banks," Questioni di Economia e Finanza (Occasional Papers) 480, Bank of Italy, Economic Research and International Relations Area.
    2. Lanbiao Liu & Chen Chen & Bo Wang, 2022. "Predicting financial crises with machine learning methods," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(5), pages 871-910, August.
    3. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.
    4. Mr. Jorge A Chan-Lau, 2020. "UnFEAR: Unsupervised Feature Extraction Clustering with an Application to Crisis Regimes Classification," IMF Working Papers 2020/262, International Monetary Fund.
    5. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2019. "Does machine learning help us predict banking crises?," Journal of Financial Stability, Elsevier, vol. 45(C).
    6. Beutel, Johannes & List, Sophia & von Schweinitz, Gregor, 2018. "An evaluation of early warning models for systemic banking crises: Does machine learning improve predictions?," Discussion Papers 48/2018, Deutsche Bundesbank.
    7. Dieckelmann, Daniel, 2020. "Cross-border lending and the international transmission of banking crises," Discussion Papers 2020/13, Free University Berlin, School of Business & Economics.
    8. Wang, Peiwan & Zong, Lu, 2023. "Does machine learning help private sectors to alarm crises? Evidence from China’s currency market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 611(C).
    9. Markus Behn & Carsten Detken & Tuomas Peltonen & Willem Schudel, 2017. "Predicting Vulnerabilities in the EU Banking Sector: The Role of Global and Domestic Factors," International Journal of Central Banking, International Journal of Central Banking, vol. 13(4), pages 147-189, December.
    10. Sondermann, David & Zorell, Nico, 2019. "A macroeconomic vulnerability model for the euro area," Working Paper Series 2306, European Central Bank.
    11. Mekki Hamdaoui, 2017. "RETRACTED ARTICLE: Liberalization, Regulatory Delays and Vulnerability to Systemic Banking Crisis," International Economic Journal, Taylor & Francis Journals, vol. 31(4), pages 490-534, October.
    12. Kauko, Karlo, 2014. "How to foresee banking crises? A survey of the empirical literature," Economic Systems, Elsevier, vol. 38(3), pages 289-308.
    13. Stijn Claessens & M. Ayhan Kose, 2013. "Financial Crises: Explanations, Types and Implications," CAMA Working Papers 2013-06, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    14. Sarlin, Peter & von Schweinitz, Gregor, 2021. "Optimizing Policymakers’ Loss Functions In Crisis Prediction: Before, Within Or After?," Macroeconomic Dynamics, Cambridge University Press, vol. 25(1), pages 100-123, January.
    15. Katsuyuki Tanaka & Takuji Kinkyo & Shigeyuki Hamori, 2018. "Financial Hazard Map: Financial Vulnerability Predicted by a Random Forests Classification Model," Sustainability, MDPI, vol. 10(5), pages 1-18, May.
    16. von Schweinitz, Gregor & Sarlin, Peter, 2015. "Signaling Crises: How to Get Good Out-of-Sample Performance Out of the Early Warning System," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 112964, Verein für Socialpolitik / German Economic Association.
    17. Marcin Łupiński, 2019. "Wskaźniki wczesnego ostrzegania przed niestabilnością finansową polskiego sektora bankowego," Collegium of Economic Analysis Annals, Warsaw School of Economics, Collegium of Economic Analysis, issue 55, pages 99-113.
    18. K. Batu Tunay, 2010. "Banking Crises and Early Warning Systems: A Model Suggestion for Turkish Banking Sector," Journal of BRSA Banking and Financial Markets, Banking Regulation and Supervision Agency, vol. 4(1), pages 9-46.
    19. Hyeongwoo Kim & Wen Shi, 2021. "Forecasting financial vulnerability in the USA: A factor model approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 439-457, April.
    20. Lang, Jan Hannes, 2018. "Cross-country linkages and spill-overs in early warning models for financial crises," Working Paper Series 2160, European Central Bank.

    More about this item

    Keywords

    banking crisis; early warning models; liquidity risk; lender of last resort; machine learning;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdi:wptemi:td_1337_21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/bdigvit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.