IDEAS home Printed from https://ideas.repec.org/p/ecb/ecbwps/20182182.html
   My bibliography  Save this paper

A framework for early-warning modeling with an application to banks

Author

Listed:
  • Lang, Jan Hannes
  • Peltonen, Tuomas A.
  • Sarlin, Peter

Abstract

This paper proposes a framework for deriving early-warning models with optimal out-of-sample forecasting properties and applies it to predicting distress in European banks. The main contributions of the paper are threefold. First, the paper introduces a conceptual framework to guide the process of building early-warning models, which highlights and structures the numerous complex choices that the modeler needs to make. Second, the paper proposes a flexible modeling solution to the conceptual framework that supports model selection in real-time. Specifically, our proposed solution is to combine the loss function approach to evaluate early-warning models with regularized logistic regression and cross-validation to find a model specification with optimal real-time out-of-sample forecasting properties. Third, the paper illustrates how the modeling framework can be used in analysis supporting both microand macro-prudential policy by applying it to a large dataset of EU banks and showing some examples of early-warning model visualizations. JEL Classification: G01, G17, G21, G33, C52, C54

Suggested Citation

  • Lang, Jan Hannes & Peltonen, Tuomas A. & Sarlin, Peter, 2018. "A framework for early-warning modeling with an application to banks," Working Paper Series 2182, European Central Bank.
  • Handle: RePEc:ecb:ecbwps:20182182
    Note: 2731285
    as

    Download full text from publisher

    File URL: https://www.ecb.europa.eu//pub/pdf/scpwps/ecb.wp2182.en.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gropp, Reint & Vesala, Jukka & Vulpes, Giuseppe, 2006. "Equity and Bond Market Signals as Leading Indicators of Bank Fragility," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(2), pages 399-428, March.
    2. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    3. Drehmann, Mathias & Juselius, Mikael, 2014. "Evaluating early warning indicators of banking crises: Satisfying policy requirements," International Journal of Forecasting, Elsevier, vol. 30(3), pages 759-780.
    4. Babecký, Jan & Havránek, Tomáš & Matějů, Jakub & Rusnák, Marek & Šmídková, Kateřina & Vašíček, Bořek, 2014. "Banking, debt, and currency crises in developed countries: Stylized facts and early warning indicators," Journal of Financial Stability, Elsevier, vol. 15(C), pages 1-17.
    5. Flood, Mark D. & Lemieux, Victoria L. & Varga, Margaret & William Wong, B.L., 2016. "The application of visual analytics to financial stability monitoring," Journal of Financial Stability, Elsevier, vol. 27(C), pages 180-197.
    6. Alessi, Lucia & Detken, Carsten, 2011. "Quasi real time early warning indicators for costly asset price boom/bust cycles: A role for global liquidity," European Journal of Political Economy, Elsevier, vol. 27(3), pages 520-533, September.
    7. Peltonen, Tuomas A. & Sarlin, Peter & Piloiu, Andreea, 2015. "Network linkages to predict bank distress," Working Paper Series 1828, European Central Bank.
    8. Graciela Kaminsky & Saul Lizondo & Carmen M. Reinhart, 1998. "Leading Indicators of Currency Crises," IMF Staff Papers, Palgrave Macmillan, vol. 45(1), pages 1-48, March.
    9. Detken, Carsten & Peltonen, Tuomas A. & Schudel, Willem & Behn, Markus, 2013. "Setting countercyclical capital buffers based on early warning models: would it work?," Working Paper Series 1604, European Central Bank.
    10. Moritz Schularick & Alan M. Taylor, 2012. "Credit Booms Gone Bust: Monetary Policy, Leverage Cycles, and Financial Crises, 1870-2008," American Economic Review, American Economic Association, vol. 102(2), pages 1029-1061, April.
    11. Demirguc, Asli & Detragiache, Enrica, 2000. "Monitoring Banking Sector Fragility: A Multivariate Logit Approach," The World Bank Economic Review, World Bank, vol. 14(2), pages 287-307, May.
    12. Betz, Frank & Oprică, Silviu & Peltonen, Tuomas A. & Sarlin, Peter, 2014. "Predicting distress in European banks," Journal of Banking & Finance, Elsevier, vol. 45(C), pages 225-241.
    13. Carmen M. Reinhart & Kenneth S. Rogoff, 2009. "Is the 2007 US Sub-Prime Financial Crisis So Different?: An International Historical Comparison," Panoeconomicus, Savez ekonomista Vojvodine, Novi Sad, Serbia, vol. 56(3), pages 291-299.
    14. repec:zbw:bofrdp:2014_014 is not listed on IDEAS
    15. Mr. Fabian Valencia & Mr. Luc Laeven, 2012. "Systemic Banking Crises Database: An Update," IMF Working Papers 2012/163, International Monetary Fund.
    16. Bertrand Candelon & Elena-Ivona Dumitrescu & Christophe Hurlin, 2012. "How to Evaluate an Early-Warning System: Toward a Unified Statistical Framework for Assessing Financial Crises Forecasting Methods," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 60(1), pages 75-113, April.
    17. Detken, Carsten & Weeken, Olaf & Alessi, Lucia & Bonfim, Diana & Boucinha, Miguel & Castro, Christian & Frontczak, Sebastian & Giordana, Gaston & Giese, Julia & Wildmann, Nadya & Kakes, Jan & Klaus, B, 2014. "Operationalising the countercyclical capital buffer: indicator selection, threshold identification and calibration options," ESRB Occasional Paper Series 5, European Systemic Risk Board.
    18. Peltonen, Tuomas A., 2006. "Are emerging market currency crises predictable? A test," Working Paper Series 571, European Central Bank.
    19. repec:zbw:bofrdp:2015_006 is not listed on IDEAS
    20. Bussiere, Matthieu & Fratzscher, Marcel, 2006. "Towards a new early warning system of financial crises," Journal of International Money and Finance, Elsevier, vol. 25(6), pages 953-973, October.
    21. Claudio Borio & Mathias Drehmann, 2009. "Assessing the risk of banking crises - revisited," BIS Quarterly Review, Bank for International Settlements, March.
    22. Berg, Andrew & Pattillo, Catherine, 1999. "Predicting currency crises:: The indicators approach and an alternative," Journal of International Money and Finance, Elsevier, vol. 18(4), pages 561-586, August.
    23. Jaume Puig & Mr. Ken Miyajima & Rebecca McCaughrin & Mr. Peter Dattels, 2010. "Can You Map Global Financial Stability?," IMF Working Papers 2010/145, International Monetary Fund.
    24. Carsten Detken & Olaf Weeken & Lucia Alessi & Diana Bonfim & Miguel M. Boucinha & Christian Castro & Sebastian Frontczak & Gaston Giordana & Julia Giese & Nadya Jahn & Jan Kakes & Benjamin Klaus & Jan, 2014. "Operationalising the countercyclical capital buffer: indicator selection, threshold identification and calibration options," ESRB Occasional Paper Series 05, European Systemic Risk Board.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jacopo Carmassi & Sonja Dobkowitz & Johanne Evrard & Laura Parisi & André F Silva & Michael Wedow, 2020. "Completing the Banking Union with a European deposit insurance scheme: who is afraid of cross-subsidization?," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 35(101), pages 41-95.
    2. Jorge E. Galán, 2021. "CREWS: a CAMELS-based early warning system of systemic risk in the banking sector," Occasional Papers 2132, Banco de España.
    3. Buckmann, Marcus & Gallego Marquez, Paula & Gimpelewicz, Mariana & Kapadia, Sujit & Rismanchi, Katie, 2023. "The more the merrier? Evidence on the value of multiple requirements in bank regulation," Journal of Banking & Finance, Elsevier, vol. 149(C).
    4. Smith, Jonathan Acosta & Grill, Michael & Lang, Jan Hannes, 2017. "The leverage ratio, risk-taking and bank stability," Working Paper Series 2079, European Central Bank.
    5. Quentin Bro de Comères, 2022. "Predicting European Banks Distress Events: Do Financial Information Producers Matter?," Working Papers hal-03752678, HAL.
    6. Piotr Bańbuła & Marcin Pietrzak, 2021. "Early Warning Models of Banking Crises: VIX and High Profits," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 13(4), pages 381-403, December.
    7. Berthonnaud, Pierre & Cesati, Enrico & Drudi, Maria Ludovica & Jager, Kirsten & Kick, Heinrich & Lanciani, Marcello & Schneider, Ludwig & Schwarz, Claudia & Siakoulis, Vasileios & Vroege, Robert, 2021. "Asset encumbrance in euro area banks: analysing trends, drivers and prediction properties for individual bank crises," Occasional Paper Series 261, European Central Bank.
    8. Fabrizio Ferriani & Wanda Cornacchia & Paolo Farroni & Eliana Ferrara & Francesco Guarino & Francesco Pisanti, 2019. "An early warning system for less significant Italian banks," Questioni di Economia e Finanza (Occasional Papers) 480, Bank of Italy, Economic Research and International Relations Area.
    9. Mr. Jorge A Chan-Lau, 2020. "UnFEAR: Unsupervised Feature Extraction Clustering with an Application to Crisis Regimes Classification," IMF Working Papers 2020/262, International Monetary Fund.
    10. Bitetto, Alessandro & Cerchiello, Paola & Mertzanis, Charilaos, 2023. "Measuring financial soundness around the world: A machine learning approach," International Review of Financial Analysis, Elsevier, vol. 85(C).
    11. Maria Ludovica Drudi & Stefano Nobili, 2021. "A liquidity risk early warning indicator for Italian banks: a machine learning approach," Temi di discussione (Economic working papers) 1337, Bank of Italy, Economic Research and International Relations Area.
    12. Sonya Georgieva, 2023. "Application of Artificial Intelligence and Machine Learning in the Conduct of Monetary Policy by Central Banks," Economic Studies journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 8, pages 177-199.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tölö, Eero, 2020. "Predicting systemic financial crises with recurrent neural networks," Journal of Financial Stability, Elsevier, vol. 49(C).
    2. Mikkel Hermansen & Oliver Röhn, 2017. "Economic resilience: The usefulness of early warning indicators in OECD countries," OECD Journal: Economic Studies, OECD Publishing, vol. 2016(1), pages 9-35.
    3. Antunes, António & Bonfim, Diana & Monteiro, Nuno & Rodrigues, Paulo M.M., 2018. "Forecasting banking crises with dynamic panel probit models," International Journal of Forecasting, Elsevier, vol. 34(2), pages 249-275.
    4. Alessi, Lucia & Detken, Carsten, 2018. "Identifying excessive credit growth and leverage," Journal of Financial Stability, Elsevier, vol. 35(C), pages 215-225.
    5. Schudel, Willem, 2015. "Shifting horizons: assessing macro trends before, during, and following systemic banking crises," Working Paper Series 1766, European Central Bank.
    6. Fendel Ralf & Stremmel Hanno, 2016. "Characteristics of Banking Crises: A Comparative Study with Geographical Contagion," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(3), pages 349-388, May.
    7. Lo Duca, Marco & Koban, Anne & Basten, Marisa & Bengtsson, Elias & Klaus, Benjamin & Kusmierczyk, Piotr & Lang, Jan Hannes & Detken, Carsten & Peltonen, Tuomas, 2017. "A new database for financial crises in European countries," ESRB Occasional Paper Series 13, European Systemic Risk Board.
    8. V. Coudert & J. Idier, 2016. "An Early Warning System for Macro-prudential Policy in France," Working papers 609, Banque de France.
    9. Savas Papadopoulos & Pantelis Stavroulias & Thomas Sager, 2016. "Systemic early warning systems for EU15 based on the 2008 crisis," Working Papers 202, Bank of Greece.
    10. Marcin Pietrzak, 2021. "Can Financial Soundness Indicators Help Predict Financial Sector Distress?," IMF Working Papers 2021/197, International Monetary Fund.
    11. repec:zbw:bofrdp:2019_014 is not listed on IDEAS
    12. Savas Papadopoulos & Pantelis Stavroulias & Thomas Sager, 2019. "Systemic early warning systems for EU14 based on the 2008 crisis: proposed estimation and model assessment for classification forecasting," Journal of Banking Regulation, Palgrave Macmillan, vol. 20(3), pages 226-244, September.
    13. Tihana Skrinjaric, 2023. "Leading indicators of financial stress in Croatia: a regime switching approach," Public Sector Economics, Institute of Public Finance, vol. 47(2), pages 205-232.
    14. Lang, Jan Hannes, 2018. "Cross-country linkages and spill-overs in early warning models for financial crises," Working Paper Series 2160, European Central Bank.
    15. Tölö, Eero, 2019. "Predicting systemic financial crises with recurrent neural networks," Research Discussion Papers 14/2019, Bank of Finland.
    16. Ruoxi Zhang & Xue Li & Satish Chand, 2018. "An Early Warning Of An Impending Currency Crisis In China," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 64(05), pages 1101-1125, July.
    17. Piotr Bańbuła & Marcin Pietrzak, 2021. "Early Warning Models of Banking Crises: VIX and High Profits," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 13(4), pages 381-403, December.
    18. Markus Behn & Carsten Detken & Tuomas Peltonen & Willem Schudel, 2017. "Predicting Vulnerabilities in the EU Banking Sector: The Role of Global and Domestic Factors," International Journal of Central Banking, International Journal of Central Banking, vol. 13(4), pages 147-189, December.
    19. Markus Holopainen & Peter Sarlin, 2015. "Toward robust early-warning models: A horse race, ensembles and model uncertainty," Papers 1501.04682, arXiv.org, revised Apr 2016.
    20. Lainà, Patrizio & Nyholm, Juho & Sarlin, Peter, 2015. "Leading indicators of systemic banking crises: Finland in a panel of EU countries," Review of Financial Economics, Elsevier, vol. 24(C), pages 18-35.
    21. Kalatie, Simo & Laakkonen, Helinä & Tölö, Eero, 2015. "Indicators used in setting the countercyclical capital buffer," Bank of Finland Research Discussion Papers 8/2015, Bank of Finland.

    More about this item

    Keywords

    bank distress; early-warning models; financial crises; micro- and macro-prudential analysis; regularization;
    All these keywords.

    JEL classification:

    • G01 - Financial Economics - - General - - - Financial Crises
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G33 - Financial Economics - - Corporate Finance and Governance - - - Bankruptcy; Liquidation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20182182. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Official Publications (email available below). General contact details of provider: https://edirc.repec.org/data/emieude.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.