IDEAS home Printed from https://ideas.repec.org/a/eee/finsta/v52y2021ics1572308920301042.html
   My bibliography  Save this article

Sensitivity of credit risk stress test results: Modelling issues with an application to Belgium

Author

Listed:
  • Ferrari, Stijn
  • Van Roy, Patrick
  • Vespro, Cristina

Abstract

This paper assesses the sensitivity of solvency stress testing results to the choice of credit risk variable and level of data aggregation at which the stress test is conducted. In practice, both choices are often determined by technical considerations, such as data availability. Using data for the Belgian banking system, we find that the impact of a stress test on banks’ Tier 1 ratios can differ substantially depending on the credit risk variable considered, but much less so on the level of aggregation. If solvency stress tests are going to be used as a supervisory tool or to set regulatory capital requirements, there is a need to further harmonise their execution across institutions and supervisors in order to enhance comparability. This is certainly relevant in the context of the EU-wide stress tests, where institutions often use different credit risk variables (and levels of data aggregation) to estimate the impact of the common methodology and macroeconomic scenario on their capital level and supervisors rely on different models to quality assure and validate banks’ results. More generally, there is also a need to improve the availability and quality of the data to be used for stress testing purposes.

Suggested Citation

  • Ferrari, Stijn & Van Roy, Patrick & Vespro, Cristina, 2021. "Sensitivity of credit risk stress test results: Modelling issues with an application to Belgium," Journal of Financial Stability, Elsevier, vol. 52(C).
  • Handle: RePEc:eee:finsta:v:52:y:2021:i:c:s1572308920301042
    DOI: 10.1016/j.jfs.2020.100805
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1572308920301042
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jfs.2020.100805?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bruneau, C. & de Bandt, O. & El Amri, W., 2012. "Macroeconomic fluctuations and corporate financial fragility," Journal of Financial Stability, Elsevier, vol. 8(4), pages 219-235.
    2. David Aikman & Piergiorgio Alessandri & Bruno Eklund & Prasanna Gai & Sujit Kapadia & Elizabeth Martin & Nada Mora & Gabriel Sterne & Matthew Willison, 2011. "Funding Liquidity Risk in a Quantitative Model of Systemic Stability," Central Banking, Analysis, and Economic Policies Book Series, in: Rodrigo Alfaro (ed.),Financial Stability, Monetary Policy, and Central Banking, edition 1, volume 15, chapter 12, pages 371-410, Central Bank of Chile.
    3. Pesaran, M. Hashem & Schuermann, Til & Treutler, Bjorn-Jakob & Weiner, Scott M., 2006. "Macroeconomic Dynamics and Credit Risk: A Global Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1211-1261, August.
    4. Breuer, Thomas & Csiszár, Imre, 2013. "Systematic stress tests with entropic plausibility constraints," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1552-1559.
    5. Stijn Ferrari & Patrick Van Roy & Cristina Vespro, 2011. "Stress testing credit risk: modelling issues," Financial Stability Review, National Bank of Belgium, vol. 9(1), pages 105-120, June.
    6. I. De Greef & C. Van Nieuwenhuyze, 2009. "The National Bank of Belgium, Research Department’s new business survey indicator," Economic Review, National Bank of Belgium, issue ii, pages 31-51, June.
    7. Buncic, Daniel & Melecky, Martin, 2013. "Macroprudential stress testing of credit risk: A practical approach for policy makers," Journal of Financial Stability, Elsevier, vol. 9(3), pages 347-370.
    8. Martin Feldkircher & Gerhard Fenz & Robert Ferstl & Gerald Krenn & Benjamin Neudorfer & Claus Puhr & Thomas Reininger & Stefan W. Schmitz & Martin Schneider & Christoph Siebenbrunner & Michael Sigmund, 2013. "ARNIE in Action: The 2013 FSAP Stress Tests for the Austrian Banking System," Financial Stability Report, Oesterreichische Nationalbank (Austrian Central Bank), issue 26, pages 100-118.
    9. Quagliariello,Mario (ed.), 2009. "Stress-testing the Banking System," Cambridge Books, Cambridge University Press, number 9780521767309.
    10. Céline Gauthier & Zhongfang He & Moez Souissi, 2010. "Understanding Systemic Risk: The Trade-Offs between Capital, Short-Term Funding and Liquid Asset Holdings," Staff Working Papers 10-29, Bank of Canada.
    11. Klaus Düllmann & Thomas Kick, 2014. "Stress testing German banks against a global credit crunch," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 28(4), pages 337-361, November.
    12. Vazquez, Francisco & Tabak, Benjamin M. & Souto, Marcos, 2012. "A macro stress test model of credit risk for the Brazilian banking sector," Journal of Financial Stability, Elsevier, vol. 8(2), pages 69-83.
    13. Cerutti, Eugenio & Schmieder, Christian, 2014. "Ring fencing and consolidated banks’ stress tests," Journal of Financial Stability, Elsevier, vol. 11(C), pages 1-12.
    14. Tor Jacobson & Jesper Lindé & Kasper Roszbach, 2013. "Firm Default And Aggregate Fluctuations," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 945-972, August.
    15. Dion Bongaerts & Frank De Jong & Joost Driessen, 2011. "Derivative Pricing with Liquidity Risk: Theory and Evidence from the Credit Default Swap Market," Journal of Finance, American Finance Association, vol. 66(1), pages 203-240, February.
    16. Jesús Saurina & Carlos Trucharte, 2007. "An Assessment of Basel II Procyclicality in Mortgage Portfolios," Journal of Financial Services Research, Springer;Western Finance Association, vol. 32(1), pages 81-101, October.
    17. Hansjörg Lehmann & Michael Manz, 2006. "The Exposure of Swiss Banks to Macroeconomic Shocks - an Empirical Investigation," Working Papers 2006-04, Swiss National Bank.
    18. repec:onb:oenbwp:y:2002:i:3:b:3 is not listed on IDEAS
    19. Eivind Bernhardsen & Bjorne Dyre Syversten, 2009. "Stress Testing the Enterprise Sector's Bank Debt: A Micro Approach," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 111-138, September.
    20. Jokivuolle, Esa & Virén, Matti, 2013. "Cyclical default and recovery in stress testing loan losses," Journal of Financial Stability, Elsevier, vol. 9(1), pages 139-149.
    21. Mr. Christian Schmieder & Maher Hasan & Mr. Claus Puhr, 2011. "Next Generation Balance Sheet Stress Testing," IMF Working Papers 2011/083, International Monetary Fund.
    22. Annaert, Jan & De Ceuster, Marc & Van Roy, Patrick & Vespro, Cristina, 2013. "What determines Euro area bank CDS spreads?," Journal of International Money and Finance, Elsevier, vol. 32(C), pages 444-461.
    23. Darren Pain, 2003. "The provisioning experience of the major UK banks: a small panel investigation," Bank of England working papers 177, Bank of England.
    24. Piergiorgio Alessandri & Prasanna Gai & Sujit Kapadia & Nada Mora & Claus Puhr, 2009. "Towards a Framework for Quantifying Systemic Stability," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 47-81, September.
    25. Burrows, Oliver & Learmonth, David & McKeown, Jack, 2012. "Financial Stability Paper No 17: RAMSI: a top-down stress-testing model," Bank of England Financial Stability Papers 17, Bank of England.
    26. Pierre Collin-Dufresn & Robert S. Goldstein & J. Spencer Martin, 2001. "The Determinants of Credit Spread Changes," Journal of Finance, American Finance Association, vol. 56(6), pages 2177-2207, December.
    27. Miroslav Misina & David Tessier & Shubhasis Dey, 2006. "Stress Testing the Corporate Loans Portfolio of the Canadian Banking Sector," Staff Working Papers 06-47, Bank of Canada.
    28. Antonella Foglia, 2009. "Stress Testing Credit Risk: A Survey of Authorities' Aproaches," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 9-45, September.
    29. Michael Boss & Gerald Krenn & Claus Puhr & Martin Summer, 2006. "Systemic Risk Monitor: A Model for Systemic Risk Analysis and Stress Testing of Banking Systems," Financial Stability Report, Oesterreichische Nationalbank (Austrian Central Bank), issue 11, pages 83-95.
    30. Mr. Paul Louis Ceriel Hilbers & Mr. Matthew T Jones & Mr. Graham L Slack, 2004. "Stress Testing Financial Systems: What to Do When the Governor Calls," IMF Working Papers 2004/127, International Monetary Fund.
    31. repec:zbw:bofrdp:2004_018 is not listed on IDEAS
    32. Jiménez, Gabriel & Mencía, Javier, 2009. "Modelling the distribution of credit losses with observable and latent factors," Journal of Empirical Finance, Elsevier, vol. 16(2), pages 235-253, March.
    33. Gross, Marco & Población García, Francisco Javier, 2015. "A false sense of security in applying handpicked equations for stress test purposes," Working Paper Series 1845, European Central Bank.
    34. Martin v. & Tavolaro S. & Viol S., 2013. "Stress tests sur le système bancaire et les organismes d’assurance en France," Analyse et synthèse 11, Banque de France.
    35. Miguel A. Segoviano, 2006. "Portfolio Credit Risk and Macroeconomic Shocks: Applications to Stress Testing Under Data-Restricted Environments," IMF Working Papers 2006/283, International Monetary Fund.
    36. Eric Gustin & Patrick Van Roy, 2014. "The role of internal models in regulatory capital requirements: a comparison of Belgian banks’ credit risk parameters," Financial Stability Review, National Bank of Belgium, vol. 12(1), pages 141-151, June.
    37. Mr. Maria Soledad Martinez Peria & Mr. Giovanni Majnoni & Mr. Matthew T Jones & Mr. Winfrid Blaschke, 2001. "Stress Testing of Financial Systems: An Overview of Issues, Methodologies, and FSAP Experiences," IMF Working Papers 2001/088, International Monetary Fund.
    38. Castrén, Olli & Dées, Stéphane & Zaher, Fadi, 2010. "Stress-testing euro area corporate default probabilities using a global macroeconomic model," Journal of Financial Stability, Elsevier, vol. 6(2), pages 64-78, June.
    39. Harvir Kalirai & Martin Scheicher, 2002. "Macroeconomic Stress Testing: Preliminary Evidence for Austria," Financial Stability Report, Oesterreichische Nationalbank (Austrian Central Bank), issue 3, pages 58-74.
    40. Burrows, Oliver & Learmonth, David & McKeown, jack & Williams, Richard, 2012. "RAMSI: a top-down stress-testing model developed at the Bank of England," Bank of England Quarterly Bulletin, Bank of England, vol. 52(3), pages 204-212.
    41. Mr. Claus Puhr & Mr. Andre O Santos & Mr. Christian Schmieder & Salih N. Neftci & Mr. Benjamin Neudorfer & Mr. Stefan W. Schmitz & Mr. Heiko Hesse, 2012. "Next Generation System-Wide Liquidity Stress Testing," IMF Working Papers 2012/003, International Monetary Fund.
    42. Breuer, Thomas & Jandačka, Martin & Mencía, Javier & Summer, Martin, 2012. "A systematic approach to multi-period stress testing of portfolio credit risk," Journal of Banking & Finance, Elsevier, vol. 36(2), pages 332-340.
    43. Sorge, Marco & Virolainen, Kimmo, 2006. "A comparative analysis of macro stress-testing methodologies with application to Finland," Journal of Financial Stability, Elsevier, vol. 2(2), pages 113-151, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abinzano, Isabel & Corredor, Pilar & Mansilla-Fernández, José Manuel, 2022. "Sovereign debt holdings and banks’ credit risk: Evidence from the Eurozone," Finance Research Letters, Elsevier, vol. 47(PA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Busch, Ramona & Koziol, Philipp & Mitrovic, Marc, 2018. "Many a little makes a mickle: Stress testing small and medium-sized German banks," The Quarterly Review of Economics and Finance, Elsevier, vol. 68(C), pages 237-253.
    2. Stijn Ferrari & Patrick Van Roy & Cristina Vespro, 2011. "Stress testing credit risk: modelling issues," Financial Stability Review, National Bank of Belgium, vol. 9(1), pages 105-120, June.
    3. Ruja, Catalin, 2014. "Macro Stress-Testing Credit Risk in Romanian Banking System," MPRA Paper 58244, University Library of Munich, Germany.
    4. Busch, Ramona & Koziol, Philipp & Mitrovic, Marc, 2015. "Many a little makes a mickle: Macro portfolio stress test for small and medium-sized German banks," Discussion Papers 23/2015, Deutsche Bundesbank.
    5. George Papadopoulos & Savas Papadopoulos & Thomas Sager, 2016. "Credit risk stress testing for EU15 banks: a model combination approach," Working Papers 203, Bank of Greece.
    6. Borio, Claudio & Drehmann, Mathias & Tsatsaronis, Kostas, 2014. "Stress-testing macro stress testing: Does it live up to expectations?," Journal of Financial Stability, Elsevier, vol. 12(C), pages 3-15.
    7. Dua, Pami & Kapur, Hema, 2018. "Macro stress testing and resilience assessment of Indian banking," Journal of Policy Modeling, Elsevier, vol. 40(2), pages 452-475.
    8. Antonella Foglia, 2009. "Stress Testing Credit Risk: A Survey of Authorities' Aproaches," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 9-45, September.
    9. Adam Gersl & Petr Jakubik & Tomas Konecny & Jakub Seidler, 2013. "Dynamic Stress Testing: The Framework for Assessing the Resilience of the Banking Sector Used by the Czech National Bank," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 63(6), pages 505-536, December.
    10. Pliszka, Kamil, 2021. "System-wide and banks' internal stress tests: Regulatory requirements and literature review," Discussion Papers 19/2021, Deutsche Bundesbank.
    11. Georgios Papadopoulos & Dionysios Chionis & Nikolaos P. Rachaniotis, 2018. "Macro-financial linkages during tranquil and crisis periods: evidence from stressed economies," Risk Management, Palgrave Macmillan, vol. 20(2), pages 142-166, May.
    12. Darne, O. & Levy-Rueff, O. & Pop, A., 2013. "Calibrating Initial Shocks in Bank Stress Test Scenarios: An Outlier Detection Based Approach," Working papers 426, Banque de France.
    13. Wang, Zheqi & Crook, Jonathan & Andreeva, Galina, 2020. "Reducing estimation risk using a Bayesian posterior distribution approach: Application to stress testing mortgage loan default," European Journal of Operational Research, Elsevier, vol. 287(2), pages 725-738.
    14. Peter Grundke & Kamil Pliszka & Michael Tuchscherer, 2020. "Model and estimation risk in credit risk stress tests," Review of Quantitative Finance and Accounting, Springer, vol. 55(1), pages 163-199, July.
    15. Abildgren, Kim, 2014. "Far out in the tails – The historical distributions of macro-financial risk factors in Denmark," Nationaløkonomisk tidsskrift, Nationaløkonomisk Forening, vol. 2014(1), pages 1-31.
    16. Ventsislav Hristev, 2014. "Bank Stress-Testing Lessons from Central, Eastern and Southeastern European Countries," Economic Alternatives, University of National and World Economy, Sofia, Bulgaria, issue 4, pages 92-109, December.
    17. Pierluigi Bologna & Anatoli Segura, 2017. "Integrating Stress Tests within the Basel III Capital Framework: A Macroprudentially Coherent Approach," Journal of Financial Regulation, Oxford University Press, vol. 3(2), pages 159-186.
    18. Henry, Jérôme & Zimmermann, Maik & Leber, Miha & Kolb, Markus & Grodzicki, Maciej & Amzallag, Adrien & Vouldis, Angelos & Hałaj, Grzegorz & Pancaro, Cosimo & Gross, Marco & Baudino, Patrizia & Sydow, , 2013. "A macro stress testing framework for assessing systemic risks in the banking sector," Occasional Paper Series 152, European Central Bank.
    19. Gross, Marco & Población García, Francisco Javier, 2015. "A false sense of security in applying handpicked equations for stress test purposes," Working Paper Series 1845, European Central Bank.
    20. Antonella Foglia, 2008. "Stress testing credit risk: a survey of authorities' approaches," Questioni di Economia e Finanza (Occasional Papers) 37, Bank of Italy, Economic Research and International Relations Area.

    More about this item

    Keywords

    Stress tests; Credit risk; Sensitivity analysis; Capital requirements; Modelling choices;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finsta:v:52:y:2021:i:c:s1572308920301042. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jfstabil .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.