IDEAS home Printed from https://ideas.repec.org/a/kap/jfsres/v55y2019i1d10.1007_s10693-017-0275-4.html
   My bibliography  Save this article

Implications of Model Uncertainty for Bank Stress Testing

Author

Listed:
  • Marco Gross

    (European Central Bank)

  • Javier Población

    (European Central Bank)

Abstract

We aim to raise the awareness that model uncertainty stemming from stress test satellite equations that relate bank risk parameters to macro-financial variables can be significant. Based on a set of credit risk models derived by means of a Bayesian model averaging (BMA) methodology we conduct a stress test for 75 European banks to highlight that i) an optimistic equation choice can imply significantly overstated capital estimates, ii) model uncertainty contributes on average about 35% to overall uncertainty in our application, and iii) the impact of model uncertainty feeding through regulatory risk weights can easily turn twice as sizable as that from loan losses. Model methods that account for model uncertainty, such as the BMA, should mitigate the risks arising along these three dimensions and help establish a level playing field with regard to an equal extent of conservatism across banks.

Suggested Citation

  • Marco Gross & Javier Población, 2019. "Implications of Model Uncertainty for Bank Stress Testing," Journal of Financial Services Research, Springer;Western Finance Association, vol. 55(1), pages 31-58, February.
  • Handle: RePEc:kap:jfsres:v:55:y:2019:i:1:d:10.1007_s10693-017-0275-4
    DOI: 10.1007/s10693-017-0275-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10693-017-0275-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10693-017-0275-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Glenn Hoggarth & Steffen Sorensen & Lea Zicchino, 2005. "Stress tests of UK banks using a VAR approach," Bank of England working papers 282, Bank of England.
    2. Pesaran, M. Hashem & Schuermann, Til & Treutler, Bjorn-Jakob & Weiner, Scott M., 2006. "Macroeconomic Dynamics and Credit Risk: A Global Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1211-1261, August.
    3. Michael Boss & Gerald Krenn & Claus Puhr & Martin Summer, 2006. "Systemic Risk Monitor: A Model for Systemic Risk Analysis and Stress Testing of Banking Systems," Financial Stability Report, Oesterreichische Nationalbank (Austrian Central Bank), issue 11, pages 83-95.
    4. Covas, Francisco B. & Rump, Ben & Zakrajšek, Egon, 2014. "Stress-testing US bank holding companies: A dynamic panel quantile regression approach," International Journal of Forecasting, Elsevier, vol. 30(3), pages 691-713.
    5. Gabriel Jiménez & Jesús Saurina, 2006. "Credit Cycles, Credit Risk, and Prudential Regulation," International Journal of Central Banking, International Journal of Central Banking, vol. 2(2), May.
    6. Pavel Kapinos & Oscar A. Mitnik, 2016. "A Top-down Approach to Stress-testing Banks," Journal of Financial Services Research, Springer;Western Finance Association, vol. 49(2), pages 229-264, June.
    7. Yuliya Demyanyk & Otto Van Hemert, 2011. "Understanding the Subprime Mortgage Crisis," The Review of Financial Studies, Society for Financial Studies, vol. 24(6), pages 1848-1880.
    8. Tomasz Piskorski & Amit Seru & James Witkin, 2015. "Asset Quality Misrepresentation by Financial Intermediaries: Evidence from the RMBS Market," Journal of Finance, American Finance Association, vol. 70(6), pages 2635-2678, December.
    9. Markus Behn & Rainer Haselmann & Vikrant Vig, 2022. "The Limits of Model‐Based Regulation," Journal of Finance, American Finance Association, vol. 77(3), pages 1635-1684, June.
    10. Jacobson, Tor & Linde, Jesper & Roszbach, Kasper, 2005. "Exploring interactions between real activity and the financial stance," Journal of Financial Stability, Elsevier, vol. 1(3), pages 308-341, April.
    11. Borio, Claudio & Drehmann, Mathias & Tsatsaronis, Kostas, 2014. "Stress-testing macro stress testing: Does it live up to expectations?," Journal of Financial Stability, Elsevier, vol. 12(C), pages 3-15.
    12. Hirtle, Beverly & Kovner, Anna & Vickery, James & Bhanot, Meru, 2016. "Assessing financial stability: The Capital and Loss Assessment under Stress Scenarios (CLASS) model," Journal of Banking & Finance, Elsevier, vol. 69(S1), pages 35-55.
    13. Matthew Plosser & João A. C. Santos, 2014. "Banks' incentives and the quality of internal risk models," Staff Reports 704, Federal Reserve Bank of New York.
    14. Altman, Edward I. & Saunders, Anthony, 1997. "Credit risk measurement: Developments over the last 20 years," Journal of Banking & Finance, Elsevier, vol. 21(11-12), pages 1721-1742, December.
    15. Thomas Breuer & Martin Jandacka & Klaus Rheinberger & Martin Summer, 2009. "How to find plausible, severe, and useful stress scenarios," Working Papers 150, Oesterreichische Nationalbank (Austrian Central Bank).
    16. Vicente Salas & Jesús Saurina, 2002. "Credit Risk in Two Institutional Regimes: Spanish Commercial and Savings Banks," Journal of Financial Services Research, Springer;Western Finance Association, vol. 22(3), pages 203-224, December.
    17. Gordy, Michael B., 2000. "A comparative anatomy of credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 119-149, January.
    18. Jacobson, Tor & Linde, Jesper & Roszbach, Kasper, 2006. "Internal ratings systems, implied credit risk and the consistency of banks' risk classification policies," Journal of Banking & Finance, Elsevier, vol. 30(7), pages 1899-1926, July.
    19. Mr. Dale F Gray, 2013. "Modeling Banking, Sovereign, and Macro Risk in a CCA Global VAR," IMF Working Papers 2013/218, International Monetary Fund.
    20. Thomas Breuer & Martin Jandacka & Klaus Rheinberger & Martin Summer, 2009. "How to Find Plausible, Severe and Useful Stress Scenarios," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 205-224, September.
    21. Castrén, Olli & Dées, Stéphane & Zaher, Fadi, 2010. "Stress-testing euro area corporate default probabilities using a global macroeconomic model," Journal of Financial Stability, Elsevier, vol. 6(2), pages 64-78, June.
    22. Xavier Sala-I-Martin & Gernot Doppelhofer & Ronald I. Miller, 2004. "Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach," American Economic Review, American Economic Association, vol. 94(4), pages 813-835, September.
    23. Mr. Christian Schmieder & Maher Hasan & Mr. Claus Puhr, 2011. "Next Generation Balance Sheet Stress Testing," IMF Working Papers 2011/083, International Monetary Fund.
    24. Simon Firestone & Marcelo Rezende, 2013. "Are Banks' Internal Risk Parameters Consistent? Evidence from Syndicated Loans," Finance and Economics Discussion Series 2013-84, Board of Governors of the Federal Reserve System (U.S.).
    25. Mr. Martin Cihak, 2007. "Introduction to Applied Stress Testing," IMF Working Papers 2007/059, International Monetary Fund.
    26. Crouhy, Michel & Galai, Dan & Mark, Robert, 2000. "A comparative analysis of current credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 59-117, January.
    27. Uday Rajan & Amit Seru & Vikrant Vig, 2010. "Statistical Default Models and Incentives," American Economic Review, American Economic Association, vol. 100(2), pages 506-510, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kupiec, Paul H., 2020. "Policy uncertainty and bank stress testing," Journal of Financial Stability, Elsevier, vol. 51(C).
    2. Wilmar Alexander Cabrera-Rodríguez & Daniela Rodríguez-Novoa & Camilo Eduardo Sánchez-Quinto, 2023. "A robust model for the term structure of interest rates: some applications in Colombia," Borradores de Economia 1255, Banco de la Republica de Colombia.
    3. D. Georgoutsos & G. Moratis, 2021. "On the informative value of the EU-wide stress tests and the determinants of banks’ stock return reactions," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 48(4), pages 977-1008, November.
    4. Josef Sveda & Jiri Panos & Vojtech Siuda, 2023. "Modelling Risk-Weighted Assets: Looking Beyond Stress Tests," Working Papers 2023/15, Czech National Bank.
    5. Martin Guth, 2022. "Predicting Default Probabilities for Stress Tests: A Comparison of Models," Papers 2202.03110, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gross, Marco & Población García, Francisco Javier, 2015. "A false sense of security in applying handpicked equations for stress test purposes," Working Paper Series 1845, European Central Bank.
    2. Buncic, Daniel & Melecky, Martin, 2013. "Macroprudential stress testing of credit risk: A practical approach for policy makers," Journal of Financial Stability, Elsevier, vol. 9(3), pages 347-370.
    3. Jiri Panos & Petr Polak, 2019. "How to Improve the Model Selection Procedure in a Stress-testing Framework," Working Papers 2019/9, Czech National Bank.
    4. Matthew Pritsker, 2017. "Choosing Stress Scenarios for Systemic Risk Through Dimension Reduction," Supervisory Research and Analysis Working Papers RPA 17-4, Federal Reserve Bank of Boston.
    5. Kolari, James W. & López-Iturriaga, Félix J. & Sanz, Ivan Pastor, 2019. "Predicting European bank stress tests: Survival of the fittest," Global Finance Journal, Elsevier, vol. 39(C), pages 44-57.
    6. Paul Glasserman & Mike Li, 2022. "Should Bank Stress Tests Be Fair?," Papers 2207.13319, arXiv.org, revised May 2023.
    7. Miora Rakotonirainy & Jean Razafindravonona & Christian Rasolomanana, 2020. "Macro Stress Testing Credit Risk: Case of Madagascar Banking Sector," Journal of Central Banking Theory and Practice, Central bank of Montenegro, vol. 9(2), pages 199-218.
    8. Henry, Jérôme & Zimmermann, Maik & Leber, Miha & Kolb, Markus & Grodzicki, Maciej & Amzallag, Adrien & Vouldis, Angelos & Hałaj, Grzegorz & Pancaro, Cosimo & Gross, Marco & Baudino, Patrizia & Sydow, , 2013. "A macro stress testing framework for assessing systemic risks in the banking sector," Occasional Paper Series 152, European Central Bank.
    9. Darne, O. & Levy-Rueff, O. & Pop, A., 2013. "Calibrating Initial Shocks in Bank Stress Test Scenarios: An Outlier Detection Based Approach," Working papers 426, Banque de France.
    10. Claudio Borio & Mathias Drehmann, 2011. "Toward an Operational Framework for Financial Stability: “Fuzzy” Measurement and Its Consequences," Central Banking, Analysis, and Economic Policies Book Series, in: Rodrigo Alfaro (ed.),Financial Stability, Monetary Policy, and Central Banking, edition 1, volume 15, chapter 4, pages 063-123, Central Bank of Chile.
    11. International Association of Deposit Insurers, 2011. "Evaluation of Deposit Insurance Fund Sufficiency on the Basis of Risk Analysis," IADI Research Papers 11-11, International Association of Deposit Insurers.
    12. Tor Jacobson & Jesper Lindé & Kasper Roszbach, 2013. "Firm Default And Aggregate Fluctuations," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 945-972, August.
    13. Bolt, Wilko & de Haan, Leo & Hoeberichts, Marco & van Oordt, Maarten R.C. & Swank, Job, 2012. "Bank profitability during recessions," Journal of Banking & Finance, Elsevier, vol. 36(9), pages 2552-2564.
    14. Varotto, Simone, 2012. "Stress testing credit risk: The Great Depression scenario," Journal of Banking & Finance, Elsevier, vol. 36(12), pages 3133-3149.
    15. Busch, Ramona & Koziol, Philipp & Mitrovic, Marc, 2018. "Many a little makes a mickle: Stress testing small and medium-sized German banks," The Quarterly Review of Economics and Finance, Elsevier, vol. 68(C), pages 237-253.
    16. Solntsev, O. & Mamonov, M. & Pestova, A. & Magomedova, Z., 2011. "Experience in Developing Early Warning System for Financial Crises and the Forecast of Russian Banking Sector Dynamic in 2012," Journal of the New Economic Association, New Economic Association, issue 12, pages 41-76.
    17. Ferrari, Stijn & Van Roy, Patrick & Vespro, Cristina, 2021. "Sensitivity of credit risk stress test results: Modelling issues with an application to Belgium," Journal of Financial Stability, Elsevier, vol. 52(C).
    18. Abbassi, Puriya & Schmidt, Michael, 2018. "A comprehensive view on risk reporting: Evidence from supervisory data," Journal of Financial Intermediation, Elsevier, vol. 36(C), pages 74-85.
    19. Adam Gersl & Petr Jakubik & Tomas Konecny & Jakub Seidler, 2013. "Dynamic Stress Testing: The Framework for Assessing the Resilience of the Banking Sector Used by the Czech National Bank," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 63(6), pages 505-536, December.
    20. Dua, Pami & Kapur, Hema, 2018. "Macro stress testing and resilience assessment of Indian banking," Journal of Policy Modeling, Elsevier, vol. 40(2), pages 452-475.

    More about this item

    Keywords

    Stress testing; Model uncertainty; Bank regulation and supervision;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:jfsres:v:55:y:2019:i:1:d:10.1007_s10693-017-0275-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.