IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/23083.html
   My bibliography  Save this paper

Backtesting European Stress Tests

Author

Listed:
  • Thomas Philippon
  • Pierre Pessarossi
  • Boubacar Camara

Abstract

We provide a first evaluation of the quality of banking stress tests in the European Union. We use stress tests scenarios and banks’ estimated losses to recover bank level exposures to macroeconomic factors. Once macro outcomes are realized, we predict banks’ losses and compare them to actual losses. We find that stress tests are informative and unbiased on average. Model-based losses are good predictors of realized losses and of banks’ equity returns around announcements of macroeconomic news. When we perform our tests for the Union as a whole, we do not detect biases in the construction of the scenarios, or in the estimated losses across banks of different sizes and ownership structures. There is, however, some evidence that exposures are underestimated in countries with ex-ante weaker banking systems. Our results have implications for the modeling of credit losses, quality controls of supervision, and the political economy of financial regulation.

Suggested Citation

  • Thomas Philippon & Pierre Pessarossi & Boubacar Camara, 2017. "Backtesting European Stress Tests," NBER Working Papers 23083, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:23083
    Note: AP CF EFG ME
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w23083.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Viral V. Acharya & Lasse H. Pedersen & Thomas Philippon & Matthew Richardson, 2017. "Measuring Systemic Risk," The Review of Financial Studies, Society for Financial Studies, vol. 30(1), pages 2-47.
    2. Franklin Allen & Douglas Gale, 2000. "Financial Contagion," Journal of Political Economy, University of Chicago Press, vol. 108(1), pages 1-33, February.
    3. Flannery, Mark & Hirtle, Beverly & Kovner, Anna, 2017. "Evaluating the information in the federal reserve stress tests," Journal of Financial Intermediation, Elsevier, vol. 29(C), pages 1-18.
    4. Fernandes, Marcelo & Igan, Deniz & Pinheiro, Marcelo, 2020. "March madness in Wall Street: (What) does the market learn from stress tests?," Journal of Banking & Finance, Elsevier, vol. 112(C).
    5. Miguel Faria-e-Castro & Joseba Martinez & Thomas Philippon, 2017. "Runs versus Lemons: Information Disclosure and Fiscal Capacity," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(4), pages 1683-1707.
    6. Acharya, Viral & Engle, Robert & Pierret, Diane, 2014. "Testing macroprudential stress tests: The risk of regulatory risk weights," Journal of Monetary Economics, Elsevier, vol. 65(C), pages 36-53.
    7. Jean Yves MOISSERON & Bruno Laurent MOSCHETTO & Frédéric TEULON, 2014. "Islamic finance: a review of the literature," Working Papers 2014-93, Department of Research, Ipag Business School.
    8. ., 2014. "Challenges facing the Islamic financial industry," Chapters, in: Morality and Justice in Islamic Economics and Finance, chapter 7, pages 193-238, Edward Elgar Publishing.
    9. Jeremy C. Stein, 2014. "Regulating Large Financial Institutions," MIT Press Book Chapters, in: What Have We Learned? Macroeconomic Policy After the Crisis, edition 1, volume 1, chapter 10, pages 135-142, The MIT Press.
    10. ., 2014. "Land and local government finance," Chapters, in: China’s Urbanization and the World Economy, chapter 5, pages 41-55, Edward Elgar Publishing.
    11. Petrella, Giovanni & Resti, Andrea, 2013. "Supervisors as information producers: Do stress tests reduce bank opaqueness?," Journal of Banking & Finance, Elsevier, vol. 37(12), pages 5406-5420.
    12. ., 2014. "Innovation and authenticity in Islamic finance," Chapters, in: Morality and Justice in Islamic Economics and Finance, chapter 6, pages 163-192, Edward Elgar Publishing.
    13. Joel Shapiro & David Skeie, 2015. "Information Management in Banking Crises," The Review of Financial Studies, Society for Financial Studies, vol. 28(8), pages 2322-2363.
    14. Hamid, 2014. "Bank deregulation and relative wages in finance," Applied Economics Letters, Taylor & Francis Journals, vol. 21(2), pages 69-74, January.
    15. Schuermann, Til, 2016. "Stress Testing in Wartime and in Peacetime," Working Papers 17-01, University of Pennsylvania, Wharton School, Weiss Center.
    16. Goldstein, Itay & Sapra, Haresh, 2014. "Should Banks' Stress Test Results be Disclosed? An Analysis of the Costs and Benefits," Foundations and Trends(R) in Finance, now publishers, vol. 8(1), pages 1-54, March.
    17. Anna, Petrenko, 2016. "Мaркування готової продукції як складова частина інформаційного забезпечення маркетингової діяльності підприємств овочепродуктового підкомплексу," Agricultural and Resource Economics: International Scientific E-Journal, Agricultural and Resource Economics: International Scientific E-Journal, vol. 2(1), March.
    18. Noor Md. Rahmatullah & Abu Zafar Ahmed Mukul & Mohammad Tanjimul Islam, 2014. "Visiting SME Financing Industry of Bangladesh," Review of Knowledge Economy, Conscientia Beam, vol. 1(1), pages 6-20.
    19. repec:ipg:wpaper:2014-571 is not listed on IDEAS
    20. Nicky J. Welton & Howard H. Z. Thom, 2015. "Value of Information," Medical Decision Making, , vol. 35(5), pages 564-566, July.
    21. Bertrand Candelon & Mr. Amadou N Sy, 2015. "How Did Markets React to Stress Tests?," IMF Working Papers 2015/075, International Monetary Fund.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Niepmann, Friederike & Stebunovs, Viktors, 2024. "Modeling your stress away," Journal of Banking & Finance, Elsevier, vol. 158(C).
    2. Lukas Ahnert & Pascal Vogt & Volker Vonhoff & Florian Weigert, 2020. "Regulatory stress testing and bank performance," European Financial Management, European Financial Management Association, vol. 26(5), pages 1449-1488, November.
    3. Cecilia Parlatore, 2018. "Designing Stress Scenarios," 2018 Meeting Papers 1090, Society for Economic Dynamics.
    4. Denisa Banulescu-Radu & Christophe Hurlin & Jérémy Leymarie & Olivier Scaillet, 2021. "Backtesting Marginal Expected Shortfall and Related Systemic Risk Measures," Management Science, INFORMS, vol. 67(9), pages 5730-5754, September.
    5. Sahin, Cenkhan & de Haan, Jakob & Neretina, Ekaterina, 2020. "Banking stress test effects on returns and risks," Journal of Banking & Finance, Elsevier, vol. 117(C).
    6. Stéphane Loisel, 2014. "Reevaluation of the capital charge in insurance after a large shock: empirical and theoretical views," Post-Print hal-02013669, HAL.
    7. Cyril Pouvelle., 2022. "An Analysis of Financial Conglomerate Resilience: A Perspective on bancassurance in France [Une analyse de la résilience des conglomérats financiers : Une perspective sur la bancassurance en France," Débats économiques et financiers 39, Banque de France.
    8. Ramadiah, Amanah & Fricke, Daniel & Caccioli, Fabio, 2022. "Backtesting macroprudential stress tests," Journal of Economic Dynamics and Control, Elsevier, vol. 137(C).
    9. Bakoush, Mohamed & Gerding, Enrico & Mishra, Tapas & Wolfe, Simon, 2022. "An integrated macroprudential stress test of bank liquidity and solvency," Journal of Financial Stability, Elsevier, vol. 60(C).
    10. Ahnert, Lukas & Vogt, Pascal & Vonhoff, Volker & Weigert, Florian, 2020. "Regulatory stress testing and bank performance," CFR Working Papers 20-03, University of Cologne, Centre for Financial Research (CFR).
    11. Tirupam Goel & Isha Agarwal, 2021. "Limits of stress-test based bank regulation," BIS Working Papers 953, Bank for International Settlements.
    12. Haselmann, Rainer & Wahrenburg, Mark, 2018. "How demanding and consistent is the 2018 stress test design in comparison to previous exercises? Banking union scrutiny," SAFE White Paper Series 54, Leibniz Institute for Financial Research SAFE.
    13. Wang, Zheqi & Crook, Jonathan & Andreeva, Galina, 2020. "Reducing estimation risk using a Bayesian posterior distribution approach: Application to stress testing mortgage loan default," European Journal of Operational Research, Elsevier, vol. 287(2), pages 725-738.
    14. Kleszcz Klaudia & Nehrebecka Natalia, 2020. "Financial liability stress tests: an approach based on the use of a rating migration matrix," Central European Economic Journal, Sciendo, vol. 7(54), pages 12-32, January.
    15. Henri Fraisse & Christophe Hurlin, 2024. "Modèles internes des banques pour le calcul du capital réglementaire (IRB) et intelligence artificielle," Débats économiques et financiers 44, Banque de France.
    16. Guerrieri, Luca & Modugno, Michele, 2024. "The information content of stress test announcements," Journal of Banking & Finance, Elsevier, vol. 160(C).
    17. David M. Arseneau, 2020. "How Would U.S. Banks Fare in a Negative Interest Rate Environment?," International Journal of Central Banking, International Journal of Central Banking, vol. 16(5), pages 269-308, October.
    18. Fulvia Fringuellotti & Thomas Kroen, 2024. "Payout Restrictions and Bank Risk-Shifting," Staff Reports 1123, Federal Reserve Bank of New York.
    19. Robert McKeown, 2017. "How Vulnerable Is The Canadian Banking System To Fire-sales?," Working Paper 1381, Economics Department, Queen's University.
    20. Eric Monnet, & Angelo Riva, & Stefano Ungaro., 2021. "The Real Effects of Bank Runs. Evidence from the French Great Depression (1930-1931) [Les effets réels des ruées bancaires : l’exemple de la Grande Dépression en France (1930-1931)]," Débats économiques et financiers 37, Banque de France.
    21. Agarwal, Isha & Goel, Tirupam, 2024. "Bank regulation and supervision: A symbiotic relationship," Journal of Banking & Finance, Elsevier, vol. 163(C).
    22. J. Hombert & V. Lyonnet, 2017. "Intergenerational Risk Sharing in Life Insurance: Evidence from France," Débats économiques et financiers 30, Banque de France.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cecilia Parlatore, 2018. "Designing Stress Scenarios," 2018 Meeting Papers 1090, Society for Economic Dynamics.
    2. Cortés, Kristle R. & Demyanyk, Yuliya & Li, Lei & Loutskina, Elena & Strahan, Philip E., 2020. "Stress tests and small business lending," Journal of Financial Economics, Elsevier, vol. 136(1), pages 260-279.
    3. Dmitry Orlov & Pavel Zryumov & Andrzej Skrzypacz & Itay Goldstein, 2023. "The Design of Macroprudential Stress Tests," The Review of Financial Studies, Society for Financial Studies, vol. 36(11), pages 4460-4501.
    4. D. Georgoutsos & G. Moratis, 2021. "On the informative value of the EU-wide stress tests and the determinants of banks’ stock return reactions," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 48(4), pages 977-1008, November.
    5. Goldstein, Itay & Leitner, Yaron, 2018. "Stress tests and information disclosure," Journal of Economic Theory, Elsevier, vol. 177(C), pages 34-69.
    6. Anne Mills, 2015. "Universal Health Coverage: The Holy Grail?," Monograph 001571, Office of Health Economics.
    7. Nicola Cetorelli & Linda S. Goldberg, 2016. "Organizational complexity and balance sheet management in global banks," Staff Reports 772, Federal Reserve Bank of New York.
    8. Ahnert, Lukas & Vogt, Pascal & Vonhoff, Volker & Weigert, Florian, 2020. "Regulatory stress testing and bank performance," CFR Working Papers 20-03, University of Cologne, Centre for Financial Research (CFR).
    9. Karwowski, Mariusz, 2016. "The risk in using financial reports in the study of airline business models," Journal of Air Transport Management, Elsevier, vol. 55(C), pages 185-192.
    10. Lukas Ahnert & Pascal Vogt & Volker Vonhoff & Florian Weigert, 2020. "Regulatory stress testing and bank performance," European Financial Management, European Financial Management Association, vol. 26(5), pages 1449-1488, November.
    11. Flannery, Mark & Hirtle, Beverly & Kovner, Anna, 2017. "Evaluating the information in the federal reserve stress tests," Journal of Financial Intermediation, Elsevier, vol. 29(C), pages 1-18.
    12. Pacicco, Fausto & Vena, Luigi & Venegoni, Andrea, 2020. "Communication and financial supervision: How does disclosure affect market stability?," Journal of Empirical Finance, Elsevier, vol. 57(C), pages 1-15.
    13. Sahin, Cenkhan & de Haan, Jakob & Neretina, Ekaterina, 2020. "Banking stress test effects on returns and risks," Journal of Banking & Finance, Elsevier, vol. 117(C).
    14. Maria Rosa Borges & José Zorro Mendes & André Pereira, 2019. "The Value of Information: The Impact of European Union Bank Stress Tests on Stock Markets," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 25(4), pages 429-444, November.
    15. Fernandes, Marcelo & Igan, Deniz & Pinheiro, Marcelo, 2020. "March madness in Wall Street: (What) does the market learn from stress tests?," Journal of Banking & Finance, Elsevier, vol. 112(C).
    16. Alvarez, Fernando & Barlevy, Gadi, 2021. "Mandatory disclosure and financial contagion," Journal of Economic Theory, Elsevier, vol. 194(C).
    17. Beverly Hirtle & Anna Kovner, 2022. "Bank Supervision," Annual Review of Financial Economics, Annual Reviews, vol. 14(1), pages 39-56, November.
    18. Niepmann, Friederike & Stebunovs, Viktors, 2024. "Modeling your stress away," Journal of Banking & Finance, Elsevier, vol. 158(C).
    19. Durrani, Agha & Ongena, Steven & Ponte Marques, Aurea, 2022. "The certification role of the EU-wide stress testing exercises in the stock market. What can we learn from the stress tests (2014-2021)?," Working Paper Series 2711, European Central Bank.
    20. Thomas Ian Schneider & Philip E. Strahan & Jun Yang, 2020. "Bank Stress Testing: Public Interest or Regulatory Capture?," NBER Working Papers 26887, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • G01 - Financial Economics - - General - - - Financial Crises
    • G18 - Financial Economics - - General Financial Markets - - - Government Policy and Regulation
    • G2 - Financial Economics - - Financial Institutions and Services
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:23083. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.