IDEAS home Printed from https://ideas.repec.org/p/fip/fedhwp/wp-2015-09.html
   My bibliography  Save this paper

Backtesting Systemic Risk Measures During Historical Bank Runs

Author

Listed:

Abstract

The measurement of systemic risk is at the forefront of economists and policymakers concerns in the wake of the 2008 financial crisis. What exactly are we measuring and do any of the proposed measures perform well outside the context of the recent financial crisis? One way to address these questions is to take backtesting seriously and evaluate how useful the recently proposed measures are when applied to historical crises. Ideally, one would like to look at the pre-FDIC era for a broad enough sample of financial panics to confidently assess the robustness of systemic risk measures but pre-FDIC era balance sheet and bank stock price data were heretofore unavailable. We rectify this data shortcoming by employing a recently collected financial dataset spanning the 60 years before the introduction of deposit insurance. Our data includes many of the most severe financial panics in U.S. history. Overall we find CoVaR and SRisk to be remarkably useful in alerting regulators of systemically risky financial institutions.

Suggested Citation

  • Christian Brownlees & Benjamin Chabot & Eric Ghysels & Christopher J. Kurz, 2015. "Backtesting Systemic Risk Measures During Historical Bank Runs," Working Paper Series WP-2015-9, Federal Reserve Bank of Chicago.
  • Handle: RePEc:fip:fedhwp:wp-2015-09
    as

    Download full text from publisher

    File URL: https://www.chicagofed.org/~/media/publications/working-papers/2015/wp2015-09-pdf.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gorton, Gary, 1988. "Banking Panics and Business Cycles," Oxford Economic Papers, Oxford University Press, vol. 40(4), pages 751-781, December.
    2. Robert F. Engle & Eric Ghysels & Bumjean Sohn, 2013. "Stock Market Volatility and Macroeconomic Fundamentals," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 776-797, July.
    3. Ghysels, Eric & Santa-Clara, Pedro & Valkanov, Rossen, 2005. "There is a risk-return trade-off after all," Journal of Financial Economics, Elsevier, vol. 76(3), pages 509-548, June.
    4. Eric Ghysels & Arthur Sinko & Rossen Valkanov, 2007. "MIDAS Regressions: Further Results and New Directions," Econometric Reviews, Taylor & Francis Journals, vol. 26(1), pages 53-90.
    5. Colacito, Riccardo & Engle, Robert F. & Ghysels, Eric, 2011. "A component model for dynamic correlations," Journal of Econometrics, Elsevier, vol. 164(1), pages 45-59, September.
    6. Dimitrios Bisias & Mark Flood & Andrew W. Lo & Stavros Valavanis, 2012. "A Survey of Systemic Risk Analytics," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 255-296, October.
    7. Lars Peter Hansen, 2013. "Challenges in Identifying and Measuring Systemic Risk," NBER Chapters, in: Risk Topography: Systemic Risk and Macro Modeling, pages 15-30, National Bureau of Economic Research, Inc.
    8. Brunnermeier, Markus K. & Oehmke, Martin, 2013. "Bubbles, Financial Crises, and Systemic Risk," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1221-1288, Elsevier.
    9. Gorton, Gary, 1985. "Clearinghouses and the Origin of Central Banking in the United States," The Journal of Economic History, Cambridge University Press, vol. 45(2), pages 277-283, June.
    10. Andrew J. Jalil, 2015. "A New History of Banking Panics in the United States, 1825-1929: Construction and Implications," American Economic Journal: Macroeconomics, American Economic Association, vol. 7(3), pages 295-330, July.
    11. repec:pri:metric:wp047_2012_brunnermeier_ssrn-id2103814.pdf is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kreis, Yvonne & Leisen, Dietmar P.J., 2018. "Systemic risk in a structural model of bank default linkages," Journal of Financial Stability, Elsevier, vol. 39(C), pages 221-236.
    2. Viral V. Acharya & Lasse H. Pedersen & Thomas Philippon & Matthew Richardson, 2017. "Measuring Systemic Risk," The Review of Financial Studies, Society for Financial Studies, vol. 30(1), pages 2-47.
    3. Peter Grundke, 2019. "Ranking consistency of systemic risk measures: a simulation-based analysis in a banking network model," Review of Quantitative Finance and Accounting, Springer, vol. 52(4), pages 953-990, May.
    4. Baumöhl, Eduard & Bouri, Elie & Hoang, Thi-Hong-Van & Shahzad, Syed Jawad Hussain & Výrost, Tomáš, 2020. "Increasing systemic risk during the Covid-19 pandemic: A cross-quantilogram analysis of the banking sector," EconStor Preprints 222580, ZBW - Leibniz Information Centre for Economics.
    5. Borri, Nicola & Giorgio, Giorgio di, 2022. "Systemic risk and the COVID challenge in the european banking sector," Journal of Banking & Finance, Elsevier, vol. 140(C).
    6. Sanjiv R. Das & Kris James Mitchener & Angela Vossmeyer, 2018. "Bank Regulation, Network Topology, and Systemic Risk: Evidence from the Great Depression," CESifo Working Paper Series 7425, CESifo.
    7. Mitchener, Kris & Das, Sanjiv & Vossmeyer, Angela, 2018. "Bank Regulation, Network Topology, and Systemic Risk: Evidence from the Great Depression," CEPR Discussion Papers 13416, C.E.P.R. Discussion Papers.
    8. Busch, Pascal & Cappelletti, Giuseppe & Marincas, Vlad & Meller, Barbara & Wildmann, Nadya, 2021. "How useful is market information for the identification of G-SIBs?," Occasional Paper Series 260, European Central Bank.
    9. Colletaz, Gilbert & Levieuge, Grégory & Popescu, Alexandra, 2018. "Monetary policy and long-run systemic risk-taking," Journal of Economic Dynamics and Control, Elsevier, vol. 86(C), pages 165-184.
    10. Kremer, Manfred & Chavleishvili, Sulkhan, 2021. "Measuring Systemic Financial Stress and its Impact on the Macroeconomy," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242346, Verein für Socialpolitik / German Economic Association.
    11. Chavleishvili, Sulkhan & Engle, Robert F. & Fahr, Stephan & Kremer, Manfred & Manganelli, Simone & Schwaab, Bernd, 2021. "The risk management approach to macro-prudential policy," Working Paper Series 2565, European Central Bank.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brownlees, Christian & Chabot, Ben & Ghysels, Eric & Kurz, Christopher, 2020. "Back to the future: Backtesting systemic risk measures during historical bank runs and the great depression," Journal of Banking & Finance, Elsevier, vol. 113(C).
    2. Amendola, Alessandra & Candila, Vincenzo & Gallo, Giampiero M., 2019. "On the asymmetric impact of macro–variables on volatility," Economic Modelling, Elsevier, vol. 76(C), pages 135-152.
    3. Jiang, Cuixia & Li, Yuqian & Xu, Qifa & Liu, Yezheng, 2021. "Measuring risk spillovers from multiple developed stock markets to China: A vine-copula-GARCH-MIDAS model," International Review of Economics & Finance, Elsevier, vol. 75(C), pages 386-398.
    4. Dhaene, Geert & Wu, Jianbin, 2020. "Incorporating overnight and intraday returns into multivariate GARCH volatility models," Journal of Econometrics, Elsevier, vol. 217(2), pages 471-495.
    5. Jiang, Cuixia & Ding, Xiaoyi & Xu, Qifa & Tong, Yongbo, 2020. "A TVM-Copula-MIDAS-GARCH model with applications to VaR-based portfolio selection," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    6. Pan, Beier, 2023. "The asymmetric dynamics of stock–bond liquidity correlation in China: The role of macro-financial determinants," Economic Modelling, Elsevier, vol. 124(C).
    7. Conrad, Christian & Loch, Karin & Rittler, Daniel, 2014. "On the macroeconomic determinants of long-term volatilities and correlations in U.S. stock and crude oil markets," Journal of Empirical Finance, Elsevier, vol. 29(C), pages 26-40.
    8. Xu, Qifa & Chen, Lu & Jiang, Cuixia & Yu, Keming, 2020. "Mixed data sampling expectile regression with applications to measuring financial risk," Economic Modelling, Elsevier, vol. 91(C), pages 469-486.
    9. Gong, Yuting & Chen, Qiang & Liang, Jufang, 2018. "A mixed data sampling copula model for the return-liquidity dependence in stock index futures markets," Economic Modelling, Elsevier, vol. 68(C), pages 586-598.
    10. Qifa Xu & Lu Chen & Cuixia Jiang & Yezheng Liu, 2022. "Forecasting expected shortfall and value at risk with a joint elicitable mixed data sampling model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(3), pages 407-421, April.
    11. Goldmann, Leonie & Crook, Jonathan & Calabrese, Raffaella, 2024. "A new ordinal mixed-data sampling model with an application to corporate credit rating levels," European Journal of Operational Research, Elsevier, vol. 314(3), pages 1111-1126.
    12. Davide Pettenuzzo & Rossen Valkanov & Allan Timmermann, 2014. "A Bayesian MIDAS Approach to Modeling First and Second Moment Dynamics," Working Papers 76, Brandeis University, Department of Economics and International Business School.
    13. Julien Chevallier, 2020. "COVID-19 Outbreak and CO 2 Emissions: Macro-Financial Linkages," JRFM, MDPI, vol. 14(1), pages 1-18, December.
    14. Richard W. Booser, 2018. "An Algorithm Exploiting Episodes of Inefficient Asset Pricing to Derive a Macro-Foundation Scaled Metric for Systemic Risk: A Time-Series Martingale Representation," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 8(1), pages 1-3.
    15. Hossein Asgharian & Charlotte Christiansen & Ai Jun Hou & Weining Wang, 2017. "Long- and Short-Run Components of Factor Betas: Implications for Equity Pricing," CREATES Research Papers 2017-34, Department of Economics and Business Economics, Aarhus University.
    16. Kanas, Angelos & Molyneux, Philip, 2020. "Do measures of systemic risk predict U.S. corporate bond default rates?," International Review of Financial Analysis, Elsevier, vol. 71(C).
    17. Hossein Asgharian & Charlotte Christiansen & Ai Jun Hou, 2017. "Economic Policy Uncertainty and Long-Run Stock Market Volatility and Correlation," CREATES Research Papers 2018-12, Department of Economics and Business Economics, Aarhus University.
    18. Qifa Xu & Junqing Zuo & Cuixia Jiang & Yaoyao He, 2021. "A large constrained time‐varying portfolio selection model with DCC‐MIDAS: Evidence from Chinese stock market," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 3417-3435, July.
    19. Fang, Tong & Su, Zhi & Yin, Libo, 2020. "Economic fundamentals or investor perceptions? The role of uncertainty in predicting long-term cryptocurrency volatility," International Review of Financial Analysis, Elsevier, vol. 71(C).
    20. Vincenzo Candila, 2021. "Multivariate Analysis of Cryptocurrencies," Econometrics, MDPI, vol. 9(3), pages 1-17, July.

    More about this item

    Keywords

    Financial crisis; Systemic risk; Stress testing; credit risks; High-frequency data;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • G14 - Financial Economics - - General Financial Markets - - - Information and Market Efficiency; Event Studies; Insider Trading
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedhwp:wp-2015-09. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lauren Wiese (email available below). General contact details of provider: https://edirc.repec.org/data/frbchus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.