IDEAS home Printed from https://ideas.repec.org/a/eee/jbfina/v80y2017icp215-234.html
   My bibliography  Save this article

An evaluation of bank measures for market risk before, during and after the financial crisis

Author

Listed:
  • O’Brien, James
  • Szerszeń, Paweł J.

Abstract

We study the performance and behavior of Value at Risk measures used by a number of large U.S. banks before, during and after the financial crisis. Alternative benchmark VaR measures, including GARCH-based measures, are estimated directly from the banks’ trading revenues to explain the bank VaR performance results. While overly conservative in both the pre-crisis and post-crisis periods, bank VaR exceedances were excessive and clustered in the crisis period. This contrasted with mostly unbiased benchmark HS and GARCH VaRs in the pre-crisis and post-crisis periods, and vastly superior GARCH-based VaR performance in the crisis period with lower exceedance rates and no exceedance clustering. Our results document the bank VaRs very slow adjustment to changing market conditions and their systematic bias in all studied periods. Our results indicate that bank VaRs could be improved by the use of models with time-varying volatility, and built on banks’ knowledge of their current positions.

Suggested Citation

  • O’Brien, James & Szerszeń, Paweł J., 2017. "An evaluation of bank measures for market risk before, during and after the financial crisis," Journal of Banking & Finance, Elsevier, vol. 80(C), pages 215-234.
    • Handle: RePEc:eee:jbfina:v:80:y:2017:i:c:p:215-234
    DOI: 10.1016/j.jbankfin.2017.03.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378426617300511
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jbankfin.2017.03.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jean-Pierre Zigrand & Hyun Song Shin & Jon Danielsson, 2010. "Risk Appetite and Endogenous Risk," FMG Discussion Papers dp647, Financial Markets Group.
    2. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2007. "Roughing It Up: Including Jump Components in the Measurement, Modeling, and Forecasting of Return Volatility," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 701-720, November.
    3. Jin‐Chuan Duan & Peter Ritchken & Zhiqiang Sun, 2006. "Approximating Garch‐Jump Models, Jump‐Diffusion Processes, And Option Pricing," Mathematical Finance, Wiley Blackwell, vol. 16(1), pages 21-52, January.
    4. Yamai, Yasuhiro & Yoshiba, Toshinao, 2005. "Value-at-risk versus expected shortfall: A practical perspective," Journal of Banking & Finance, Elsevier, vol. 29(4), pages 997-1015, April.
    5. Pérignon, Christophe & Deng, Zi Yin & Wang, Zhi Jun, 2008. "Do banks overstate their Value-at-Risk?," Journal of Banking & Finance, Elsevier, vol. 32(5), pages 783-794, May.
    6. Aramonte, Sirio & Giudice Rodriguez, Marius del & Wu, Jason, 2013. "Dynamic factor Value-at-Risk for large heteroskedastic portfolios," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4299-4309.
    7. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    8. Danielsson, Jon, 2002. "The emperor has no clothes: Limits to risk modelling," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1273-1296, July.
    9. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    10. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    11. Alexander, Carol & Sheedy, Elizabeth, 2008. "Developing a stress testing framework based on market risk models," Journal of Banking & Finance, Elsevier, vol. 32(10), pages 2220-2236, October.
    12. Pérignon, Christophe & Smith, Daniel R., 2010. "The level and quality of Value-at-Risk disclosure by commercial banks," Journal of Banking & Finance, Elsevier, vol. 34(2), pages 362-377, February.
    13. Tobias Adrian & Hyun Song Shin, 2014. "Procyclical Leverage and Value-at-Risk," The Review of Financial Studies, Society for Financial Studies, vol. 27(2), pages 373-403.
    14. Beverly Hirtle, 2003. "What market risk capital reporting tells us about bank risk," Economic Policy Review, Federal Reserve Bank of New York, issue Sep, pages 37-54.
    15. Tae-Hwy Lee & Yong Bao & Burak Saltoglu, 2006. "Evaluating predictive performance of value-at-risk models in emerging markets: a reality check," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(2), pages 101-128.
    16. Basak, Suleyman & Shapiro, Alexander, 2001. "Value-at-Risk-Based Risk Management: Optimal Policies and Asset Prices," Review of Financial Studies, Society for Financial Studies, vol. 14(2), pages 371-405.
    17. John M. Maheu & Thomas H. McCurdy, 2004. "News Arrival, Jump Dynamics, and Volatility Components for Individual Stock Returns," Journal of Finance, American Finance Association, vol. 59(2), pages 755-793, April.
    18. Marianne Baxter & Robert G. King, 1999. "Measuring Business Cycles: Approximate Band-Pass Filters For Economic Time Series," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 575-593, November.
    19. Giovanni Barone‐Adesi & Kostas Giannopoulos & Les Vosper, 1999. "VaR without correlations for portfolios of derivative securities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 19(5), pages 583-602, August.
    20. Engle, Robert F. & Manganelli, Simone, 2001. "Value at risk models in finance," Working Paper Series 75, European Central Bank.
    21. Embrechts, Paul & Puccetti, Giovanni & Rüschendorf, Ludger, 2013. "Model uncertainty and VaR aggregation," Journal of Banking & Finance, Elsevier, vol. 37(8), pages 2750-2764.
    22. Pérignon, Christophe & Smith, Daniel R., 2010. "Diversification and Value-at-Risk," Journal of Banking & Finance, Elsevier, vol. 34(1), pages 55-66, January.
    23. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    24. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value‐at‐Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, June.
    25. Boudt, Kris & Daníelsson, Jón & Laurent, Sébastien, 2013. "Robust forecasting of dynamic conditional correlation GARCH models," International Journal of Forecasting, Elsevier, vol. 29(2), pages 244-257.
    26. Michael S. Gibson, 2001. "Incorporating event risk into value-at-risk," Finance and Economics Discussion Series 2001-17, Board of Governors of the Federal Reserve System (U.S.).
    27. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    28. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    29. Torben G. Andersen & Tim Bollerslev & Peter Christoffersen & Francis X. Diebold, 2007. "Practical Volatility and Correlation Modeling for Financial Market Risk Management," NBER Chapters, in: The Risks of Financial Institutions, pages 513-544, National Bureau of Economic Research, Inc.
    30. L. Kourouma & Denis Dupré & G. Sanfilippo & O. Taramasco, 2011. "Extreme Value at Risk and Expected Shortfall during Financial Crisis," Post-Print halshs-00658495, HAL.
    31. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    32. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.
    33. Danielsson, Jon & Shin, Hyun Song & Zigrand, Jean-Pierre, 2004. "The impact of risk regulation on price dynamics," Journal of Banking & Finance, Elsevier, vol. 28(5), pages 1069-1087, May.
    34. Longin, Francois M., 2000. "From value at risk to stress testing: The extreme value approach," Journal of Banking & Finance, Elsevier, vol. 24(7), pages 1097-1130, July.
    35. L. Kourouma & Denis Dupré & O. Taramasco & G. Sanfilippo, 2011. "Extreme Value at Risk and Expected Shortfall during Financial Crisis," Post-Print halshs-00650913, HAL.
    36. Jondeau, Eric & Rockinger, Michael, 2006. "The Copula-GARCH model of conditional dependencies: An international stock market application," Journal of International Money and Finance, Elsevier, vol. 25(5), pages 827-853, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Farkas, Walter & Fringuellotti, Fulvia & Tunaru, Radu, 2020. "A cost-benefit analysis of capital requirements adjusted for model risk," Journal of Corporate Finance, Elsevier, vol. 65(C).
    2. Orla Mccullagh & Mark Cummins & Sheila Killian, 2023. "The Fundamental Review of the Trading Book: Implications for Portfolio and Risk Management in the Banking Sector," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 55(7), pages 1785-1816, October.
    3. Michele Leonardo Bianchi, 2023. "Assessing and forecasting the market risk of bank securities holdings: a data-driven approach," Risk Management, Palgrave Macmillan, vol. 25(4), pages 1-23, December.
    4. Zhouwei Wang & Qicheng Zhao & Min Zhu & Tao Pang, 2020. "Jump Aggregation, Volatility Prediction, and Nonlinear Estimation of Banks’ Sustainability Risk," Sustainability, MDPI, vol. 12(21), pages 1-17, October.
    5. Fang, Libing & Yu, Honghai & Xiao, Wen, 2018. "Forecasting gold futures market volatility using macroeconomic variables in the United States," Economic Modelling, Elsevier, vol. 72(C), pages 249-259.
    6. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    7. Jean-Paul Laurent & Hassan Omidi Firouzi, 2022. "Market Risk and Volatility Weighted Historical Simulation After Basel III," Working Papers hal-03679434, HAL.
    8. Aramonte, Sirio & Szerszeń, Paweł J., 2020. "Cross-market liquidity and dealer profitability: Evidence from the bond and CDS markets," Journal of Financial Markets, Elsevier, vol. 51(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James M. O'Brien & Pawel J. Szerszen, 2014. "An Evaluation of Bank VaR Measures for Market Risk During and Before the Financial Crisis," Finance and Economics Discussion Series 2014-21, Board of Governors of the Federal Reserve System (U.S.).
    2. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    3. Fries, Christian P. & Nigbur, Tobias & Seeger, Norman, 2017. "Displaced relative changes in historical simulation: Application to risk measures of interest rates with phases of negative rates," Journal of Empirical Finance, Elsevier, vol. 42(C), pages 175-198.
    4. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    5. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    6. Righi, Marcelo Brutti & Ceretta, Paulo Sergio, 2015. "A comparison of Expected Shortfall estimation models," Journal of Economics and Business, Elsevier, vol. 78(C), pages 14-47.
    7. Farkas, Walter & Fringuellotti, Fulvia & Tunaru, Radu, 2020. "A cost-benefit analysis of capital requirements adjusted for model risk," Journal of Corporate Finance, Elsevier, vol. 65(C).
    8. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    9. Jean-Paul Laurent & Hassan Omidi Firouzi, 2022. "Market Risk and Volatility Weighted Historical Simulation After Basel III," Working Papers hal-03679434, HAL.
    10. Marco Rocco, 2011. "Extreme value theory for finance: a survey," Questioni di Economia e Finanza (Occasional Papers) 99, Bank of Italy, Economic Research and International Relations Area.
    11. Alejandro Bernales & Diether W. Beuermann & Gonzalo Cortazar, 2014. "Thinly traded securities and risk management," Estudios de Economia, University of Chile, Department of Economics, vol. 41(1 Year 20), pages 5-48, June.
    12. Frésard, Laurent & Pérignon, Christophe & Wilhelmsson, Anders, 2011. "The pernicious effects of contaminated data in risk management," Journal of Banking & Finance, Elsevier, vol. 35(10), pages 2569-2583, October.
    13. Pérignon, Christophe & Smith, Daniel R., 2010. "The level and quality of Value-at-Risk disclosure by commercial banks," Journal of Banking & Finance, Elsevier, vol. 34(2), pages 362-377, February.
    14. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    15. Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
    16. Wagner Piazza Gaglianone & Luiz Renato Lima & Oliver Linton & Daniel R. Smith, 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 150-160, January.
    17. Bakshi, Gurdip & Panayotov, George, 2010. "First-passage probability, jump models, and intra-horizon risk," Journal of Financial Economics, Elsevier, vol. 95(1), pages 20-40, January.
    18. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    19. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    20. Erik Kole & Thijs Markwat & Anne Opschoor & Dick van Dijk, 2017. "Forecasting Value-at-Risk under Temporal and Portfolio Aggregation," Journal of Financial Econometrics, Oxford University Press, vol. 15(4), pages 649-677.

    More about this item

    Keywords

    Market risk; VaR; Backtesting; Profit and loss; Financial crisis;
    All these keywords.

    JEL classification:

    • G01 - Financial Economics - - General - - - Financial Crises
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbfina:v:80:y:2017:i:c:p:215-234. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbf .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.