IDEAS home Printed from https://ideas.repec.org/a/eee/finsta/v51y2020ics1572308920300607.html

Policy uncertainty and bank stress testing

Author

Listed:
  • Kupiec, Paul H.

Abstract

The accuracy of dynamic stress-test capital models remains undocumented. Three methodologies: a CLASS-style approach, Bayesian model averaging, and a Lasso specification are used to forecast the performance of 14 large US banks during the financial crisis. Individual bank models are calibrated using bank historical data while regulatory models are calibrated using representative bank data. Representative bank model forecasts differ dramatically from the forecasts from bank-specific models and from actual outcomes. The Lasso methodology is most accurate, but its superiority may be sample-specific and is only apparent ex post. The results highlight the policy uncertainty inherent in regulatory stress tests.

Suggested Citation

  • Kupiec, Paul H., 2020. "Policy uncertainty and bank stress testing," Journal of Financial Stability, Elsevier, vol. 51(C).
  • Handle: RePEc:eee:finsta:v:51:y:2020:i:c:s1572308920300607
    DOI: 10.1016/j.jfs.2020.100761
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1572308920300607
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jfs.2020.100761?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or

    for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Robertson, John C & Tallman, Ellis W & Whiteman, Charles H, 2005. "Forecasting Using Relative Entropy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 383-401, June.
    2. Min, Chung-ki & Zellner, Arnold, 1993. "Bayesian and non-Bayesian methods for combining models and forecasts with applications to forecasting international growth rates," Journal of Econometrics, Elsevier, vol. 56(1-2), pages 89-118, March.
    3. Meru Bhanot & Beverly Hirtle & Anna Kovner & James Vickery, 2014. "The CLASS Model: A Top-Down Assessment of the U.S. Banking System," Liberty Street Economics 20140604, Federal Reserve Bank of New York.
    4. Olivier Cappé & Christian P. Robert & Tobias Rydén, 2003. "Reversible jump, birth‐and‐death and more general continuous time Markov chain Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(3), pages 679-700, August.
    5. Marco Gross & Javier Población, 2019. "Implications of Model Uncertainty for Bank Stress Testing," Journal of Financial Services Research, Springer;Western Finance Association, vol. 55(1), pages 31-58, February.
    6. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    7. Liang, Feng & Paulo, Rui & Molina, German & Clyde, Merlise A. & Berger, Jim O., 2008. "Mixtures of g Priors for Bayesian Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 410-423, March.
    8. Kupiec, Paul H., 2018. "On the accuracy of alternative approaches for calibrating bank stress test models," Journal of Financial Stability, Elsevier, vol. 38(C), pages 132-146.
    9. Jon Faust & Simon Gilchrist & Jonathan H. Wright & Egon Zakrajšsek, 2013. "Credit Spreads as Predictors of Real-Time Economic Activity: A Bayesian Model-Averaging Approach," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1501-1519, December.
    10. repec:dau:papers:123456789/6040 is not listed on IDEAS
    11. Jose Fique, 2017. "The MacroFinancial Risk Assessment Framework (MFRAF), Version 2.0," Technical Reports 111, Bank of Canada.
    12. Green, Kesten C. & Armstrong, J. Scott, 2015. "Simple versus complex forecasting: The evidence," Journal of Business Research, Elsevier, vol. 68(8), pages 1678-1685.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:aei:rpaper:008586461 is not listed on IDEAS
    2. Mai Dao & Lam Nguyen, 2025. "Variable selection in macroeconomic stress test: a Bayesian quantile regression approach," Empirical Economics, Springer, vol. 68(3), pages 1113-1169, March.
    3. Avi Lichtig & Helene Mass, 2024. "Optimal Testing in Disclosure Games," CRC TR 224 Discussion Paper Series crctr224_2024_543, University of Bonn and University of Mannheim, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ley, Eduardo & Steel, Mark F. J., 2007. "On the effect of prior assumptions in Bayesian model averaging with applications to growth regression," Policy Research Working Paper Series 4238, The World Bank.
    2. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    3. Anna Sokolova, 2023. "Marginal Propensity to Consume and Unemployment: a Meta-analysis," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 51, pages 813-846, December.
    4. Hasan, Iftekhar & Horvath, Roman & Mares, Jan, 2020. "Finance and wealth inequality," Journal of International Money and Finance, Elsevier, vol. 108(C).
    5. Ley, Eduardo & Steel, Mark F.J., 2012. "Mixtures of g-priors for Bayesian model averaging with economic applications," Journal of Econometrics, Elsevier, vol. 171(2), pages 251-266.
    6. Jesus Crespo Cuaresma & Bettina Grün & Paul Hofmarcher & Stefan Humer & Mathias Moser, 2015. "A Comprehensive Approach to Posterior Jointness Analysis in Bayesian Model Averaging Applications," Department of Economics Working Papers wuwp193, Vienna University of Economics and Business, Department of Economics.
    7. Aart Kraay & Norikazu Tawara, 2013. "Can specific policy indicators identify reform priorities?," Journal of Economic Growth, Springer, vol. 18(3), pages 253-283, September.
    8. Crespo Cuaresma, Jesus & von Schweinitz, Gregor & Wendt, Katharina, 2019. "On the empirics of reserve requirements and economic growth," Journal of Macroeconomics, Elsevier, vol. 60(C), pages 253-274.
    9. Jesús Crespo Cuaresma & Martin Feldkircher, 2013. "Spatial Filtering, Model Uncertainty And The Speed Of Income Convergence In Europe," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(4), pages 720-741, June.
    10. Chen Ray-Bing & Chen Yi-Chi & Chu Chi-Hsiang & Lee Kuo-Jung, 2017. "On the determinants of the 2008 financial crisis: a Bayesian approach to the selection of groups and variables," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 21(5), pages 1-17, December.
    11. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    12. Bruns, Stephan B. & Ioannidis, John P.A., 2020. "Determinants of economic growth: Different time different answer?," Journal of Macroeconomics, Elsevier, vol. 63(C).
    13. Gilles Celeux & Mohammed El Anbari & Jean-Michel Marin & Christian P. Robert, 2010. "Regularization in Regression : Comparing Bayesian and Frequentist Methods in a Poorly Informative Situation," Working Papers 2010-43, Center for Research in Economics and Statistics.
    14. Min Wang & Guangying Liu, 2016. "A Simple Two-Sample Bayesian t -Test for Hypothesis Testing," The American Statistician, Taylor & Francis Journals, vol. 70(2), pages 195-201, May.
    15. Christian Kascha & Francesco Ravazzolo, 2010. "Combining inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 231-250.
    16. Koop, Gary & Tole, Lise, 2004. "Measuring the health effects of air pollution: to what extent can we really say that people are dying from bad air?," Journal of Environmental Economics and Management, Elsevier, vol. 47(1), pages 30-54, January.
    17. Sune Karlsson & Tor Jacobson, 2004. "Finding good predictors for inflation: a Bayesian model averaging approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(7), pages 479-496.
    18. Njindan Iyke, Bernard, 2015. "Macro Determinants of the Real Exchange Rate in a Small Open Small Island Economy: Evidence from Mauritius via BMA," MPRA Paper 68968, University Library of Munich, Germany.
    19. João M. Sousa & Ricardo M. Sousa, 2019. "Asset Returns Under Model Uncertainty: Evidence from the Euro Area, the US and the UK," Computational Economics, Springer;Society for Computational Economics, vol. 54(1), pages 139-176, June.
    20. Rockey, James & Temple, Jonathan, 2016. "Growth econometrics for agnostics and true believers," European Economic Review, Elsevier, vol. 81(C), pages 86-102.

    More about this item

    Keywords

    ;

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finsta:v:51:y:2020:i:c:s1572308920300607. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jfstabil .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.