IDEAS home Printed from https://ideas.repec.org/p/fip/fedfwp/2015-13.html
   My bibliography  Save this paper

Robust stress testing

Author

Listed:
  • Rhys M. Bidder
  • Andrew McKenna

Abstract

In recent years, stress testing has become an important component of financial and macro-prudential regulation. Despite the general consensus that such testing has been useful in many dimensions, the techniques of stress testing are still being honed and debated. This paper contributes to this debate in proposing the use of robust forecasting analysis to identify and construct adverse scenarios that are naturally interpretable as stress tests. These scenarios emerge from a particular pessimistic twist to a benchmark forecasting model, referred to as a ?worst case distribution?. This offers regulators a method of identifying vulnerabilities, even while acknowledging that their models are misspecified in possibly unknown ways. We first carry out our analysis in the familiar Linear-Quadratic framework of Hansen and Sargent (2008), based on an estimated VAR for the economy and linear regressions of bank performance on the state of the economy. We note, however, that the worst case so constructed features undesirable properties for our purpose in that it distorts moments that we would prefer were left undistorted. In response, we formulate a finite horizon robust forecasting problem in which the worst case distribution is required to respect certain moment conditions. In this framework, we are able to allow for rich nonlinearities in the benchmark process and more general loss functions than in the L-Q setup, thereby bringing our approach closer to applied use.

Suggested Citation

  • Rhys M. Bidder & Andrew McKenna, 2015. "Robust stress testing," Working Paper Series 2015-13, Federal Reserve Bank of San Francisco.
  • Handle: RePEc:fip:fedfwp:2015-13
    DOI: 10.24148/wp2015-13
    as

    Download full text from publisher

    File URL: http://www.frbsf.org/economic-research/files/wp2015-13.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://libkey.io/10.24148/wp2015-13?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tomasz Strzalecki, 2011. "Axiomatic Foundations of Multiplier Preferences," Econometrica, Econometric Society, vol. 79(1), pages 47-73, January.
    2. Beverly Hirtle & Til Schuermann & Kevin J. Stiroh, 2009. "Macroprudential supervision of financial institutions: lessons from the SCAP," Staff Reports 409, Federal Reserve Bank of New York.
    3. Lars Peter Hansen & Thomas J Sargent, 2014. "Doubts or Variability?," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 7, pages 217-256, World Scientific Publishing Co. Pte. Ltd..
    4. Breuer, Thomas & Csiszár, Imre, 2013. "Systematic stress tests with entropic plausibility constraints," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1552-1559.
    5. Hans, Erwin & Wullink, Gerhard & van Houdenhoven, Mark & Kazemier, Geert, 2008. "Robust surgery loading," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1038-1050, March.
    6. Daniel F. Waggoner & Tao Zha, 1999. "Conditional Forecasts In Dynamic Multivariate Models," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 639-651, November.
    7. Christensen, Jens H.E. & Lopez, Jose A. & Rudebusch, Glenn D., 2015. "A probability-based stress test of Federal Reserve assets and income," Journal of Monetary Economics, Elsevier, vol. 73(C), pages 26-43.
    8. Bidder, R.M. & Smith, M.E., 2012. "Robust animal spirits," Journal of Monetary Economics, Elsevier, vol. 59(8), pages 738-750.
    9. Paul Glasserman & Xingbo Xu, 2014. "Robust risk measurement and model risk," Quantitative Finance, Taylor & Francis Journals, vol. 14(1), pages 29-58, January.
    10. Schuermann, Til, 2014. "Stress testing banks," International Journal of Forecasting, Elsevier, vol. 30(3), pages 717-728.
    11. Robertson, John C & Tallman, Ellis W & Whiteman, Charles H, 2005. "Forecasting Using Relative Entropy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 383-401, June.
    12. Fabio Maccheroni & Massimo Marinacci & Aldo Rustichini, 2006. "Ambiguity Aversion, Robustness, and the Variational Representation of Preferences," Econometrica, Econometric Society, vol. 74(6), pages 1447-1498, November.
    13. Timothy Cogley & Riccardo Colacito & Lars Peter Hansen & Thomas J. Sargent, 2008. "Robustness and U.S. Monetary Policy Experimentation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(8), pages 1599-1623, December.
    14. Li-Lin Ku & Chien-Pai Han, 2008. "Robust testing procedures of process locations," Quality & Quantity: International Journal of Methodology, Springer, vol. 42(5), pages 579-595, October.
    15. Tom Pak-wing Fong & Chun-shan Wong, 2008. "Stress Testing Banks' Credit Risk Using Mixture Vector Autoregressive Models," Working Papers 0813, Hong Kong Monetary Authority.
    16. Giacomini, Raffaella & Ragusa, Giuseppe, 2014. "Theory-coherent forecasting," Journal of Econometrics, Elsevier, vol. 182(1), pages 145-155.
    17. White, Halbert & Kim, Tae-Hwan & Manganelli, Simone, 2015. "VAR for VaR: Measuring tail dependence using multivariate regression quantiles," Journal of Econometrics, Elsevier, vol. 187(1), pages 169-188.
    18. Glenn Hoggarth & Steffen Sorensen & Lea Zicchino, 2005. "Stress tests of UK banks using a VAR approach," Bank of England working papers 282, Bank of England.
    19. Bidder, R.M. & Smith, M.E., 2018. "Doubts and variability: A robust perspective on exotic consumption series," Journal of Economic Theory, Elsevier, vol. 175(C), pages 689-712.
    20. Lars Peter Hansen & Thomas J Sargent, 2014. "Three Types of Ambiguity," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 11, pages 379-430, World Scientific Publishing Co. Pte. Ltd..
    21. Cogley, Timothy & Morozov, Sergei & Sargent, Thomas J., 2005. "Bayesian fan charts for U.K. inflation: Forecasting and sources of uncertainty in an evolving monetary system," Journal of Economic Dynamics and Control, Elsevier, vol. 29(11), pages 1893-1925, November.
    22. Pritsker, Matthew, 2013. "Knightian uncertainty and interbank lending," Journal of Financial Intermediation, Elsevier, vol. 22(1), pages 85-105.
    23. Thomas Breuer & Martin Jandacka & Klaus Rheinberger & Martin Summer, 2009. "How to Find Plausible, Severe and Useful Stress Scenarios," International Journal of Central Banking, International Journal of Central Banking, vol. 5(3), pages 205-224, September.
    24. Daniel Ellsberg, 1961. "Risk, Ambiguity, and the Savage Axioms," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 75(4), pages 643-669.
    25. Paul Glasserman & Xingbo Xu, 2013. "Robust Portfolio Control with Stochastic Factor Dynamics," Operations Research, INFORMS, vol. 61(4), pages 874-893, August.
    26. Frederick T. Furlong, 2011. "Stress testing and bank capital supervision," FRBSF Economic Letter, Federal Reserve Bank of San Francisco, issue june27.
    27. Rhys M. Bidder & Ian Dew-Becker, 2014. "Long-Run Risk is the Worst-Case Scenario: Ambiguity Aversion and Non-Parametric Estimation of the Endowment Process," Working Paper Series 2014-16, Federal Reserve Bank of San Francisco.
    28. Lars Peter Hansen & Thomas J. Sargent, 2008. "Time Inconsistency of Robust Control?," Chapters, in: Roger E.A. Farmer (ed.), Macroeconomics in the Small and the Large, chapter 7, Edward Elgar Publishing.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael Jacobs, 2016. "Stress Testing and a Comparison of Alternative Methodologies for Scenario Generation," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 6(6), pages 1-7.
    2. Pierluigi Bologna & Anatoli Segura, 2017. "Integrating Stress Tests within the Basel III Capital Framework: A Macroprudentially Coherent Approach," Journal of Financial Regulation, Oxford University Press, vol. 3(2), pages 159-186.
    3. Pritsker, Matt, 2019. "An overview of regulatory stress-testing and steps to improve it," Global Finance Journal, Elsevier, vol. 39(C), pages 39-43.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rhys M. Bidder & Raffaella Giacomini & Andrew McKenna, 2016. "Stress Testing with Misspecified Models," Working Paper Series 2016-26, Federal Reserve Bank of San Francisco.
    2. Kwon, Hyosung & Miao, Jianjun, 2017. "Three types of robust Ramsey problems in a linear-quadratic framework," Journal of Economic Dynamics and Control, Elsevier, vol. 76(C), pages 211-231.
    3. Djeutem, Edouard, 2014. "Model uncertainty and the Forward Premium Puzzle," Journal of International Money and Finance, Elsevier, vol. 46(C), pages 16-40.
    4. Jianjun Miao & Alejandro Rivera, 2016. "Robust Contracts in Continuous Time," Econometrica, Econometric Society, vol. 84, pages 1405-1440, July.
    5. Xin Li & Borghan N. Narajabad & Ted Temzelides, 2014. "Robust Dynamic Optimal Taxation and Environmental Externalities," Finance and Economics Discussion Series 2014-75, Board of Governors of the Federal Reserve System (U.S.).
    6. Benigno, Pierpaolo & Paciello, Luigi, 2014. "Monetary policy, doubts and asset prices," Journal of Monetary Economics, Elsevier, vol. 64(C), pages 85-98.
    7. Dennis, Richard, 2014. "Imperfect credibility and robust monetary policy," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 218-234.
    8. Angelopoulos, Konstantinos & Malley, James, 2010. "Fear of model misspecifcation and the robustness premium," SIRE Discussion Papers 2010-79, Scottish Institute for Research in Economics (SIRE).
    9. Hansen, Lars Peter & Sargent, Thomas J., 2011. "Robustness and ambiguity in continuous time," Journal of Economic Theory, Elsevier, vol. 146(3), pages 1195-1223, May.
    10. Bidder, R.M. & Smith, M.E., 2018. "Doubts and variability: A robust perspective on exotic consumption series," Journal of Economic Theory, Elsevier, vol. 175(C), pages 689-712.
    11. Windsor, Callan & La Cava, Gianni & Hansen, James, 2015. "Home price beliefs: Evidence from Australia," Journal of Housing Economics, Elsevier, vol. 29(C), pages 41-58.
    12. Asano, Takao & Shibata, Akihisa, 2011. "Optimal pricing and quality choice of a monopolist under Knightian uncertainty," International Journal of Industrial Organization, Elsevier, vol. 29(6), pages 746-754.
    13. Flor, Christian Riis & Hesel, Søren, 2015. "Uncertain dynamics, correlation effects, and robust investment decisions," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 278-298.
    14. Hansen, Lars Peter & Sargent, Thomas J., 2015. "Four types of ignorance," Journal of Monetary Economics, Elsevier, vol. 69(C), pages 97-113.
    15. Massimo Marinacci, 2015. "Model Uncertainty," Journal of the European Economic Association, European Economic Association, vol. 13(6), pages 1022-1100, December.
    16. Rhys Bidder & Ian Dew-Becker, 2016. "Long-Run Risk Is the Worst-Case Scenario," American Economic Review, American Economic Association, vol. 106(9), pages 2494-2527, September.
    17. Kasa, Kenneth & Lei, Xiaowen, 2018. "Risk, uncertainty, and the dynamics of inequality," Journal of Monetary Economics, Elsevier, vol. 94(C), pages 60-78.
    18. Cukierman, Alex & Izhakian, Yehuda, 2015. "Bailout uncertainty in a microfounded general equilibrium model of the financial system," Journal of Banking & Finance, Elsevier, vol. 52(C), pages 160-179.
    19. Xu, Yuan, 2015. "Robustness to model uncertainty and the nominal term premium puzzle," Journal of Macroeconomics, Elsevier, vol. 44(C), pages 124-137.
    20. Karantounias, Anastasios G., 2023. "Doubts about the model and optimal policy," Journal of Economic Theory, Elsevier, vol. 210(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedfwp:2015-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Federal Reserve Bank of San Francisco Research Library (email available below). General contact details of provider: https://edirc.repec.org/data/frbsfus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.