IDEAS home Printed from https://ideas.repec.org/p/fip/fedfwp/2016-26.html
   My bibliography  Save this paper

Stress Testing with Misspecified Models

Author

Listed:
  • Rhys M. Bidder
  • Raffaella Giacomini
  • Andrew McKenna

Abstract

Stress testing has become an important component of macroprudential regulation yet its goals and implementation are still being debated, reflecting the difficulty of designing such frameworks in the context of enormous model uncertainty. We illustrate methods for responding to possible misspecifications in models used for assessing bank vulnerabilities. We show how ?exponential tilting? allows the incorporation of external judgment, captured in moment conditions, into a forecasting model as a partial correction for misspecification. We also make use of methods from robust control to seek the most relevant dimensions in which a regulator?s forecasting model might be misspecified?a search for a ?worst case? model that is a ?twisted? version of the regulator?s initial forecasting model. Finally, we show how the two approaches can be blended so that one can search for a worst case model subject to restrictions on its properties, informed by the regulator?s judgment. We demonstrate the methods using the New York Fed?s CLASS model, a top-down capital stress testing framework that projects the effect of macroeconomic scenarios on U.S. banking firms.

Suggested Citation

  • Rhys M. Bidder & Raffaella Giacomini & Andrew McKenna, 2016. "Stress Testing with Misspecified Models," Working Paper Series 2016-26, Federal Reserve Bank of San Francisco.
  • Handle: RePEc:fip:fedfwp:2016-26
    DOI: 10.24148/wp2016-26
    Note: Corresponding author: rhys.bidder@sf.frb.org
    as

    Download full text from publisher

    File URL: http://www.frbsf.org/economic-research/files/wp2016-26.pdf
    File Function: Full text
    Download Restriction: no

    File URL: https://libkey.io/10.24148/wp2016-26?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Breuer, Thomas & Csiszár, Imre, 2013. "Systematic stress tests with entropic plausibility constraints," Journal of Banking & Finance, Elsevier, vol. 37(5), pages 1552-1559.
    2. Jing Cynthia Wu & Fan Dora Xia, 2016. "Measuring the Macroeconomic Impact of Monetary Policy at the Zero Lower Bound," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 48(2-3), pages 253-291, March.
    3. Hans, Erwin & Wullink, Gerhard & van Houdenhoven, Mark & Kazemier, Geert, 2008. "Robust surgery loading," European Journal of Operational Research, Elsevier, vol. 185(3), pages 1038-1050, March.
    4. Danielsson, Jon & James, Kevin R. & Valenzuela, Marcela & Zer, Ilknur, 2016. "Model risk of risk models," Journal of Financial Stability, Elsevier, vol. 23(C), pages 79-91.
    5. Andreas Lehnert & Beverly Hirtle, 2015. "Supervisory Stress Tests," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 339-355, December.
    6. Paul Glasserman & Xingbo Xu, 2014. "Robust risk measurement and model risk," Quantitative Finance, Taylor & Francis Journals, vol. 14(1), pages 29-58, January.
    7. Robertson, John C & Tallman, Ellis W & Whiteman, Charles H, 2005. "Forecasting Using Relative Entropy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 383-401, June.
    8. Timothy Cogley & Riccardo Colacito & Lars Peter Hansen & Thomas J. Sargent, 2008. "Robustness and U.S. Monetary Policy Experimentation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(8), pages 1599-1623, December.
    9. Li-Lin Ku & Chien-Pai Han, 2008. "Robust testing procedures of process locations," Quality & Quantity: International Journal of Methodology, Springer, vol. 42(5), pages 579-595, October.
    10. Giacomini, Raffaella & Ragusa, Giuseppe, 2014. "Theory-coherent forecasting," Journal of Econometrics, Elsevier, vol. 182(1), pages 145-155.
    11. Lars Peter Hansen & Thomas J Sargent, 2014. "Three Types of Ambiguity," World Scientific Book Chapters, in: UNCERTAINTY WITHIN ECONOMIC MODELS, chapter 11, pages 379-430, World Scientific Publishing Co. Pte. Ltd..
    12. Cogley, Timothy & Morozov, Sergei & Sargent, Thomas J., 2005. "Bayesian fan charts for U.K. inflation: Forecasting and sources of uncertainty in an evolving monetary system," Journal of Economic Dynamics and Control, Elsevier, vol. 29(11), pages 1893-1925, November.
    13. Thomas J. Sargent & Riccardo Colacito & Lars P. Hansen & Timothy Cogley, 2008. "Robustness and US Monetary," 2008 Meeting Papers 228, Society for Economic Dynamics.
    14. Pritsker, Matthew, 2013. "Knightian uncertainty and interbank lending," Journal of Financial Intermediation, Elsevier, vol. 22(1), pages 85-105.
    15. Paul Glasserman & Xingbo Xu, 2013. "Robust Portfolio Control with Stochastic Factor Dynamics," Operations Research, INFORMS, vol. 61(4), pages 874-893, August.
    16. Lars Peter Hansen & Thomas J. Sargent, 2008. "Time Inconsistency of Robust Control?," Chapters, in: Roger E.A. Farmer (ed.), Macroeconomics in the Small and the Large, chapter 7, Edward Elgar Publishing.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael W. McCracken & Joseph T. McGillicuddy, 2019. "An empirical investigation of direct and iterated multistep conditional forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(2), pages 181-204, March.
    2. Bidder, R.M. & Smith, M.E., 2018. "Doubts and variability: A robust perspective on exotic consumption series," Journal of Economic Theory, Elsevier, vol. 175(C), pages 689-712.
    3. Kupiec, Paul H., 2018. "On the accuracy of alternative approaches for calibrating bank stress test models," Journal of Financial Stability, Elsevier, vol. 38(C), pages 132-146.
    4. Jose Fique, 2017. "The MacroFinancial Risk Assessment Framework (MFRAF), Version 2.0," Technical Reports 111, Bank of Canada.
    5. Ho, Paul, 2023. "Global robust Bayesian analysis in large models," Journal of Econometrics, Elsevier, vol. 235(2), pages 608-642.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew McKenna & Rhys Bidder, 2014. "Robust Stress Testing," 2014 Meeting Papers 853, Society for Economic Dynamics.
    2. Dennis, Richard, 2014. "Imperfect credibility and robust monetary policy," Journal of Economic Dynamics and Control, Elsevier, vol. 44(C), pages 218-234.
    3. Kwon, Hyosung & Miao, Jianjun, 2017. "Three types of robust Ramsey problems in a linear-quadratic framework," Journal of Economic Dynamics and Control, Elsevier, vol. 76(C), pages 211-231.
    4. Sorge, Marco M., 2013. "Robust delegation with uncertain monetary policy preferences," Economic Modelling, Elsevier, vol. 30(C), pages 73-78.
    5. Angelopoulos, Konstantinos & Malley, James, 2010. "Fear of model misspecifcation and the robustness premium," SIRE Discussion Papers 2010-79, Scottish Institute for Research in Economics (SIRE).
    6. James Costain & Anton Nakov, 2019. "Logit Price Dynamics," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 51(1), pages 43-78, February.
    7. Hansen, Lars Peter & Sargent, Thomas J., 2011. "Robustness and ambiguity in continuous time," Journal of Economic Theory, Elsevier, vol. 146(3), pages 1195-1223, May.
    8. Jianjun Miao & Alejandro Rivera, 2016. "Robust Contracts in Continuous Time," Econometrica, Econometric Society, vol. 84, pages 1405-1440, July.
    9. Qin, Li & Sidiropoulos, Moïse & Spyromitros, Eleftherios, 2013. "Robust monetary policy under model uncertainty and inflation persistence," Economic Modelling, Elsevier, vol. 30(C), pages 721-728.
    10. Zhao, Guihai, 2017. "Confidence, bond risks, and equity returns," Journal of Financial Economics, Elsevier, vol. 126(3), pages 668-688.
    11. Xin Li & Borghan N. Narajabad & Ted Temzelides, 2014. "Robust Dynamic Optimal Taxation and Environmental Externalities," Finance and Economics Discussion Series 2014-75, Board of Governors of the Federal Reserve System (U.S.).
    12. Asano, Takao & Shibata, Akihisa, 2011. "Optimal pricing and quality choice of a monopolist under Knightian uncertainty," International Journal of Industrial Organization, Elsevier, vol. 29(6), pages 746-754.
    13. Hansen, Lars Peter & Sargent, Thomas J., 2015. "Four types of ignorance," Journal of Monetary Economics, Elsevier, vol. 69(C), pages 97-113.
    14. Kasa, Kenneth & Lei, Xiaowen, 2018. "Risk, uncertainty, and the dynamics of inequality," Journal of Monetary Economics, Elsevier, vol. 94(C), pages 60-78.
    15. Bunten, Devin & Kahn, Matthew E., 2017. "Optimal real estate capital durability and localized climate change disaster risk," Journal of Housing Economics, Elsevier, vol. 36(C), pages 1-7.
    16. Djeutem, Edouard, 2014. "Model uncertainty and the Forward Premium Puzzle," Journal of International Money and Finance, Elsevier, vol. 46(C), pages 16-40.
    17. Iverson, Terrence, 2012. "Communicating Trade-offs amid Controversial Science: Decision Support for Climate Policy," Ecological Economics, Elsevier, vol. 77(C), pages 74-90.
    18. Schumacher Johannes M., 2018. "Distortion risk measures, ROC curves, and distortion divergence," Statistics & Risk Modeling, De Gruyter, vol. 35(1-2), pages 35-50, January.
    19. Paolo Vitale, 2017. "Ambiguity-aversion in a Single Auction Market," Economics Bulletin, AccessEcon, vol. 37(3), pages 1745-1752.
    20. Dennis, Richard, 2013. "Asset Prices, Business Cycles, and Markov-Perfect Fiscal Policy when Agents are Risk-Sensitive," SIRE Discussion Papers 2013-79, Scottish Institute for Research in Economics (SIRE).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedfwp:2016-26. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Federal Reserve Bank of San Francisco Research Library (email available below). General contact details of provider: https://edirc.repec.org/data/frbsfus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.