IDEAS home Printed from https://ideas.repec.org/a/pal/risman/v25y2023i4d10.1057_s41283-023-00129-x.html
   My bibliography  Save this article

Unaccounted model risk for Basel IRB models deemed acceptable by conventional validation criteria

Author

Listed:
  • Henry Penikas

    (Bank of Russia)

Abstract

Validation procedures are designed to prevent IRB models with model risk from being used in day-to-day business operations. The models that do pass are expected to entail negligible model risk. However, no one has studied the magnitude of such risk. Moreover, most of the prior literature criticises the IRB models either for missing certain features (such as concentration) or for being overconservative due to reliance on the 99.9% confidence level. By simulating around 700 scenarios for the hypothetical loan book, we are able to demonstrate the materiality of the model risk of the accepted IRB models. In addition, we explain that the accuracy of the conservative margin adjusting model calibration cannot offset the underlying model risk when the discriminatory power is not perfect (which is almost always the case). Ultimately, we arrive at suggested risk-weight (RW) mark-ups which enable the revealed and previously unaccounted for IRB model risk to be captured.

Suggested Citation

  • Henry Penikas, 2023. "Unaccounted model risk for Basel IRB models deemed acceptable by conventional validation criteria," Risk Management, Palgrave Macmillan, vol. 25(4), pages 1-25, December.
  • Handle: RePEc:pal:risman:v:25:y:2023:i:4:d:10.1057_s41283-023-00129-x
    DOI: 10.1057/s41283-023-00129-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41283-023-00129-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1057/s41283-023-00129-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bruno, Valentina & Shin, Hyun Song, 2015. "Capital flows and the risk-taking channel of monetary policy," Journal of Monetary Economics, Elsevier, vol. 71(C), pages 119-132.
    2. Schoors, Koen & Semenova, Maria & Zubanov, Andrey, 2019. "Depositor discipline during crisis: Flight to familiarity or trust in local authorities?," Journal of Financial Stability, Elsevier, vol. 43(C), pages 25-39.
    3. Gabriel Jiménez & Steven Ongena & José‐Luis Peydró & Jesús Saurina, 2014. "Hazardous Times for Monetary Policy: What Do Twenty‐Three Million Bank Loans Say About the Effects of Monetary Policy on Credit Risk‐Taking?," Econometrica, Econometric Society, vol. 82(2), pages 463-505, March.
    4. Stephen G. Cecchetti & Lianfa Li, 2008. "Do Capital Adequacy Requirements Matter For Monetary Policy?," Economic Inquiry, Western Economic Association International, vol. 46(4), pages 643-659, October.
    5. Grossman, Sanford J & Hart, Oliver D, 1983. "An Analysis of the Principal-Agent Problem," Econometrica, Econometric Society, vol. 51(1), pages 7-45, January.
    6. Nikita Kozodoi & Johannes Jacob & Stefan Lessmann, 2021. "Fairness in Credit Scoring: Assessment, Implementation and Profit Implications," Papers 2103.01907, arXiv.org, revised Jun 2022.
    7. Loffler, Gunter, 2003. "The effects of estimation error on measures of portfolio credit risk," Journal of Banking & Finance, Elsevier, vol. 27(8), pages 1427-1453, August.
    8. Robert Gibbons, 2005. "Incentives Between Firms (and Within)," Management Science, INFORMS, vol. 51(1), pages 2-17, January.
    9. Nikola Tarashev & Haibin Zhu, 2008. "Specification and Calibration Errors in Measures of Portfolio Credit Risk: The Case of the ASRF Model," International Journal of Central Banking, International Journal of Central Banking, vol. 4(2), pages 129-173, June.
    10. Tarashev, Nikola, 2010. "Measuring portfolio credit risk correctly: Why parameter uncertainty matters," Journal of Banking & Finance, Elsevier, vol. 34(9), pages 2065-2076, September.
    11. M. V. Pomazanov, 2022. "Second-order accuracy metrics for scoring models and their practical use," Papers 2204.07989, arXiv.org, revised Nov 2022.
    12. J. A. Mirrlees, 1999. "The Theory of Moral Hazard and Unobservable Behaviour: Part I," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 3-21.
    13. Kozodoi, Nikita & Jacob, Johannes & Lessmann, Stefan, 2022. "Fairness in credit scoring: Assessment, implementation and profit implications," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1083-1094.
    14. Krämer, Walter & Neumärker, Simon, 2019. "Skill Scores and modified Lorenz domination in default forecasts," Economics Letters, Elsevier, vol. 181(C), pages 61-64.
    15. Roman Tikhonov & Aleksey Masyutin & Vadim Anpilogov, 2021. "The Relationship Between the Financial Performance of Banks and the Quality of Credit Scoring Models," Russian Journal of Money and Finance, Bank of Russia, vol. 80(2), pages 76-95, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Henry Penikas, 2022. "Model Risk for Acceptable, but Imperfect, Discrimination and Calibration in Basel PD and LGD Models," Bank of Russia Working Paper Series wps92, Bank of Russia.
    2. Henry Penikas, 2012. "An Optimal Incentive Contract Preventing Excessive Risk-Taking by a Bank Manager," HSE Working papers WP BRP 03/FE/2012, National Research University Higher School of Economics.
    3. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    4. Lee, Seung Jung & Liu, Lucy Qian & Stebunovs, Viktors, 2022. "Risk-taking spillovers of U.S. monetary policy in the global market for U.S. dollar corporate loans," Journal of Banking & Finance, Elsevier, vol. 138(C).
    5. Chen Lian & Yueran Ma & Carmen Wang, 2019. "Low Interest Rates and Risk-Taking: Evidence from Individual Investment Decisions," The Review of Financial Studies, Society for Financial Studies, vol. 32(6), pages 2107-2148.
    6. Cai, W. & Singham, D.I., 2018. "A principal–agent problem with heterogeneous demand distributions for a carbon capture and storage system," European Journal of Operational Research, Elsevier, vol. 264(1), pages 239-256.
    7. Silvana M. Pesenti & Pietro Millossovich & Andreas Tsanakas, 2023. "Differential Sensitivity in Discontinuous Models," Papers 2310.06151, arXiv.org.
    8. Martin F. Hellwig & Klaus M. Schmidt, 2002. "Discrete-Time Approximations of the Holmstrom-Milgrom Brownian-Motion Model of Intertemporal Incentive Provision," Econometrica, Econometric Society, vol. 70(6), pages 2225-2264, November.
    9. Neuenkirch, Matthias & Nöckel, Matthias, 2018. "The risk-taking channel of monetary policy transmission in the euro area," Journal of Banking & Finance, Elsevier, vol. 93(C), pages 71-91.
    10. Ghossoub, Mario, 2010. "Supplement to "Belief heterogeneity in the Arrow-Borch-Raviv insurance model"," MPRA Paper 37717, University Library of Munich, Germany, revised 22 Mar 2012.
    11. Anna Langenberg & Shih-Chi Ma & Tatiana Ermakova & Benjamin Fabian, 2023. "Formal Group Fairness and Accuracy in Automated Decision Making," Mathematics, MDPI, vol. 11(8), pages 1-25, April.
    12. repec:zbw:bofrdp:2017_018 is not listed on IDEAS
    13. Mirman, Leonard J. & Santugini, Marc, 2013. "Firms, shareholders, and financial markets," The Quarterly Review of Economics and Finance, Elsevier, vol. 53(2), pages 152-164.
    14. Nicolás Hernández Santibáñez & Dylan Possamaï & Chao Zhou, 2017. "Bank monitoring incentives under moral hazard and adverse selection," Working Papers hal-01435460, HAL.
    15. Yao Axel Ehouman, 2020. "Do oil-market shocks drive global liquidity?," EconomiX Working Papers 2020-33, University of Paris Nanterre, EconomiX.
    16. Fabiani, Andrea & Piñeros, Martha López & Peydró, José-Luis & Soto, Paul E., 2022. "Capital controls, domestic macroprudential policy and the bank lending channel of monetary policy," Journal of International Economics, Elsevier, vol. 139(C).
    17. Lilit Popoyan, 2020. "Macroprudential Policy: a Blessing or a Curse?," Review of Economics and Institutions, Università di Perugia, vol. 11(1-2).
    18. Balmaceda, Felipe & Balseiro, Santiago R. & Correa, José R. & Stier-Moses, Nicolás E., 2016. "Bounds on the welfare loss from moral hazard with limited liability," Games and Economic Behavior, Elsevier, vol. 95(C), pages 137-155.
    19. Agur, Itai, 2019. "Monetary and macroprudential policy coordination among multiple equilibria," Journal of International Money and Finance, Elsevier, vol. 96(C), pages 192-209.
    20. Nuno Coimbra & Hélène Rey, 2017. "Financial Cycles with Heterogeneous Intermediaries," NBER Working Papers 23245, National Bureau of Economic Research, Inc.
    21. Malcomson James M, 2009. "Principal and Expert Agent," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 9(1), pages 1-36, May.

    More about this item

    Keywords

    Validation; IRB; Basel II; AUROC; CLAR; Loss shortfall; Brier skill score; Traffic light approach;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:risman:v:25:y:2023:i:4:d:10.1057_s41283-023-00129-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.