IDEAS home Printed from https://ideas.repec.org/a/pal/risman/v25y2023i4d10.1057_s41283-023-00129-x.html
   My bibliography  Save this article

Unaccounted model risk for Basel IRB models deemed acceptable by conventional validation criteria

Author

Listed:
  • Henry Penikas

    (Bank of Russia)

Abstract

Validation procedures are designed to prevent IRB models with model risk from being used in day-to-day business operations. The models that do pass are expected to entail negligible model risk. However, no one has studied the magnitude of such risk. Moreover, most of the prior literature criticises the IRB models either for missing certain features (such as concentration) or for being overconservative due to reliance on the 99.9% confidence level. By simulating around 700 scenarios for the hypothetical loan book, we are able to demonstrate the materiality of the model risk of the accepted IRB models. In addition, we explain that the accuracy of the conservative margin adjusting model calibration cannot offset the underlying model risk when the discriminatory power is not perfect (which is almost always the case). Ultimately, we arrive at suggested risk-weight (RW) mark-ups which enable the revealed and previously unaccounted for IRB model risk to be captured.

Suggested Citation

  • Henry Penikas, 2023. "Unaccounted model risk for Basel IRB models deemed acceptable by conventional validation criteria," Risk Management, Palgrave Macmillan, vol. 25(4), pages 1-25, December.
  • Handle: RePEc:pal:risman:v:25:y:2023:i:4:d:10.1057_s41283-023-00129-x
    DOI: 10.1057/s41283-023-00129-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41283-023-00129-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1057/s41283-023-00129-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Loffler, Gunter, 2003. "The effects of estimation error on measures of portfolio credit risk," Journal of Banking & Finance, Elsevier, vol. 27(8), pages 1427-1453, August.
    2. Bruno, Valentina & Shin, Hyun Song, 2015. "Capital flows and the risk-taking channel of monetary policy," Journal of Monetary Economics, Elsevier, vol. 71(C), pages 119-132.
    3. Robert Gibbons, 2005. "Incentives Between Firms (and Within)," Management Science, INFORMS, vol. 51(1), pages 2-17, January.
    4. Stephen G. Cecchetti & Lianfa Li, 2008. "Do Capital Adequacy Requirements Matter For Monetary Policy?," Economic Inquiry, Western Economic Association International, vol. 46(4), pages 643-659, October.
    5. Schoors, Koen & Semenova, Maria & Zubanov, Andrey, 2019. "Depositor discipline during crisis: Flight to familiarity or trust in local authorities?," Journal of Financial Stability, Elsevier, vol. 43(C), pages 25-39.
    6. Nikola Tarashev & Haibin Zhu, 2008. "Specification and Calibration Errors in Measures of Portfolio Credit Risk: The Case of the ASRF Model," International Journal of Central Banking, International Journal of Central Banking, vol. 4(2), pages 129-173, June.
    7. Tarashev, Nikola, 2010. "Measuring portfolio credit risk correctly: Why parameter uncertainty matters," Journal of Banking & Finance, Elsevier, vol. 34(9), pages 2065-2076, September.
    8. Gabriel Jiménez & Steven Ongena & José‐Luis Peydró & Jesús Saurina, 2014. "Hazardous Times for Monetary Policy: What Do Twenty‐Three Million Bank Loans Say About the Effects of Monetary Policy on Credit Risk‐Taking?," Econometrica, Econometric Society, vol. 82(2), pages 463-505, March.
    9. M. V. Pomazanov, 2022. "Second-order accuracy metrics for scoring models and their practical use," Papers 2204.07989, arXiv.org, revised Nov 2022.
    10. J. A. Mirrlees, 1999. "The Theory of Moral Hazard and Unobservable Behaviour: Part I," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(1), pages 3-21.
    11. Grossman, Sanford J & Hart, Oliver D, 1983. "An Analysis of the Principal-Agent Problem," Econometrica, Econometric Society, vol. 51(1), pages 7-45, January.
    12. Kozodoi, Nikita & Jacob, Johannes & Lessmann, Stefan, 2022. "Fairness in credit scoring: Assessment, implementation and profit implications," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1083-1094.
    13. Nikita Kozodoi & Johannes Jacob & Stefan Lessmann, 2021. "Fairness in Credit Scoring: Assessment, Implementation and Profit Implications," Papers 2103.01907, arXiv.org, revised Jun 2022.
    14. Krämer, Walter & Neumärker, Simon, 2019. "Skill Scores and modified Lorenz domination in default forecasts," Economics Letters, Elsevier, vol. 181(C), pages 61-64.
    15. Roman Tikhonov & Aleksey Masyutin & Vadim Anpilogov, 2021. "The Relationship Between the Financial Performance of Banks and the Quality of Credit Scoring Models," Russian Journal of Money and Finance, Bank of Russia, vol. 80(2), pages 76-95, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Henry Penikas, 2022. "Model Risk for Acceptable, but Imperfect, Discrimination and Calibration in Basel PD and LGD Models," Bank of Russia Working Paper Series wps92, Bank of Russia.
    2. Henry Penikas, 2012. "An Optimal Incentive Contract Preventing Excessive Risk-Taking by a Bank Manager," HSE Working papers WP BRP 03/FE/2012, National Research University Higher School of Economics.
    3. Stijn Claessens & M Ayhan Kose, 2018. "Frontiers of macrofinancial linkages," BIS Papers, Bank for International Settlements, number 95.
    4. Lee, Seung Jung & Liu, Lucy Qian & Stebunovs, Viktors, 2022. "Risk-taking spillovers of U.S. monetary policy in the global market for U.S. dollar corporate loans," Journal of Banking & Finance, Elsevier, vol. 138(C).
    5. Seung Jung Lee & Lucy Qian Liu & Viktors Stebunovs, 2017. "Risk Taking and Interest Rates: Evidence from Decades in the Global Syndicated Loan Market," IMF Working Papers 2017/016, International Monetary Fund.
    6. Inés Macho-Stadler & David Pérez-Castrillo, 2018. "Moral hazard: Base models and two extensions," Chapters, in: Luis C. Corchón & Marco A. Marini (ed.), Handbook of Game Theory and Industrial Organization, Volume I, chapter 16, pages 453-485, Edward Elgar Publishing.
    7. Kabundi, Alain & De Simone, Francisco Nadal, 2020. "Monetary policy and systemic risk-taking in the euro area banking sector," Economic Modelling, Elsevier, vol. 91(C), pages 736-758.
    8. Jie Shi & Arno P. J. M. Siebes & Siamak Mehrkanoon, 2023. "TransCORALNet: A Two-Stream Transformer CORAL Networks for Supply Chain Credit Assessment Cold Start," Papers 2311.18749, arXiv.org.
    9. Chen Lian & Yueran Ma & Carmen Wang, 2019. "Low Interest Rates and Risk-Taking: Evidence from Individual Investment Decisions," Review of Financial Studies, Society for Financial Studies, vol. 32(6), pages 2107-2148.
    10. Cai, W. & Singham, D.I., 2018. "A principal–agent problem with heterogeneous demand distributions for a carbon capture and storage system," European Journal of Operational Research, Elsevier, vol. 264(1), pages 239-256.
    11. Kurtzman, Robert & Luck, Stephan & Zimmermann, Tom, 2022. "Did QE lead banks to relax their lending standards? Evidence from the Federal Reserve’s LSAPs," Journal of Banking & Finance, Elsevier, vol. 138(C).
    12. Yang Zhao & Zichun Xu, 2021. "The Impact of Cross-Border Capital Flows on the Chinese Banking System," SAGE Open, , vol. 11(2), pages 21582440211, June.
    13. Silvana M. Pesenti & Pietro Millossovich & Andreas Tsanakas, 2023. "Differential Sensitivity in Discontinuous Models," Papers 2310.06151, arXiv.org.
    14. Martin F. Hellwig & Klaus M. Schmidt, 2002. "Discrete-Time Approximations of the Holmstrom-Milgrom Brownian-Motion Model of Intertemporal Incentive Provision," Econometrica, Econometric Society, vol. 70(6), pages 2225-2264, November.
    15. Neuenkirch, Matthias & Nöckel, Matthias, 2018. "The risk-taking channel of monetary policy transmission in the euro area," Journal of Banking & Finance, Elsevier, vol. 93(C), pages 71-91.
    16. Ghossoub, Mario, 2010. "Supplement to "Belief heterogeneity in the Arrow-Borch-Raviv insurance model"," MPRA Paper 37717, University Library of Munich, Germany, revised 22 Mar 2012.
    17. João Barata Ribeiro Blanco Barroso, 2016. "Quantitative Easing and United States Investor Portfolio Rebalancing Towards Foreign Assets," Working Papers Series 420, Central Bank of Brazil, Research Department.
    18. Anna Langenberg & Shih-Chi Ma & Tatiana Ermakova & Benjamin Fabian, 2023. "Formal Group Fairness and Accuracy in Automated Decision Making," Mathematics, MDPI, vol. 11(8), pages 1-25, April.
    19. repec:zbw:bofrdp:2017_018 is not listed on IDEAS
    20. Jon Frost & Patty Duijm & Clemens Bonner & Leo Haan & Jakob Haan, 2019. "International Lending of Dutch Insurers and Pension Funds: the Impact of ECB Monetary Policy and Prudential Policies in the Host Country," Open Economies Review, Springer, vol. 30(3), pages 445-456, July.
    21. Mirman, Leonard J. & Santugini, Marc, 2013. "Firms, shareholders, and financial markets," The Quarterly Review of Economics and Finance, Elsevier, vol. 53(2), pages 152-164.

    More about this item

    Keywords

    Validation; IRB; Basel II; AUROC; CLAR; Loss shortfall; Brier skill score; Traffic light approach;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:risman:v:25:y:2023:i:4:d:10.1057_s41283-023-00129-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.