IDEAS home Printed from https://ideas.repec.org/p/war/wpaper/2020-18.html
   My bibliography  Save this paper

Towards better understanding of complex machine learning models using Explainable Artificial Intelligence (XAI) - case of Credit Scoring modelling

Author

Listed:
  • Marta Kłosok

    (Faculty of Economic Sciences, University of Warsaw)

  • Marcin Chlebus

    (Faculty of Economic Sciences, University of Warsaw)

Abstract

recent years many scientific journals have widely explored the topic of machine learning interpretability. It is important as application of Artificial Intelligence is growing rapidly and its excellent performance is of huge potential for many. There is also need for overcoming the barriers faced by analysts implementing intelligent systems. The biggest one relates to the problem of explaining why the model made a certain prediction. This work brings the topic of methods for understanding a black-box from both the global and local perspective. Numerous agnostic methods aimed at interpreting black-box model behavior and predictions generated by these complex structures are analyzed. Among them are: Permutation Feature Importance, Partial Dependence Plot, Individual Conditional Expectation Curve, Accumulated Local Effects, techniques approximating predictions of the black-box for single observations with surrogate models (interpretable white-boxes) and Shapley values framework. Our prospect leads toward the question to what extent presented tools enhance model transparency. All of the frameworks are examined in practice with a credit default data use case. The overview presented prove that each of the method has some limitations, but overall almost all summarized techniques produce reliable explanations and contribute to higher transparency accountability of decision systems.

Suggested Citation

  • Marta Kłosok & Marcin Chlebus, 2020. "Towards better understanding of complex machine learning models using Explainable Artificial Intelligence (XAI) - case of Credit Scoring modelling," Working Papers 2020-18, Faculty of Economic Sciences, University of Warsaw.
  • Handle: RePEc:war:wpaper:2020-18
    as

    Download full text from publisher

    File URL: https://www.wne.uw.edu.pl/index.php/download_file/5721/
    File Function: First version, 2020
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Michal Polena & Tobias Regner, 2018. "Determinants of Borrowers’ Default in P2P Lending under Consideration of the Loan Risk Class," Games, MDPI, vol. 9(4), pages 1-17, October.
    2. Nantian Huang & Guobo Lu & Dianguo Xu, 2016. "A Permutation Importance-Based Feature Selection Method for Short-Term Electricity Load Forecasting Using Random Forest," Energies, MDPI, vol. 9(10), pages 1-24, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ricardo Vazquez & Hortensia Amaris & Monica Alonso & Gregorio Lopez & Jose Ignacio Moreno & Daniel Olmeda & Javier Coca, 2017. "Assessment of an Adaptive Load Forecasting Methodology in a Smart Grid Demonstration Project," Energies, MDPI, vol. 10(2), pages 1-23, February.
    2. Kaneko, Nanae & Fujimoto, Yu & Hayashi, Yasuhiro, 2022. "Sensitivity analysis of factors relevant to extreme imbalance between procurement plans and actual demand: Case study of the Japanese electricity market," Applied Energy, Elsevier, vol. 313(C).
    3. Teply, Petr & Polena, Michal, 2020. "Best classification algorithms in peer-to-peer lending," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    4. Sangwan Lee, 2022. "Exploring Associations between Multimodality and Built Environment Characteristics in the U.S," Sustainability, MDPI, vol. 14(11), pages 1-16, May.
    5. Sangwan Lee, 2022. "Satisfaction with the Pedestrian Environment and Its Relationship to Neighborhood Satisfaction in Seoul, South Korea," Sustainability, MDPI, vol. 14(15), pages 1-15, July.
    6. Lu, Haitian & Wang, Bo & Wang, Haizhi & Zhao, Tianyu, 2020. "Does social capital matter for peer-to-peer-lending? Empirical evidence," Pacific-Basin Finance Journal, Elsevier, vol. 61(C).
    7. Dongkyu Lee & Jinhwa Jeong & Sung Hoon Yoon & Young Tae Chae, 2019. "Improvement of Short-Term BIPV Power Predictions Using Feature Engineering and a Recurrent Neural Network," Energies, MDPI, vol. 12(17), pages 1-17, August.
    8. Feras Alasali & Husam Foudeh & Esraa Mousa Ali & Khaled Nusair & William Holderbaum, 2021. "Forecasting and Modelling the Uncertainty of Low Voltage Network Demand and the Effect of Renewable Energy Sources," Energies, MDPI, vol. 14(8), pages 1-31, April.
    9. Chan-Uk Yeom & Keun-Chang Kwak, 2017. "Short-Term Electricity-Load Forecasting Using a TSK-Based Extreme Learning Machine with Knowledge Representation," Energies, MDPI, vol. 10(10), pages 1-18, October.
    10. Yanyan Cui & Lixin Liu, 2022. "Investor sentiment-aware prediction model for P2P lending indicators based on LSTM," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-17, January.
    11. Chiou-Jye Huang & Ping-Huan Kuo, 2018. "A Short-Term Wind Speed Forecasting Model by Using Artificial Neural Networks with Stochastic Optimization for Renewable Energy Systems," Energies, MDPI, vol. 11(10), pages 1-20, October.
    12. Francisco Martínez-Álvarez & Alicia Troncoso & José C. Riquelme, 2017. "Recent Advances in Energy Time Series Forecasting," Energies, MDPI, vol. 10(6), pages 1-3, June.
    13. Yan Wang & Xuelei Sherry Ni, 2020. "Improving Investment Suggestions for Peer-to-Peer (P2P) Lending via Integrating Credit Scoring into Profit Scoring," Papers 2009.04536, arXiv.org.
    14. Nigmonov, Asror & Shams, Syed & Alam, Khorshed, 2022. "Macroeconomic determinants of loan defaults: Evidence from the U.S. peer-to-peer lending market," Research in International Business and Finance, Elsevier, vol. 59(C).
    15. Jiabao Du & Changxi Yue & Ying Shi & Jicheng Yu & Fan Sun & Changjun Xie & Tao Su, 2021. "A Frequency Decomposition-Based Hybrid Forecasting Algorithm for Short-Term Reactive Power," Energies, MDPI, vol. 14(20), pages 1-18, October.
    16. Kaneko, Nanae & Fujimoto, Yu & Kabe, Satoshi & Hayashida, Motonari & Hayashi, Yasuhiro, 2020. "Sparse modeling approach for identifying the dominant factors affecting situation-dependent hourly electricity demand," Applied Energy, Elsevier, vol. 265(C).
    17. Serena Gallo, 2021. "Fintech platforms: Lax or careful borrowers’ screening?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-33, December.
    18. Tomasz Ciechulski & Stanisław Osowski, 2020. "Deep Learning Approach to Power Demand Forecasting in Polish Power System," Energies, MDPI, vol. 13(22), pages 1-13, November.
    19. Ji-Yoon Kim & Sung-Bae Cho, 2019. "Towards Repayment Prediction in Peer-to-Peer Social Lending Using Deep Learning," Mathematics, MDPI, vol. 7(11), pages 1-17, November.
    20. Yundong Gu & Dongfen Ma & Jiawei Cui & Zhenhua Li & Yaqi Chen, 2022. "Variable-Weighted Ensemble Forecasting of Short-Term Power Load Based on Factor Space Theory," Annals of Data Science, Springer, vol. 9(3), pages 485-501, June.

    More about this item

    Keywords

    machine learning; explainable Artificial Intelligence; visualization techniques; model interpretation; variable importance;
    All these keywords.

    JEL classification:

    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:war:wpaper:2020-18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marcin Bąba (email available below). General contact details of provider: https://edirc.repec.org/data/fesuwpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.