IDEAS home Printed from https://ideas.repec.org/p/war/wpaper/2020-18.html
   My bibliography  Save this paper

Towards better understanding of complex machine learning models using Explainable Artificial Intelligence (XAI) - case of Credit Scoring modelling

Author

Listed:
  • Marta Kłosok

    (Faculty of Economic Sciences, University of Warsaw)

  • Marcin Chlebus

    (Faculty of Economic Sciences, University of Warsaw)

Abstract

recent years many scientific journals have widely explored the topic of machine learning interpretability. It is important as application of Artificial Intelligence is growing rapidly and its excellent performance is of huge potential for many. There is also need for overcoming the barriers faced by analysts implementing intelligent systems. The biggest one relates to the problem of explaining why the model made a certain prediction. This work brings the topic of methods for understanding a black-box from both the global and local perspective. Numerous agnostic methods aimed at interpreting black-box model behavior and predictions generated by these complex structures are analyzed. Among them are: Permutation Feature Importance, Partial Dependence Plot, Individual Conditional Expectation Curve, Accumulated Local Effects, techniques approximating predictions of the black-box for single observations with surrogate models (interpretable white-boxes) and Shapley values framework. Our prospect leads toward the question to what extent presented tools enhance model transparency. All of the frameworks are examined in practice with a credit default data use case. The overview presented prove that each of the method has some limitations, but overall almost all summarized techniques produce reliable explanations and contribute to higher transparency accountability of decision systems.

Suggested Citation

  • Marta Kłosok & Marcin Chlebus, 2020. "Towards better understanding of complex machine learning models using Explainable Artificial Intelligence (XAI) - case of Credit Scoring modelling," Working Papers 2020-18, Faculty of Economic Sciences, University of Warsaw.
  • Handle: RePEc:war:wpaper:2020-18
    as

    Download full text from publisher

    File URL: https://www.wne.uw.edu.pl/index.php/download_file/5721/
    File Function: First version, 2020
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Michal Polena & Tobias Regner, 2018. "Determinants of Borrowers’ Default in P2P Lending under Consideration of the Loan Risk Class," Games, MDPI, vol. 9(4), pages 1-17, October.
    2. Nantian Huang & Guobo Lu & Dianguo Xu, 2016. "A Permutation Importance-Based Feature Selection Method for Short-Term Electricity Load Forecasting Using Random Forest," Energies, MDPI, vol. 9(10), pages 1-24, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Teply, Petr & Polena, Michal, 2020. "Best classification algorithms in peer-to-peer lending," The North American Journal of Economics and Finance, Elsevier, vol. 51(C).
    2. Lu, Haitian & Wang, Bo & Wang, Haizhi & Zhao, Tianyu, 2020. "Does social capital matter for peer-to-peer-lending? Empirical evidence," Pacific-Basin Finance Journal, Elsevier, vol. 61(C).
    3. Chan-Uk Yeom & Keun-Chang Kwak, 2017. "Short-Term Electricity-Load Forecasting Using a TSK-Based Extreme Learning Machine with Knowledge Representation," Energies, MDPI, vol. 10(10), pages 1-18, October.
    4. Yanyan Cui & Lixin Liu, 2022. "Investor sentiment-aware prediction model for P2P lending indicators based on LSTM," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-17, January.
    5. Chiou-Jye Huang & Ping-Huan Kuo, 2018. "A Short-Term Wind Speed Forecasting Model by Using Artificial Neural Networks with Stochastic Optimization for Renewable Energy Systems," Energies, MDPI, vol. 11(10), pages 1-20, October.
    6. Francisco Martínez-Álvarez & Alicia Troncoso & José C. Riquelme, 2017. "Recent Advances in Energy Time Series Forecasting," Energies, MDPI, vol. 10(6), pages 1-3, June.
    7. Yan Wang & Xuelei Sherry Ni, 2020. "Improving Investment Suggestions for Peer-to-Peer (P2P) Lending via Integrating Credit Scoring into Profit Scoring," Papers 2009.04536, arXiv.org.
    8. Nigmonov, Asror & Shams, Syed & Alam, Khorshed, 2022. "Macroeconomic determinants of loan defaults: Evidence from the U.S. peer-to-peer lending market," Research in International Business and Finance, Elsevier, vol. 59(C).
    9. Jiabao Du & Changxi Yue & Ying Shi & Jicheng Yu & Fan Sun & Changjun Xie & Tao Su, 2021. "A Frequency Decomposition-Based Hybrid Forecasting Algorithm for Short-Term Reactive Power," Energies, MDPI, vol. 14(20), pages 1-18, October.
    10. Serena Gallo, 2021. "Fintech platforms: Lax or careful borrowers’ screening?," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-33, December.
    11. Ji-Yoon Kim & Sung-Bae Cho, 2019. "Towards Repayment Prediction in Peer-to-Peer Social Lending Using Deep Learning," Mathematics, MDPI, vol. 7(11), pages 1-17, November.
    12. Yundong Gu & Dongfen Ma & Jiawei Cui & Zhenhua Li & Yaqi Chen, 2022. "Variable-Weighted Ensemble Forecasting of Short-Term Power Load Based on Factor Space Theory," Annals of Data Science, Springer, vol. 9(3), pages 485-501, June.
    13. Yeujun Yoon & Yu Li & Yan Feng, 2019. "Factors affecting platform default risk in online peer-to-peer (P2P) lending business: an empirical study using Chinese online P2P platform data," Electronic Commerce Research, Springer, vol. 19(1), pages 131-158, March.
    14. Li, Chuan & Tao, Ying & Ao, Wengang & Yang, Shuai & Bai, Yun, 2018. "Improving forecasting accuracy of daily enterprise electricity consumption using a random forest based on ensemble empirical mode decomposition," Energy, Elsevier, vol. 165(PB), pages 1220-1227.
    15. Ping-Huan Kuo & Chiou-Jye Huang, 2018. "An Electricity Price Forecasting Model by Hybrid Structured Deep Neural Networks," Sustainability, MDPI, vol. 10(4), pages 1-17, April.
    16. Peng Liu & Peijun Zheng & Ziyu Chen, 2019. "Deep Learning with Stacked Denoising Auto-Encoder for Short-Term Electric Load Forecasting," Energies, MDPI, vol. 12(12), pages 1-15, June.
    17. Peplinski, McKenna & Dilkina, Bistra & Chen, Mo & Silva, Sam J. & Ban-Weiss, George A. & Sanders, Kelly T., 2024. "A machine learning framework to estimate residential electricity demand based on smart meter electricity, climate, building characteristics, and socioeconomic datasets," Applied Energy, Elsevier, vol. 357(C).
    18. Ricardo Vazquez & Hortensia Amaris & Monica Alonso & Gregorio Lopez & Jose Ignacio Moreno & Daniel Olmeda & Javier Coca, 2017. "Assessment of an Adaptive Load Forecasting Methodology in a Smart Grid Demonstration Project," Energies, MDPI, vol. 10(2), pages 1-23, February.
    19. Kaneko, Nanae & Fujimoto, Yu & Hayashi, Yasuhiro, 2022. "Sensitivity analysis of factors relevant to extreme imbalance between procurement plans and actual demand: Case study of the Japanese electricity market," Applied Energy, Elsevier, vol. 313(C).
    20. Sangwan Lee, 2022. "Exploring Associations between Multimodality and Built Environment Characteristics in the U.S," Sustainability, MDPI, vol. 14(11), pages 1-16, May.

    More about this item

    Keywords

    machine learning; explainable Artificial Intelligence; visualization techniques; model interpretation; variable importance;
    All these keywords.

    JEL classification:

    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:war:wpaper:2020-18. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marcin Bąba (email available below). General contact details of provider: https://edirc.repec.org/data/fesuwpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.