IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v87y2023ipbs0038012123000605.html
   My bibliography  Save this article

Machine Learning Classification Model Comparison

Author

Listed:
  • Giudici, Paolo
  • Gramegna, Alex
  • Raffinetti, Emanuela

Abstract

Machine learning models are boosting Artificial Intelligence applications in many domains, such as automotive, finance and health care. This is mainly due to their advantage, in terms of predictive accuracy, with respect to classic statistical models. However, machine learning models are much less explainable: less transparent, less interpretable. This paper proposes to improve machine learning models, by proposing a model selection methodology, based on Lorenz Zonoids, which allows to compare them in terms of predictive accuracy significant gains, leading to a selected model which maintains accuracy while improving explainability. We illustrate our proposal by means of simulated datasets and of a real credit scoring problem. The analysis of the former shows that the proposal improves alternative methods, based on the AUROC. The analysis of the latter shows that the proposal leads to models made up of two/three relevant variables that measure the profitability and the financial leverage of the companies asking for credit.

Suggested Citation

  • Giudici, Paolo & Gramegna, Alex & Raffinetti, Emanuela, 2023. "Machine Learning Classification Model Comparison," Socio-Economic Planning Sciences, Elsevier, vol. 87(PB).
  • Handle: RePEc:eee:soceps:v:87:y:2023:i:pb:s0038012123000605
    DOI: 10.1016/j.seps.2023.101560
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012123000605
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.seps.2023.101560?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Giudici & Emanuela Raffinetti, 2020. "Lorenz Model Selection," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 754-768, October.
    2. Bracke, Philippe & Datta, Anupam & Jung, Carsten & Sen, Shayak, 2019. "Machine learning explainability in finance: an application to default risk analysis," Bank of England working papers 816, Bank of England.
    3. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    4. Ravi Kumar, P. & Ravi, V., 2007. "Bankruptcy prediction in banks and firms via statistical and intelligent techniques - A review," European Journal of Operational Research, Elsevier, vol. 180(1), pages 1-28, July.
    5. Angelini, Eliana & di Tollo, Giacomo & Roli, Andrea, 2008. "A neural network approach for credit risk evaluation," The Quarterly Review of Economics and Finance, Elsevier, vol. 48(4), pages 733-755, November.
    6. Lerman, Robert I. & Yitzhaki, Shlomo, 1984. "A note on the calculation and interpretation of the Gini index," Economics Letters, Elsevier, vol. 15(3-4), pages 363-368.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giudici, Paolo & Raffinetti, Emanuela, 2023. "SAFE Artificial Intelligence in finance," Finance Research Letters, Elsevier, vol. 56(C).
    2. Giacomo di Tollo & Joseph Andria & Gianni Filograsso, 2023. "The Predictive Power of Social Media Sentiment: Evidence from Cryptocurrencies and Stock Markets Using NLP and Stochastic ANNs," Mathematics, MDPI, vol. 11(16), pages 1-18, August.
    3. Peter Martey Addo & Dominique Guegan & Bertrand Hassani, 2018. "Credit Risk Analysis Using Machine and Deep Learning Models," Risks, MDPI, vol. 6(2), pages 1-20, April.
    4. Dumitrescu, Elena & Hué, Sullivan & Hurlin, Christophe & Tokpavi, Sessi, 2022. "Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1178-1192.
    5. Piasecki Krzysztof & Wójcicka-Wójtowicz Aleksandra, 2017. "Capacity of Neural Networks and Discriminant Analysis in Classifying Potential Debtors," Folia Oeconomica Stetinensia, Sciendo, vol. 17(2), pages 129-143, December.
    6. Tyler Pike & Horacio Sapriza & Tom Zimmermann, 2019. "Bottom-up Leading Macroeconomic Indicators: An Application to Non-Financial Corporate Defaults using Machine Learning," Finance and Economics Discussion Series 2019-070, Board of Governors of the Federal Reserve System (U.S.).
    7. Babaei, Golnoosh & Giudici, Paolo & Raffinetti, Emanuela, 2023. "Explainable FinTech lending," Journal of Economics and Business, Elsevier, vol. 125.
    8. Marianna Lyra, 2010. "Heuristic Strategies in Finance – An Overview," Working Papers 045, COMISEF.
    9. Paolo Giudici & Emanuela Raffinetti, 2020. "Lorenz Model Selection," Journal of Classification, Springer;The Classification Society, vol. 37(3), pages 754-768, October.
    10. Dominique Guegan & Peter Martey Addo & Bertrand Hassani, 2018. "Credit Risk Analysis Using Machine and Deep Learning Models," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01835164, HAL.
    11. Dominique Guegan & Peter Martey Addo & Bertrand Hassani, 2018. "Credit Risk Analysis Using Machine and Deep Learning Models," Post-Print halshs-01835164, HAL.
    12. Tiago E. Pratas & Filipe R. Ramos & Lihki Rubio, 2023. "Forecasting bitcoin volatility: exploring the potential of deep learning," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 13(2), pages 285-305, June.
    13. Anatoly A. Peresetsky & Ruslan I. Yakubov, 2017. "Autocorrelation in an unobservable global trend: does it help to forecast market returns?," International Journal of Computational Economics and Econometrics, Inderscience Enterprises Ltd, vol. 7(1/2), pages 152-169.
    14. Kelly Burns & Imad Moosa, 2017. "Demystifying the Meese–Rogoff puzzle: structural breaks or measures of forecasting accuracy?," Applied Economics, Taylor & Francis Journals, vol. 49(48), pages 4897-4910, October.
    15. João C. Claudio & Katja Heinisch & Oliver Holtemöller, 2020. "Nowcasting East German GDP growth: a MIDAS approach," Empirical Economics, Springer, vol. 58(1), pages 29-54, January.
    16. Antonio Rubia & Trino-Manuel Ñíguez, 2006. "Forecasting the conditional covariance matrix of a portfolio under long-run temporal dependence," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(6), pages 439-458.
    17. Athanasopoulos, George & de Carvalho Guillén, Osmani Teixeira & Issler, João Victor & Vahid, Farshid, 2011. "Model selection, estimation and forecasting in VAR models with short-run and long-run restrictions," Journal of Econometrics, Elsevier, vol. 164(1), pages 116-129, September.
    18. Hao Chen & Qiulan Wan & Yurong Wang, 2014. "Refined Diebold-Mariano Test Methods for the Evaluation of Wind Power Forecasting Models," Energies, MDPI, vol. 7(7), pages 1-14, July.
    19. Antonello D’Agostino & Kieran Mcquinn & Karl Whelan, 2012. "Are Some Forecasters Really Better Than Others?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(4), pages 715-732, June.
    20. Quentin Wodon, 2000. "Microdeterminants of consumption, poverty, growth, and inequality in Bangladesh," Applied Economics, Taylor & Francis Journals, vol. 32(10), pages 1337-1352.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:87:y:2023:i:pb:s0038012123000605. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.