IDEAS home Printed from https://ideas.repec.org/a/wly/isacfm/v13y2005i3p133-150.html

Modelling small‐business credit scoring by using logistic regression, neural networks and decision trees

Author

Listed:
  • Mirta Bensic
  • Natasa Sarlija
  • Marijana Zekic‐Susac

Abstract

Previous research on credit scoring that used statistical and intelligent methods was mostly focused on commercial and consumer lending. The main purpose of this paper is to extract important features for credit scoring in small‐business lending on a dataset with specific transitional economic conditions using a relatively small dataset. To do this, we compare the accuracy of the best models extracted by different methodologies, such as logistic regression, neural networks (NNs), and CART decision trees. Four different NN algorithms are tested, including backpropagation, radial basis function network, probabilistic and learning vector quantization, by using the forward nonlinear variable selection strategy. Although the test of differences in proportion and McNemar's test do not show a statistically significant difference in the models tested, the probabilistic NN model produces the highest hit rate and the lowest type I error. According to the measures of association, the best NN model also shows the highest degree of association with the data, and it yields the lowest total relative cost of misclassification for all scenarios examined. The best model extracts a set of important features for small‐business credit scoring for the observed sample, emphasizing credit programme characteristics, as well as entrepreneur's personal and business characteristics as the most important ones. Copyright © 2005 John Wiley & Sons, Ltd.

Suggested Citation

  • Mirta Bensic & Natasa Sarlija & Marijana Zekic‐Susac, 2005. "Modelling small‐business credit scoring by using logistic regression, neural networks and decision trees," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 13(3), pages 133-150, July.
    • Handle: RePEc:wly:isacfm:v:13:y:2005:i:3:p:133-150
    DOI: 10.1002/isaf.261
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/isaf.261
    Download Restriction: no
    File URL: https://libkey.io/10.1002/isaf.261?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Desai, Vijay S. & Crook, Jonathan N. & Overstreet, George A., 1996. "A comparison of neural networks and linear scoring models in the credit union environment," European Journal of Operational Research, Elsevier, vol. 95(1), pages 24-37, November.
    2. D. J. Hand & W. E. Henley, 1997. "Statistical Classification Methods in Consumer Credit Scoring: a Review," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 160(3), pages 523-541, September.
    3. Ron J. Feldman, 1997. "Small business loans, small banks and big change in technology called credit scoring," The Region, Federal Reserve Bank of Minneapolis, vol. 11(Sep), pages 19-25.
    4. Philip Swicegood & Jeffrey A. Clark, 2001. "Off‐site monitoring systems for predicting bank underperformance: a comparison of neural networks, discriminant analysis, and professional human judgment," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 10(3), pages 169-186, September.
    5. W. Scott Frame & Michael Padhi & Lynn W. Woosley, 2001. "The effect of credit scoring on small business lending in low- and moderate-income areas," FRB Atlanta Working Paper 2001-6, Federal Reserve Bank of Atlanta.
    6. Altman, Edward I. & Marco, Giancarlo & Varetto, Franco, 1994. "Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience)," Journal of Banking & Finance, Elsevier, vol. 18(3), pages 505-529, May.
    7. Selowsky, Marcelo & Martin, Ricardo, 1997. "Policy Performance and Output Growth in the Transition Economies," American Economic Review, American Economic Association, vol. 87(2), pages 349-353, May.
    8. Frame, W Scott & Srinivasan, Aruna & Woosley, Lynn, 2001. "The Effect of Credit Scoring on Small-Business Lending," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 33(3), pages 813-825, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Perazzini, Selene & Metulini, Rodolfo & Carpita, Maurizio, 2023. "Integration of flows and signals data from mobile phone network for statistical analyses of traffic in a flooding risk area," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    2. Lv, Yufeng & Zuo, Qiankun & Qian, Yiming & Yu, Jiaojiao, 2025. "Heterogeneous Representation Decomposition-Fusion Network with multi-resolution wavelet transform for credit scoring," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 675(C).
    3. Mostafa, Mohamed M. & El-Masry, Ahmed A., 2013. "Citizens as consumers: Profiling e-government services’ users in Egypt via data mining techniques," International Journal of Information Management, Elsevier, vol. 33(4), pages 627-641.
    4. Rahman, Md Jahidur & Zhu, Hongtao, 2024. "Detecting accounting fraud in family firms: Evidence from machine learning approaches," Advances in accounting, Elsevier, vol. 64(C).
    5. Calabrese, G.G. & Falavigna, G. & Ippoliti, R., 2024. "Financial constraints prediction to lead socio-economic development: An application of neural networks to the Italian market," Socio-Economic Planning Sciences, Elsevier, vol. 95(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Berger, Allen N & Frame, W Scott & Miller, Nathan H, 2005. "Credit Scoring and the Availability, Price, and Risk of Small Business Credit," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(2), pages 191-222, April.
    2. Ha-Thu Nguyen, 2015. "How is credit scoring used to predict default in China?," EconomiX Working Papers 2015-1, University of Paris Nanterre, EconomiX.
    3. Degryse, H.A. & Cerqueiro, G.M. & Ongena, S., 2007. "Distance, Bank Organizational Structure and Credit," Other publications TiSEM 34c2f607-3395-4fd9-9c52-4, Tilburg University, School of Economics and Management.
    4. Hussein A. Abdou & John Pointon, 2011. "Credit Scoring, Statistical Techniques And Evaluation Criteria: A Review Of The Literature," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 18(2-3), pages 59-88, April.
    5. Brad S. Trinkle & Amelia A. Baldwin, 2007. "Interpretable credit model development via artificial neural networks," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 15(3‐4), pages 123-147, July.
    6. Thomas, Lyn C., 2000. "A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers," International Journal of Forecasting, Elsevier, vol. 16(2), pages 149-172.
    7. Cerqueiro, Geraldo & Degryse, Hans & Ongena, Steven, 2011. "Rules versus discretion in loan rate setting," Journal of Financial Intermediation, Elsevier, vol. 20(4), pages 503-529, October.
    8. Dawei Cheng & Zhibin Niu & Yi Tu & Liqing Zhang, 2017. "Prediction defaults for networked-guarantee loans," Papers 1702.04642, arXiv.org, revised Jun 2020.
    9. Hong Wang & Qingsong Xu & Lifeng Zhou, 2015. "Large Unbalanced Credit Scoring Using Lasso-Logistic Regression Ensemble," PLOS ONE, Public Library of Science, vol. 10(2), pages 1-20, February.
    10. Francesco Ciampi & Alessandro Giannozzi & Giacomo Marzi & Edward I. Altman, 2021. "Rethinking SME default prediction: a systematic literature review and future perspectives," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2141-2188, March.
    11. Allen N. Berger & Astrid A. Dick & Lawrence G. Goldberg & Lawrence J. White, 2007. "Competition from Large, Multimarket Firms and the Performance of Small, Single‐Market Firms: Evidence from the Banking Industry," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(2‐3), pages 331-368, March.
    12. Sumit Agarwal & Souphala Chomsisengphet & Chunlin Liu & Lawrence Mielnicki, 2005. "Impact of State Exemption Laws on Small Business Bankruptcy Decision," Southern Economic Journal, John Wiley & Sons, vol. 71(3), pages 620-635, January.
    13. George Xianzhi Yuan & Huiqi Wang, 2019. "The general dynamic risk assessment for the enterprise by the hologram approach in financial technology," International Journal of Financial Engineering (IJFE), World Scientific Publishing Co. Pte. Ltd., vol. 6(01), pages 1-48, March.
    14. Stefano Filomeni & Michele Modina & Elena Tabacco, 2023. "Trade credit and firm investments: empirical evidence from Italian cooperative banks," Review of Quantitative Finance and Accounting, Springer, vol. 60(3), pages 1099-1141, April.
    15. Andrey Filchenkov & Natalia Khanzhina & Arina Tsai & Ivan Smetannikov, 2021. "Regularization of Autoencoders for Bank Client Profiling Based on Financial Transactions," Risks, MDPI, vol. 9(3), pages 1-16, March.
    16. Badreddine Benyacoub & Souad ElBernoussi & Abdelhak Zoglat & Mohamed Ouzineb, 2022. "Credit Scoring Model Based on HMM/Baum-Welch Method," Computational Economics, Springer;Society for Computational Economics, vol. 59(3), pages 1135-1154, March.
    17. Allen N. Berger & Adrian M. Cowan & W. Scott Frame, 2009. "The surprising use of credit scoring in small business lending by community banks and the attendant effects on credit availability and risk," FRB Atlanta Working Paper 2009-09, Federal Reserve Bank of Atlanta.
    18. Beck, Thorsten & de Haas, Ralph & Degryse, Hans & Van Horen, Neeltje, 2014. "When Arm’s Length Is Too Far. Relationship Banking over the Business Cycle," CEPR Discussion Papers 10050, C.E.P.R. Discussion Papers.
    19. Li, Bin & Guo, Fei & Xu, Lei & Meng, Siqi, 2024. "Fintech business and corporate social responsibility practices," Emerging Markets Review, Elsevier, vol. 59(C).
    20. repec:dau:papers:123456789/5897 is not listed on IDEAS
    21. Durguner, Sena, 2017. "Do borrower-lender relationships still matter for small business loans?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 50(C), pages 98-118.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:isacfm:v:13:y:2005:i:3:p:133-150. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/1099-1174/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.