IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i3p411-d1577621.html
   My bibliography  Save this article

Deterministic and Stochastic Machine Learning Classification Models: A Comparative Study Applied to Companies’ Capital Structures

Author

Listed:
  • Joseph F. Hair

    (Marketing & Quantitative Methods, Mitchell College of Business, University of South Alabama, Mobile, AL 36688, USA)

  • Luiz Paulo Fávero

    (Faculty of Economics, Administration, and Accounting, University of Sao Paulo, Sao Paulo 05508-900, Brazil)

  • Wilson Tarantin Junior

    (Faculty of Economics, Administration, and Accounting, University of Sao Paulo, Sao Paulo 05508-900, Brazil)

  • Alexandre Duarte

    (Polytechnic School, University of Sao Paulo, Sao Paulo 05508-010, Brazil)

Abstract

Corporate financing decisions, particularly the choice between equity and debt, significantly impact a company’s financial health and value. This study predicts binary corporate debt levels (high or low) using supervised machine learning (ML) models and firms’ characteristics as predictive variables. Key features include companies’ size, tangibility, profitability, liquidity, growth opportunities, risk, and industry. Deterministic models, represented by logistic regression and multilevel logistic regression, and stochastic approaches that incorporate a certain degree of randomness or probability, including decision trees, random forests, Gradient Boosting, Support Vector Machines, and Artificial Neural Networks, were evaluated using usual metrics. The results indicate that decision trees, random forest, and XGBoost excelled in the training phase but showed higher overfitting when evaluated in the test sample. Deterministic models, in contrast, were less prone to overfitting. Notably, all models delivered statistically similar results in the test sample, emphasizing the need to balance performance, simplicity, and interpretability. These findings provide actionable insights for managers to benchmark their company’s debt level and improve financing strategies. Furthermore, this study contributes to ML applications in corporate finance by comparing deterministic and stochastic models in predicting capital structure, offering a robust tool to enhance managerial decision-making and optimize financial strategies.

Suggested Citation

  • Joseph F. Hair & Luiz Paulo Fávero & Wilson Tarantin Junior & Alexandre Duarte, 2025. "Deterministic and Stochastic Machine Learning Classification Models: A Comparative Study Applied to Companies’ Capital Structures," Mathematics, MDPI, vol. 13(3), pages 1-24, January.
  • Handle: RePEc:gam:jmathe:v:13:y:2025:i:3:p:411-:d:1577621
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/3/411/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/13/3/411/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stewart C. Myers & Nicholas S. Majluf, 1984. "Corporate Financing and Investment Decisions When Firms Have InformationThat Investors Do Not Have," NBER Working Papers 1396, National Bureau of Economic Research, Inc.
    2. Myers, Stewart C. & Majluf, Nicholas S., 1984. "Corporate financing and investment decisions when firms have information that investors do not have," Journal of Financial Economics, Elsevier, vol. 13(2), pages 187-221, June.
    3. Dominique Guegan & Peter Martey Addo & Bertrand Hassani, 2018. "Credit Risk Analysis Using Machine and Deep Learning Models," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01835164, HAL.
    4. Murray Z. Frank & Vidhan K. Goyal, 2009. "Capital Structure Decisions: Which Factors Are Reliably Important?," Financial Management, Financial Management Association International, vol. 38(1), pages 1-37, March.
    5. Kayo, Eduardo K. & Kimura, Herbert, 2011. "Hierarchical determinants of capital structure," Journal of Banking & Finance, Elsevier, vol. 35(2), pages 358-371, February.
    6. Peter Martey Addo & Dominique Guegan & Bertrand Hassani, 2018. "Credit Risk Analysis using Machine and Deep learning models," Working Papers 2018:08, Department of Economics, University of Venice "Ca' Foscari".
    7. Lkhagvadorj Munkhdalai & Tsendsuren Munkhdalai & Oyun-Erdene Namsrai & Jong Yun Lee & Keun Ho Ryu, 2019. "An Empirical Comparison of Machine-Learning Methods on Bank Client Credit Assessments," Sustainability, MDPI, vol. 11(3), pages 1-23, January.
    8. Heitor Almeida & Murillo Campello, 2007. "Financial Constraints, Asset Tangibility, and Corporate Investment," The Review of Financial Studies, Society for Financial Studies, vol. 20(5), pages 1429-1460, 2007 12.
    9. Peter Martey Addo & Dominique Guegan & Bertrand Hassani, 2018. "Credit Risk Analysis using Machine and Deep Learning models," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01719983, HAL.
    10. repec:bla:jfinan:v:59:y:2004:i:4:p:1777-1804 is not listed on IDEAS
    11. Jensen, Michael C, 1986. "Agency Costs of Free Cash Flow, Corporate Finance, and Takeovers," American Economic Review, American Economic Association, vol. 76(2), pages 323-329, May.
    12. Rajan, Raghuram G & Zingales, Luigi, 1995. "What Do We Know about Capital Structure? Some Evidence from International Data," Journal of Finance, American Finance Association, vol. 50(5), pages 1421-1460, December.
    13. Dominique Guegan & Peter Martey Addo & Bertrand Hassani, 2018. "Credit Risk Analysis Using Machine and Deep Learning Models," Post-Print halshs-01835164, HAL.
    14. Myers, Stewart C., 1977. "Determinants of corporate borrowing," Journal of Financial Economics, Elsevier, vol. 5(2), pages 147-175, November.
    15. Peter Martey Addo & Dominique Guégan & Bertrand Hassani, 2018. "Credit Risk Analysis using Machine and Deep learning models," Documents de travail du Centre d'Economie de la Sorbonne 18003, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    16. Mai, Feng & Tian, Shaonan & Lee, Chihoon & Ma, Ling, 2019. "Deep learning models for bankruptcy prediction using textual disclosures," European Journal of Operational Research, Elsevier, vol. 274(2), pages 743-758.
    17. Graham, John R. & Leary, Mark T. & Roberts, Michael R., 2015. "A century of capital structure: The leveraging of corporate America," Journal of Financial Economics, Elsevier, vol. 118(3), pages 658-683.
    18. Peter Martey Addo & Dominique Guegan & Bertrand Hassani, 2018. "Credit Risk Analysis Using Machine and Deep Learning Models," Risks, MDPI, vol. 6(2), pages 1-20, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dang, Viet Anh & Kim, Minjoo & Shin, Yongcheol, 2014. "Asymmetric adjustment toward optimal capital structure: Evidence from a crisis," International Review of Financial Analysis, Elsevier, vol. 33(C), pages 226-242.
    2. Lee, Chi-Chuan & Lee, Chien-Chiang & Xiao, Shunyi, 2021. "Policy-related risk and corporate financing behavior: Evidence from China’s listed companies," Economic Modelling, Elsevier, vol. 94(C), pages 539-547.
    3. Salima Smiti & Makram Soui, 2020. "Bankruptcy Prediction Using Deep Learning Approach Based on Borderline SMOTE," Information Systems Frontiers, Springer, vol. 22(5), pages 1067-1083, October.
    4. Hong-Yi Chen & Cheng Few Lee & Tzu Tai, 2020. "The Joint Determinants of Capital Structure and Stock Rate of Return: A LISREL Model Approach," World Scientific Book Chapters, in: Cheng Few Lee & John C Lee (ed.), HANDBOOK OF FINANCIAL ECONOMETRICS, MATHEMATICS, STATISTICS, AND MACHINE LEARNING, chapter 35, pages 1345-1397, World Scientific Publishing Co. Pte. Ltd..
    5. Miguel Acedo-Ramírez & Juan Ayala-Calvo & José Rodríguez-Osés, 2013. "Capital structure of small companies in the Spanish footwear sector: relevant factors," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 4(2), pages 155-173, June.
    6. Hossein Hassani & Xu Huang & Emmanuel Silva & Mansi Ghodsi, 2020. "Deep Learning and Implementations in Banking," Annals of Data Science, Springer, vol. 7(3), pages 433-446, September.
    7. Amini, Shahram & Elmore, Ryan & Öztekin, Özde & Strauss, Jack, 2021. "Can machines learn capital structure dynamics?," Journal of Corporate Finance, Elsevier, vol. 70(C).
    8. İbrahim Yarba & Z. Nuray Güner, 2020. "Leverage dynamics: Do financial development and government leverage matter? Evidence from a major developing economy," Empirical Economics, Springer, vol. 59(5), pages 2473-2507, November.
    9. Marco Botta & Luca Vittorio Angelo Colombo, 2022. "Non‐linear capital structure dynamics," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 49(9-10), pages 1897-1928, October.
    10. Hang, Markus & Geyer-Klingeberg, Jerome & Rathgeber, Andreas W. & Stöckl, Stefan, 2018. "Measurement matters—A meta-study of the determinants of corporate capital structure," The Quarterly Review of Economics and Finance, Elsevier, vol. 68(C), pages 211-225.
    11. Faisal Seraj Alnori & Ali Mohsen Shaddady, 2019. "Corporate Debt Choice and Board Size: The Case of Oil Exporting Economy," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 9(5), pages 1-6.
    12. Mohina Saxena & Surajit Bhattacharyya, 2022. "Industry dynamics and capital structure choice: Evidence from Indian manufacturing firms," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 43(3), pages 829-845, April.
    13. Yousef Ibrahim, 2019. "The Determinants of Capital Structure: Evidence from GCC and UK Real Estate Sectors," Real Estate Management and Valuation, Sciendo, vol. 27(2), pages 108-125, June.
    14. Bontempi, Maria Elena & Bottazzi, Laura & Golinelli, Roberto, 2020. "A multilevel index of heterogeneous short-term and long-term debt dynamics," Journal of Corporate Finance, Elsevier, vol. 64(C).
    15. Hanousek, Jan & Shamshur, Anastasiya, 2011. "A stubborn persistence: Is the stability of leverage ratios determined by the stability of the economy?," Journal of Corporate Finance, Elsevier, vol. 17(5), pages 1360-1376.
    16. Yildirim, Ramazan & Masih, Mansur & Bacha, Obiyathulla Ismath, 2018. "Determinants of capital structure: evidence from Shari'ah compliant and non-compliant firms," Pacific-Basin Finance Journal, Elsevier, vol. 51(C), pages 198-219.
    17. Alves, Paulo & Couto, Eduardo Barbosa & Francisco, Paulo Morais, 2015. "Board of directors’ composition and capital structure," Research in International Business and Finance, Elsevier, vol. 35(C), pages 1-32.
    18. Ebrahim, M. Shahid & Girma, Sourafel & Shah, M. Eskandar & Williams, Jonathan, 2014. "Dynamic capital structure and political patronage: The case of Malaysia," International Review of Financial Analysis, Elsevier, vol. 31(C), pages 117-128.
    19. Kaoru HOSONO & Miho TAKIZAWA, 2017. "Intangible Capital and the Choice of External Financing Sources," Discussion papers 17080, Research Institute of Economy, Trade and Industry (RIETI).
    20. Haitham A. Al‐Zoubi & Jennifer A. O'Sullivan & Aktham I. Al‐Maghyereh & Brendan J. Lambe, 2023. "Disentangling Sentiment from Cyclicality in Firm Capital Structure," Abacus, Accounting Foundation, University of Sydney, vol. 59(2), pages 570-605, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:3:p:411-:d:1577621. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.