IDEAS home Printed from https://ideas.repec.org/p/zbw/sfb649/sfb649dp2016-052.html
   My bibliography  Save this paper

Beta-boosted ensemble for big credit scoring data

Author

Listed:
  • Zieba, Maciej
  • Härdle, Wolfgang Karl

Abstract

In this work we present a novel ensemble model for a credit scoring problem. The main idea of the approach is to incorporate separate beta binomial distributions for each of the classes to generate balanced datasets that are further used to construct base learners that constitute the final ensemble model. The sampling procedure is performed on two separate ranking lists, each for one class, where the ranking is based on prepotency of observing positive class. Two strategies are considered: one assumes mining easy examples and the second one forces good classification of hard cases. The proposed solutions are tested on two big datasets on credit scoring.

Suggested Citation

  • Zieba, Maciej & Härdle, Wolfgang Karl, 2016. "Beta-boosted ensemble for big credit scoring data," SFB 649 Discussion Papers 2016-052, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    • Handle: RePEc:zbw:sfb649:sfb649dp2016-052
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/148888/1/875029655.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Härdle, Wolfgang Karl & Prastyo, Dedy Dwi & Hafner, Christian, 2012. "Support vector machines with evolutionary feature selection for default prediction," SFB 649 Discussion Papers 2012-030, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    2. Martens, David & Baesens, Bart & Van Gestel, Tony & Vanthienen, Jan, 2007. "Comprehensible credit scoring models using rule extraction from support vector machines," European Journal of Operational Research, Elsevier, vol. 183(3), pages 1466-1476, December.
    3. Ligang Zhou & Kin Keung Lai & Jerome Yen, 2009. "Credit Scoring Models With Auc Maximization Based On Weighted Svm," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 8(04), pages 677-696.
    4. Shiyi Chen & W. K. Hardle & R. A. Moro, 2011. "Modeling default risk with support vector machines," Quantitative Finance, Taylor & Francis Journals, vol. 11(1), pages 135-154.
    5. Wolfgang Härdle & Yuh-Jye Lee & Dorothea Schäfer & Yi-Ren Yeh, 2009. "Variable selection and oversampling in the use of smooth support vector machines for predicting the default risk of companies," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(6), pages 512-534.
    6. Shiyi Chen & Wolfgang K. Härdle & Kiho Jeong, 2010. "Forecasting volatility with support vector machine-based GARCH model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(4), pages 406-433.
    7. Koutanaei, Fatemeh Nemati & Sajedi, Hedieh & Khanbabaei, Mohammad, 2015. "A hybrid data mining model of feature selection algorithms and ensemble learning classifiers for credit scoring," Journal of Retailing and Consumer Services, Elsevier, vol. 27(C), pages 11-23.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:hum:wpaper:sfb649dp2016-052 is not listed on IDEAS
    2. repec:hum:wpaper:sfb649dp2013-037 is not listed on IDEAS
    3. Härdle, Wolfgang Karl & Prastyo, Dedy Dwi, 2013. "Default risk calculation based on predictor selection for the Southeast Asian industry," SFB 649 Discussion Papers 2013-037, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    4. Dedy Dwi Prastyo & Härdle, Wolfgang Karl, 2014. "Localising forward intensities for multiperiod corporate default," SFB 649 Discussion Papers 2014-040, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    5. repec:hum:wpaper:sfb649dp2014-040 is not listed on IDEAS
    6. Hyeongjun Kim & Hoon Cho & Doojin Ryu, 2022. "Corporate Bankruptcy Prediction Using Machine Learning Methodologies with a Focus on Sequential Data," Computational Economics, Springer;Society for Computational Economics, vol. 59(3), pages 1231-1249, March.
    7. Li, Hui & Hong, Lu-Yao & He, Jia-Xun & Xu, Xuan-Guo & Sun, Jie, 2013. "Small sample-oriented case-based kernel predictive modeling and its economic forecasting applications under n-splits-k-times hold-out assessment," Economic Modelling, Elsevier, vol. 33(C), pages 747-761.
    8. Li, Chunyu & Lou, Chenxin & Luo, Dan & Xing, Kai, 2021. "Chinese corporate distress prediction using LASSO: The role of earnings management," International Review of Financial Analysis, Elsevier, vol. 76(C).
    9. Davidescu Adriana AnaMaria & Agafiței Marina-Diana & Strat Vasile Alecsandru & Dima Alina Mihaela, 2024. "Mapping the Landscape: A Bibliometric Analysis of Rating Agencies in the Era of Artificial Intelligence and Machine Learning," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 18(1), pages 67-85.
    10. Jun Lu & Shao Yi, 2022. "Reducing Overestimating and Underestimating Volatility via the Augmented Blending-ARCH Model," Applied Economics and Finance, Redfame publishing, vol. 9(2), pages 48-59, May.
    11. Derhami, Shahab & Smith, Alice E., 2017. "An integer programming approach for fuzzy rule-based classification systems," European Journal of Operational Research, Elsevier, vol. 256(3), pages 924-934.
    12. Li, Yibei & Wang, Ximei & Djehiche, Boualem & Hu, Xiaoming, 2020. "Credit scoring by incorporating dynamic networked information," European Journal of Operational Research, Elsevier, vol. 286(3), pages 1103-1112.
    13. Loterman, Gert & Brown, Iain & Martens, David & Mues, Christophe & Baesens, Bart, 2012. "Benchmarking regression algorithms for loss given default modeling," International Journal of Forecasting, Elsevier, vol. 28(1), pages 161-170.
    14. repec:hum:wpaper:sfb649dp2013-028 is not listed on IDEAS
    15. He Jiang, 2022. "A novel robust structural quadratic forecasting model and applications," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1156-1180, September.
    16. Barboza, Flavio & Altman, Edward, 2024. "Predicting financial distress in Latin American companies: A comparative analysis of logistic regression and random forest models," The North American Journal of Economics and Finance, Elsevier, vol. 72(C).
    17. Plakandaras, Vasilios & Papadimitriou, Theophilos & Gogas, Periklis, 2019. "Forecasting transportation demand for the U.S. market," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 195-214.
    18. Zhang, Zhiwang & Gao, Guangxia & Shi, Yong, 2014. "Credit risk evaluation using multi-criteria optimization classifier with kernel, fuzzification and penalty factors," European Journal of Operational Research, Elsevier, vol. 237(1), pages 335-348.
    19. Marcin Fałdziński & Piotr Fiszeder & Witold Orzeszko, 2020. "Forecasting Volatility of Energy Commodities: Comparison of GARCH Models with Support Vector Regression," Energies, MDPI, vol. 14(1), pages 1-18, December.
    20. Raffaele Manini & Oriol Amat, 2018. "Credit scoring for the supermarket and retailing industry: analysis and application proposal," Economics Working Papers 1614, Department of Economics and Business, Universitat Pompeu Fabra.
    21. Härdle, Wolfgang Karl & Huang, Li-shan, 2013. "Analysis of deviance in generalized partial linear models," SFB 649 Discussion Papers 2013-028, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    22. Yu, Lean & Wang, Shouyang & Lai, Kin Keung, 2009. "An intelligent-agent-based fuzzy group decision making model for financial multicriteria decision support: The case of credit scoring," European Journal of Operational Research, Elsevier, vol. 195(3), pages 942-959, June.
    23. Vasilios Plakandaras & Elie Bouri & Rangan Gupta, 2019. "Forecasting Bitcoin Returns: Is there a Role for the U.S. – China Trade War?," Working Papers 201980, University of Pretoria, Department of Economics.
    24. De Caigny, Arno & Coussement, Kristof & De Bock, Koen W., 2018. "A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees," European Journal of Operational Research, Elsevier, vol. 269(2), pages 760-772.

    More about this item

    Keywords

    credit scoring; ensemble model; beta distribution; Beta boost; big data;
    All these keywords.

    JEL classification:

    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:sfb649:sfb649dp2016-052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/sohubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.