IDEAS home Printed from https://ideas.repec.org/a/vrs/stintr/v18y2017i3p443-458n6.html
   My bibliography  Save this article

Stacked Regression With a Generalization of the Moore-Penrose Pseudoinverse

Author

Listed:
  • Górecki Tomasz

    (Faculty of Mathematics and Computer Science, Adam Mickiewicz University, Umultowska 87, 61-614 Poznan, Poland .)

  • Łuczak Maciej

    (Faculty of Civil Engineering, Environmental and Geodetic Sciences, Koszalin University of Technology, Sniadeckich 2, 75-453 Koszalin, Poland .)

Abstract

In practice, it often happens that there are a number of classification methods. We are not able to clearly determine which method is optimal. We propose a combined method that allows us to consolidate information from multiple sources in a better classifier. Stacked regression (SR) is a method for forming linear combinations of different classifiers to give improved classification accuracy. The Moore-Penrose (MP) pseudoinverse is a general way to find the solution to a system of linear equations.

Suggested Citation

  • Górecki Tomasz & Łuczak Maciej, 2017. "Stacked Regression With a Generalization of the Moore-Penrose Pseudoinverse," Statistics in Transition New Series, Polish Statistical Association, vol. 18(3), pages 443-458, September.
  • Handle: RePEc:vrs:stintr:v:18:y:2017:i:3:p:443-458:n:6
    DOI: 10.21307/stattrans-2016-080
    as

    Download full text from publisher

    File URL: https://doi.org/10.21307/stattrans-2016-080
    Download Restriction: no

    File URL: https://libkey.io/10.21307/stattrans-2016-080?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael Doumpos & Constantin Zopounidis, 2007. "Model combination for credit risk assessment: A stacked generalization approach," Annals of Operations Research, Springer, vol. 151(1), pages 289-306, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alina Mihaela Dima & Simona Vasilache, 2016. "Credit Risk modeling for Companies Default Prediction using Neural Networks," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(3), pages 127-143, September.
    2. Hugh Chen & Scott M. Lundberg & Su-In Lee, 2022. "Explaining a series of models by propagating Shapley values," Nature Communications, Nature, vol. 13(1), pages 1-15, December.
    3. Cao Son Tran & Dan Nicolau & Richi Nayak & Peter Verhoeven, 2021. "Modeling Credit Risk: A Category Theory Perspective," JRFM, MDPI, vol. 14(7), pages 1-21, July.
    4. Francisco Salas-Molina & Juan A. Rodriguez-Aguilar & Pablo Díaz-García, 2018. "Selecting cash management models from a multiobjective perspective," Annals of Operations Research, Springer, vol. 261(1), pages 275-288, February.
    5. Ilyes Abid & Farid Mkaouar & Olfa Kaabia, 2018. "Dynamic analysis of the forecasting bankruptcy under presence of unobserved heterogeneity," Annals of Operations Research, Springer, vol. 262(2), pages 241-256, March.
    6. Jones, Stewart & Johnstone, David & Wilson, Roy, 2015. "An empirical evaluation of the performance of binary classifiers in the prediction of credit ratings changes," Journal of Banking & Finance, Elsevier, vol. 56(C), pages 72-85.
    7. Ioannidis, Christos & Pasiouras, Fotios & Zopounidis, Constantin, 2010. "Assessing bank soundness with classification techniques," Omega, Elsevier, vol. 38(5), pages 345-357, October.
    8. Yi Liao & Yuxuan Peng & Songlin Shi & Victor Shi & Xiaohong Yu, 2022. "Early box office prediction in China’s film market based on a stacking fusion model," Annals of Operations Research, Springer, vol. 308(1), pages 321-338, January.
    9. Emilios Galariotis & Christophe Germain & Constantin Zopounidis, 2018. "A combined methodology for the concurrent evaluation of the business, financial and sports performance of football clubs: the case of France," Annals of Operations Research, Springer, vol. 266(1), pages 589-612, July.
    10. Jamal Al Qundus & Kosai Dabbour & Shivam Gupta & Régis Meissonier & Adrian Paschke, 2022. "Wireless sensor network for AI-based flood disaster detection," Annals of Operations Research, Springer, vol. 319(1), pages 697-719, December.
    11. Ilyes Abid & Rim Ayadi & Khaled Guesmi & Farid Mkaouar, 2022. "A new approach to deal with variable selection in neural networks: an application to bankruptcy prediction," Annals of Operations Research, Springer, vol. 313(2), pages 605-623, June.
    12. Philippe Jardin, 2023. "Designing topological data to forecast bankruptcy using convolutional neural networks," Annals of Operations Research, Springer, vol. 325(2), pages 1291-1332, June.
    13. Philippe Jardin, 2021. "Forecasting bankruptcy using biclustering and neural network-based ensembles," Annals of Operations Research, Springer, vol. 299(1), pages 531-566, April.
    14. De Bock, Koen W. & Coussement, Kristof & Lessmann, Stefan, 2020. "Cost-sensitive business failure prediction when misclassification costs are uncertain: A heterogeneous ensemble selection approach," European Journal of Operational Research, Elsevier, vol. 285(2), pages 612-630.
    15. Koen W. de Bock & Kristof Coussement & Stefan Lessmann, 2020. "Cost-sensitive business failure prediction when misclassification costs are uncertain: A heterogeneous ensemble selection approach," Post-Print hal-02863245, HAL.
    16. Tomasz Górecki & Maciej Łuczak, 2017. "Stacked Regression With A Generalization Of The Moore-Penrose Pseudoinverse," Statistics in Transition New Series, Polish Statistical Association, vol. 18(3), pages 443-458, September.
    17. Fu-Ling Cai & Xiuwu Liao & Kan-Liang Wang, 2012. "An interactive sorting approach based on the assignment examples of multiple decision makers with different priorities," Annals of Operations Research, Springer, vol. 197(1), pages 87-108, August.
    18. Ioannis Tsolas, 2015. "Firm credit risk evaluation: a series two-stage DEA modeling framework," Annals of Operations Research, Springer, vol. 233(1), pages 483-500, October.
    19. Ioannis Asimakopoulos & Dionysis Lalountas & Costas Siriopoulos, 2008. "The determinants for the survival of firms in the Athens Exchange," Economic Bulletin, Bank of Greece, issue 31, pages 07-30, November.
    20. Ioannis E. Tsolas, 2021. "Firm Credit Scoring: A Series Two-Stage DEA Bootstrapped Approach," JRFM, MDPI, vol. 14(5), pages 1-12, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:stintr:v:18:y:2017:i:3:p:443-458:n:6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.sciendo.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.