IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i2p467-d1036804.html
   My bibliography  Save this article

A Generalized Linear Transformation and Its Effects on Logistic Regression

Author

Listed:
  • Guoping Zeng

    (Independent Researcher, Plano, TX 75024, USA)

  • Sha Tao

    (School of Mathematical Sciences, University of Nottingham, Nottingham NG7 2RD, UK)

Abstract

Linear transformations such as min–max normalization and z-score standardization are commonly used in logistic regression for the purpose of scaling. However, the work in the literature on linear transformations in logistic regression has two major limitations. First, most work focuses on improving the fit of the regression model. Second, the effects of transformations are rarely discussed. In this paper, we first generalized a linear transformation for a single variable to multiple variables by matrix multiplication. We then studied various effects of a generalized linear transformation in logistic regression. We showed that an invertible generalized linear transformation has no effects on predictions, multicollinearity, pseudo-complete separation and complete separation. We also showed that multiple linear transformations do not have effects on the variance inflation factor (VIF). Numeric examples with a real data were presented to validate our results. Our results of no effects justify the rationality of linear transformations in logistic regression.

Suggested Citation

  • Guoping Zeng & Sha Tao, 2023. "A Generalized Linear Transformation and Its Effects on Logistic Regression," Mathematics, MDPI, vol. 11(2), pages 1-19, January.
    • Handle: RePEc:gam:jmathe:v:11:y:2023:i:2:p:467-:d:1036804
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/2/467/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/11/2/467/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Roozbeh, Mahdi, 2018. "Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 45-61.
    2. Amini, Morteza & Roozbeh, Mahdi, 2015. "Optimal partial ridge estimation in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 26-40.
    3. Guoping Zeng, 2017. "Invariant properties of logistic regression model in credit scoring under monotonic transformations," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 46(17), pages 8791-8807, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M Arashi & M Roozbeh & N A Hamzah & M Gasparini, 2021. "Ridge regression and its applications in genetic studies," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-17, April.
    2. M. Nooi Asl & H. Bevrani & R. Arabi Belaghi & K. Mansson, 2021. "Ridge-type shrinkage estimators in generalized linear models with an application to prostate cancer data," Statistical Papers, Springer, vol. 62(2), pages 1043-1085, April.
    3. Mohammad Arashi & Mina Norouzirad & Mahdi Roozbeh & Naushad Mamode Khan, 2021. "A High-Dimensional Counterpart for the Ridge Estimator in Multicollinear Situations," Mathematics, MDPI, vol. 9(23), pages 1-11, November.
    4. Hadi Emami, 2018. "Local influence for Liu estimators in semiparametric linear models," Statistical Papers, Springer, vol. 59(2), pages 529-544, June.
    5. Roozbeh, Mahdi, 2018. "Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 45-61.
    6. M. Arashi & Mahdi Roozbeh, 2019. "Some improved estimation strategies in high-dimensional semiparametric regression models with application to riboflavin production data," Statistical Papers, Springer, vol. 60(3), pages 667-686, June.
    7. Roozbeh, Mahdi, 2016. "Robust ridge estimator in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 127-144.
    8. Issam Dawoud & B. M. Golam Kibria, 2020. "A New Biased Estimator to Combat the Multicollinearity of the Gaussian Linear Regression Model," Stats, MDPI, vol. 3(4), pages 1-16, November.
    9. Morteza Amini & Mahdi Roozbeh, 2019. "Improving the prediction performance of the LASSO by subtracting the additive structural noises," Computational Statistics, Springer, vol. 34(1), pages 415-432, March.
    10. Bahadır Yüzbaşı & S. Ejaz Ahmed & Dursun Aydın, 2020. "Ridge-type pretest and shrinkage estimations in partially linear models," Statistical Papers, Springer, vol. 61(2), pages 869-898, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:2:p:467-:d:1036804. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.