IDEAS home Printed from https://ideas.repec.org/a/wly/jjmath/v2025y2025i1n3801827.html

Modified Ridge Regression With Cook’s Distance for Semiparametric Regression Models

Author

Listed:
  • Najeeb Mahmood Khan
  • Muhammad Aman Ullah
  • Javaria Ahmad Khan
  • Salman Raza

Abstract

Multicollinearity and influential cases in semiparametric regression models lead to biased and unreliable estimates distorting leverage and residual patterns. To address these challenges, we propose modified penalized least squares estimators (MPLSEs). We use Cook’s distance and a case deletion approach to evaluate their performance. The effectiveness of MPLSEs is demonstrated through the Longley dataset, where Cook’s distance is applied to the estimated coefficients, fitted values, residuals, and leverages, using a modified ridge parameter. In addition, a Monte Carlo simulation examines the influence of Cook’s distance across varying levels of multicollinearity, influential observations, and sample sizes. We compare MPLSEs with penalized least squares estimators (PLSEs) to assess their relative performance. The results show that MPLSEs outperform existing methods, effectively managing multicollinearity even with influential points. Our study aims to propose and validate a robust approach for addressing the challenges of multicollinearity and influential observations in semiparametric regression models.

Suggested Citation

  • Najeeb Mahmood Khan & Muhammad Aman Ullah & Javaria Ahmad Khan & Salman Raza, 2025. "Modified Ridge Regression With Cook’s Distance for Semiparametric Regression Models," Journal of Mathematics, John Wiley & Sons, vol. 2025(1).
    • Handle: RePEc:wly:jjmath:v:2025:y:2025:i:1:n:3801827
    DOI: 10.1155/jom/3801827
    as

    Download full text from publisher

    File URL: https://doi.org/10.1155/jom/3801827
    Download Restriction: no
    File URL: https://libkey.io/10.1155/jom/3801827?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gülin Tabakan & Fikri Akdeniz, 2010. "Difference-based ridge estimator of parameters in partial linear model," Statistical Papers, Springer, vol. 51(2), pages 357-368, June.
    2. M. Arashi & T. Valizadeh, 2015. "Performance of Kibria’s methods in partial linear ridge regression model," Statistical Papers, Springer, vol. 56(1), pages 231-246, February.
    3. Jahufer, Aboobacker & Jianbao, Chen, 2009. "Assessing global influential observations in modified ridge regression," Statistics & Probability Letters, Elsevier, vol. 79(4), pages 513-518, February.
    4. Tsai, Chih-Ling & Wu, Xizhi, 1992. "Assessing local influence in linear regression models with first-order autoregressive or heteroscedastic error structure," Statistics & Probability Letters, Elsevier, vol. 14(3), pages 247-252, June.
    5. Hadi Emami, 2018. "Local influence for Liu estimators in semiparametric linear models," Statistical Papers, Springer, vol. 59(2), pages 529-544, June.
    6. Kim, Choongrak & Park, Byeong U. & Kim, Woochul, 2002. "Influence diagnostics in semiparametric regression models," Statistics & Probability Letters, Elsevier, vol. 60(1), pages 49-58, November.
    7. Shizuhiko Nishisato, 2002. "Measurement and Multivariate Analysis," Springer Books, in: Shizuhiko Nishisato & Yasumasa Baba & Hamparsum Bozdogan & Koji Kanefuji (ed.), Measurement and Multivariate Analysis, pages 25-36, Springer.
    8. Wing‐Kam Fung & Zhong‐Yi Zhu & Bo‐Cheng Wei & Xuming He, 2002. "Influence diagnostics and outlier tests for semiparametric mixed models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 565-579, August.
    9. Amini, Morteza & Roozbeh, Mahdi, 2015. "Optimal partial ridge estimation in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 26-40.
    10. Emami, Hadi, 2015. "Influence diagnostic in ridge semiparametric models," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 106-113.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hadi Emami, 2018. "Local influence for Liu estimators in semiparametric linear models," Statistical Papers, Springer, vol. 59(2), pages 529-544, June.
    2. Germán Ibacache-Pulgar & Cristian Villegas & Javier Linkolk López-Gonzales & Magaly Moraga, 2023. "Influence measures in nonparametric regression model with symmetric random errors," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(1), pages 1-25, March.
    3. Roozbeh, Mahdi, 2018. "Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 45-61.
    4. Emami, Hadi, 2015. "Influence diagnostic in ridge semiparametric models," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 106-113.
    5. M. Arashi & Mahdi Roozbeh, 2019. "Some improved estimation strategies in high-dimensional semiparametric regression models with application to riboflavin production data," Statistical Papers, Springer, vol. 60(3), pages 667-686, June.
    6. Roozbeh, Mahdi, 2016. "Robust ridge estimator in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 127-144.
    7. Hongchang Hu & Yu Zhang & Xiong Pan, 2016. "Asymptotic normality of DHD estimators in a partially linear model," Statistical Papers, Springer, vol. 57(3), pages 567-587, September.
    8. Li, Zaixing & Xu, Wangli & Zhu, Lixing, 2009. "Influence diagnostics and outlier tests for varying coefficient mixed models," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2002-2017, October.
    9. Ibacache-Pulgar, Germán & Paula, Gilberto A., 2011. "Local influence for Student-t partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 55(3), pages 1462-1478, March.
    10. Bahadır Yüzbaşı & S. Ejaz Ahmed & Dursun Aydın, 2020. "Ridge-type pretest and shrinkage estimations in partially linear models," Statistical Papers, Springer, vol. 61(2), pages 869-898, April.
    11. Clécio S. Ferreira & Gilberto A. Paula, 2017. "Estimation and diagnostic for skew-normal partially linear models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(16), pages 3033-3053, December.
    12. Xueying Zheng & Wing Fung & Zhongyi Zhu, 2013. "Robust estimation in joint mean–covariance regression model for longitudinal data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(4), pages 617-638, August.
    13. Mohammad Arashi & Mina Norouzirad & Mahdi Roozbeh & Naushad Mamode Khan, 2021. "A High-Dimensional Counterpart for the Ridge Estimator in Multicollinear Situations," Mathematics, MDPI, vol. 9(23), pages 1-11, November.
    14. M. Revan Özkale & Stanley Lemeshow & Rodney Sturdivant, 2018. "Logistic regression diagnostics in ridge regression," Computational Statistics, Springer, vol. 33(2), pages 563-593, June.
    15. Víctor Lachos & Filidor Vilca & Manuel Galea, 2007. "Influence diagnostics for the Grubbs's model," Statistical Papers, Springer, vol. 48(3), pages 419-436, September.
    16. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    17. Guoping Zeng & Sha Tao, 2023. "A Generalized Linear Transformation and Its Effects on Logistic Regression," Mathematics, MDPI, vol. 11(2), pages 1-19, January.
    18. Whasoo Bae & Soonyoung Hwang & Choongrak Kim, 2008. "Influence diagnostics in the varying coefficient model with longitudinal data," Computational Statistics, Springer, vol. 23(2), pages 185-196, April.
    19. M Arashi & M Roozbeh & N A Hamzah & M Gasparini, 2021. "Ridge regression and its applications in genetic studies," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-17, April.
    20. Nusrat Shaheen & Ismail Shah & Amani Almohaimeed & Sajid Ali & Hana N. Alqifari, 2023. "Some Modified Ridge Estimators for Handling the Multicollinearity Problem," Mathematics, MDPI, vol. 11(11), pages 1-19, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jjmath:v:2025:y:2025:i:1:n:3801827. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://onlinelibrary.wiley.com/journal/1469 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.