IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v8y2025i4p84-d1756880.html
   My bibliography  Save this article

A Simulation-Based Comparative Analysis of Two-Parameter Robust Ridge M-Estimators for Linear Regression Models

Author

Listed:
  • Bushra Haider

    (Department of Statistics, University of Peshawar, Peshawar 25000, Pakistan)

  • Syed Muhammad Asim

    (Department of Statistics, University of Peshawar, Peshawar 25000, Pakistan)

  • Danish Wasim

    (Department of Statistics, Government Superior Science College Peshawar, Peshawar 25000, Pakistan)

  • B. M. Golam Kibria

    (Department of Mathematics and Statistics, Florida International University, Miami, FL 33199, USA)

Abstract

Traditional regression estimators like Ordinary Least Squares (OLS) and classical ridge regression often fail under multicollinearity and outlier contamination respectively. Although recently developed two-parameter ridge regression (TPRR) estimators improve efficiency by introducing dual shrinkage parameters, they remain sensitive to extreme observations. This study develops a new class of Two-Parameter Robust Ridge M-Estimators (TPRRM) that integrate dual shrinkage with robust M-estimation to simultaneously address multicollinearity and outliers. A Monte Carlo simulation study, conducted under varying sample sizes, predictor dimensions, correlation levels, and contamination structures, compares the proposed estimators with OLS, ridge, and the most recent TPRR estimators. The results demonstrate that TPRRM consistently achieves the lowest Mean Squared Error (MSE), particularly in heavy-tailed and outlier-prone scenarios. Application to the Tobacco and Gasoline Consumption datasets further validates the superiority of the proposed methods in real-world conditions. The findings confirm that the proposed TPRRM fills a critical methodological gap by offering estimators that are not only efficient under multicollinearity, but also robust against departures from normality.

Suggested Citation

  • Bushra Haider & Syed Muhammad Asim & Danish Wasim & B. M. Golam Kibria, 2025. "A Simulation-Based Comparative Analysis of Two-Parameter Robust Ridge M-Estimators for Linear Regression Models," Stats, MDPI, vol. 8(4), pages 1-19, September.
  • Handle: RePEc:gam:jstats:v:8:y:2025:i:4:p:84-:d:1756880
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/8/4/84/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2571-905X/8/4/84/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stan Lipovetsky & W. Michael Conklin, 2005. "Ridge regression in two‐parameter solution," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 21(6), pages 525-540, November.
    2. Seyab Yasin & Sultan Salem & Hamdi Ayed & Shahid Kamal & Muhammad Suhail & Yousaf Ali Khan, 2021. "Modified Robust Ridge M-Estimators in Two-Parameter Ridge Regression Model," Mathematical Problems in Engineering, Hindawi, vol. 2021, pages 1-24, September.
    3. Hasan Ertas & Selma Toker & Selahattin Ka�ıranlar, 2015. "Robust two parameter ridge M-estimator for linear regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 42(7), pages 1490-1502, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Suellen Teixeira Zavadzki de Pauli & Mariana Kleina & Wagner Hugo Bonat, 2020. "Comparing Artificial Neural Network Architectures for Brazilian Stock Market Prediction," Annals of Data Science, Springer, vol. 7(4), pages 613-628, December.
    2. Khalid Ul Islam Rather & Eda Gizem Koçyiğit & Ronald Onyango & Cem Kadilar, 2022. "Improved regression in ratio type estimators based on robust M-estimation," PLOS ONE, Public Library of Science, vol. 17(12), pages 1-16, December.
    3. Muhammad Shakir Khan & Amirah Saeed Alharthi, 2025. "Adaptive Penalized Regression for High-Efficiency Estimation in Correlated Predictor Settings: A Data-Driven Shrinkage Approach," Mathematics, MDPI, vol. 13(17), pages 1-16, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:8:y:2025:i:4:p:84-:d:1756880. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.