IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v147y2016icp127-144.html
   My bibliography  Save this article

Robust ridge estimator in restricted semiparametric regression models

Author

Listed:
  • Roozbeh, Mahdi

Abstract

In this paper, ridge and non-ridge type estimators and their robust forms are defined in the semiparametric regression model when the errors are dependent and some non-stochastic linear restrictions are imposed under a multicollinearity setting. In the context of ridge regression, the estimation of shrinkage parameter plays an important role in analyzing data. Another common problem in applied statistics is the presence of outliers in the data besides multicollinearity. In this respect, we propose some robust estimators for shrinkage parameter based on least trimmed squares (LTS) method. Given a set of n observations and the integer trimming parameter h≤n, the LTS estimator involves computing the hyperplane that minimizes the sum of the smallest h squared residuals. The LTS estimator is closely related to the well-known least median squares (LMS) estimator in which the objective is to minimize the median squared residual. Although LTS estimator has the advantage of being statistically more efficient than LMS estimator, the computational complexity of LTS is less understood than LMS. Here, we extract the robust estimators for linear and nonlinear parts of the model based on robust shrinkage estimators. It is shown that these estimators perform better than ordinary ridge estimator. For our proposal, via a Monté-Carlo simulation and a real data example, performance of the ridge type of robust estimators are compared with the classical ones in restricted semiparametric regression models.

Suggested Citation

  • Roozbeh, Mahdi, 2016. "Robust ridge estimator in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 127-144.
  • Handle: RePEc:eee:jmvana:v:147:y:2016:i:c:p:127-144
    DOI: 10.1016/j.jmva.2016.01.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X16000087
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jmva.2016.01.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Roozbeh, Mahdi, 2015. "Shrinkage ridge estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 56-74.
    2. M. Arashi & M. Janfada & M. Norouzirad, 2015. "Singular Ridge Regression With Stochastic Constraints," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 44(6), pages 1281-1292, March.
    3. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    4. M. Arashi & T. Valizadeh, 2015. "Performance of Kibria’s methods in partial linear ridge regression model," Statistical Papers, Springer, vol. 56(1), pages 231-246, February.
    5. Mount, David M. & Netanyahu, Nathan S. & Romanik, Kathleen & Silverman, Ruth & Wu, Angela Y., 2007. "A practical approximation algorithm for the LMS line estimator," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2461-2486, February.
    6. Li, Qi, 2000. "Efficient Estimation of Additive Partially Linear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 1073-1092, November.
    7. You, Jinhong & Chen, Gemai & Zhou, Yong, 2007. "Statistical inference of partially linear regression models with heteroscedastic errors," Journal of Multivariate Analysis, Elsevier, vol. 98(8), pages 1539-1557, September.
    8. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    9. Jialiang Li & Wenyang Zhang & Zhengxiao Wu, 2011. "Optimal zone for bandwidth selection in semiparametric models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(3), pages 701-717.
    10. Jung, Kang-Mo, 2005. "Multivariate least-trimmed squares regression estimator," Computational Statistics & Data Analysis, Elsevier, vol. 48(2), pages 307-316, February.
    11. Wenyu Sun & Ya-Xiang Yuan, 2006. "Optimization Theory and Methods," Springer Optimization and Its Applications, Springer, number 978-0-387-24976-6, September.
    12. Amini, Morteza & Roozbeh, Mahdi, 2015. "Optimal partial ridge estimation in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 26-40.
    13. Nguyen, T.D. & Welsch, R., 2010. "Outlier detection and least trimmed squares approximation using semi-definite programming," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3212-3226, December.
    14. Golubev, Georgi & Härdle, Wolfgang, 2000. "On adaptive estimation in partial linear models," SFB 373 Discussion Papers 2000,21, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    15. Roozbeh, M. & Arashi, M., 2013. "Feasible ridge estimator in partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 35-44.
    16. repec:hum:journl:v:105:y:2012:i:1:p:164-175 is not listed on IDEAS
    17. Arashi, M. & Kibria, B.M. Golam & Norouzirad, M. & Nadarajah, S., 2014. "Improved preliminary test and Stein-rule Liu estimators for the ill-conditioned elliptical linear regression model," Journal of Multivariate Analysis, Elsevier, vol. 126(C), pages 53-74.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Roozbeh, Mahdi, 2018. "Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 45-61.
    2. M. Taavoni & M. Arashi, 2021. "Kernel estimation in semiparametric mixed effect longitudinal modeling," Statistical Papers, Springer, vol. 62(3), pages 1095-1116, June.
    3. M Arashi & M Roozbeh & N A Hamzah & M Gasparini, 2021. "Ridge regression and its applications in genetic studies," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-17, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roozbeh, Mahdi, 2018. "Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 45-61.
    2. M. Arashi & Mahdi Roozbeh, 2019. "Some improved estimation strategies in high-dimensional semiparametric regression models with application to riboflavin production data," Statistical Papers, Springer, vol. 60(3), pages 667-686, June.
    3. Roozbeh, Mahdi, 2015. "Shrinkage ridge estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 56-74.
    4. Amini, Morteza & Roozbeh, Mahdi, 2015. "Optimal partial ridge estimation in restricted semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 136(C), pages 26-40.
    5. Bahadır Yüzbaşı & S. Ejaz Ahmed & Dursun Aydın, 2020. "Ridge-type pretest and shrinkage estimations in partially linear models," Statistical Papers, Springer, vol. 61(2), pages 869-898, April.
    6. Hadi Emami, 2018. "Local influence for Liu estimators in semiparametric linear models," Statistical Papers, Springer, vol. 59(2), pages 529-544, June.
    7. Yuejin Zhou & Yebin Cheng & Wenlin Dai & Tiejun Tong, 2018. "Optimal difference-based estimation for partially linear models," Computational Statistics, Springer, vol. 33(2), pages 863-885, June.
    8. Lian, Heng & Liang, Hua, 2016. "Separation of linear and index covariates in partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 56-70.
    9. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
    10. Zhang, Yuanqing & Sun, Yanqing, 2015. "Estimation of partially specified dynamic spatial panel data models with fixed-effects," Regional Science and Urban Economics, Elsevier, vol. 51(C), pages 37-46.
    11. Marcelo M. Taddeo & Pedro A. Morettin, 2023. "Bayesian P-Splines Applied to Semiparametric Models with Errors Following a Scale Mixture of Normals," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 85(2), pages 1331-1355, August.
    12. Xin Geng & Carlos Martins-Filho & Feng Yao, 2015. "Estimation of a Partially Linear Regression in Triangular Systems," Working Papers 15-46, Department of Economics, West Virginia University.
    13. Han Shang, 2014. "Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density," Computational Statistics, Springer, vol. 29(3), pages 829-848, June.
    14. Haotian Chen & Xibin Zhang, 2014. "Bayesian Estimation for Partially Linear Models with an Application to Household Gasoline Consumption," Monash Econometrics and Business Statistics Working Papers 28/14, Monash University, Department of Econometrics and Business Statistics.
    15. Jianhong Shi & Fanrong Zhao, 2018. "Statistical inference for heteroscedastic semi-varying coefficient EV models under restricted condition," Statistical Papers, Springer, vol. 59(2), pages 487-511, June.
    16. Wang, Xiaoguang & Shi, Xinyong, 2014. "Robust estimation for survival partially linear single-index models," Computational Statistics & Data Analysis, Elsevier, vol. 80(C), pages 140-152.
    17. Liu, Jialuo & Chu, Tingjin & Zhu, Jun & Wang, Haonan, 2021. "Semiparametric method and theory for continuously indexed spatio-temporal processes," Journal of Multivariate Analysis, Elsevier, vol. 183(C).
    18. Lin, Lu & Zhu, Lixing & Gai, Yujie, 2016. "Inference for biased models: A quasi-instrumental variable approach," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 22-36.
    19. Feng Yao & Junsen Zhang, 2015. "Efficient kernel-based semiparametric IV estimation with an application to resolving a puzzle on the estimates of the return to schooling," Empirical Economics, Springer, vol. 48(1), pages 253-281, February.
    20. Lan, Wei & Ding, Yue & Fang, Zheng & Fang, Kuangnan, 2016. "Testing covariates in high dimension linear regression with latent factors," Journal of Multivariate Analysis, Elsevier, vol. 144(C), pages 25-37.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:147:y:2016:i:c:p:127-144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.