IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v61y2020i5d10.1007_s00362-018-1013-1.html
   My bibliography  Save this article

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Author

Listed:
  • Hu Yang

    (Chongqing University)

  • Ning Li

    (Chongqing University)

  • Jing Yang

    (Hunan Normal University)

Abstract

In this paper, a new robust and efficient estimation approach based on local modal regression is proposed for partially linear models with large-dimensional covariates. We show that the resulting estimators for both parametric and nonparametric components are more efficient in the presence of outliers or heavy-tail error distribution, and as asymptotically efficient as the corresponding least squares estimators when there are no outliers and the error distribution is normal. We also establish the asymptotic properties of proposed estimators when the covariate dimension diverges at the rate of $$o\left( {\sqrt{n} } \right) \mathrm{{ }}$$ o n . To achieve sparsity and enhance interpretability, we develop a variable selection procedure based on SCAD penalty to select significant parametric covariates and show that the method enjoys the oracle property under mild regularity conditions. Moreover, we propose a practical modified MEM algorithm for the proposed procedures. Some Monte Carlo simulations and a real data are conducted to illustrate the finite sample performance of the proposed estimators. Finally, based on the idea of sure independence screening procedure proposed by Fan and Lv (J R Stat Soc 70:849–911, 2008), a robust two-step approach is introduced to deal with ultra-high dimensional data.

Suggested Citation

  • Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
  • Handle: RePEc:spr:stpapr:v:61:y:2020:i:5:d:10.1007_s00362-018-1013-1
    DOI: 10.1007/s00362-018-1013-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-018-1013-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00362-018-1013-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    3. Weixin Yao & Bruce Lindsay & Runze Li, 2012. "Local modal regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(3), pages 647-663.
    4. Weihua Zhao & Riquan Zhang & Jicai Liu & Yazhao Lv, 2014. "Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 165-191, February.
    5. Li, Qi, 2000. "Efficient Estimation of Additive Partially Linear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 1073-1092, November.
    6. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    7. Weixin Yao & Longhai Li, 2014. "A New Regression Model: Modal Linear Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(3), pages 656-671, September.
    8. Yang, Hu & Yang, Jing, 2014. "A robust and efficient estimation and variable selection method for partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 227-242.
    9. Jia Chen & Jiti Gao & Degui Li, 2013. "Estimation in Partially Linear Single-Index Panel Data Models With Fixed Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 315-330, July.
    10. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    11. Weihua Zhao & Riquan Zhang & Yukun Liu & Jicai Liu, 2015. "Empirical likelihood based modal regression," Statistical Papers, Springer, vol. 56(2), pages 411-430, May.
    12. Wang, Hansheng & Li, Guodong & Jiang, Guohua, 2007. "Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 347-355, July.
    13. Ni, Xiao & Zhang, Hao Helen & Zhang, Daowen, 2009. "Automatic model selection for partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2100-2111, October.
    14. Jianqing Fan & Jinchi Lv, 2008. "Sure independence screening for ultrahigh dimensional feature space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(5), pages 849-911, November.
    15. Haibo Zhou & Jinhong You & Bin Zhou, 2010. "Statistical inference for fixed-effects partially linear regression models with errors in variables," Statistical Papers, Springer, vol. 51(3), pages 629-650, September.
    16. Golubev, Georgi & Härdle, Wolfgang, 2000. "On adaptive estimation in partial linear models," SFB 373 Discussion Papers 2000,21, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    17. Riquan Zhang & Weihua Zhao & Jicai Liu, 2013. "Robust estimation and variable selection for semiparametric partially linear varying coefficient model based on modal regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 25(2), pages 523-544, June.
    18. Yang, Hu & Guo, Chaohui & Lv, Jing, 2014. "A robust and efficient estimation method for single-index varying-coefficient models," Statistics & Probability Letters, Elsevier, vol. 94(C), pages 119-127.
    19. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(2), pages 186-199, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xuejun Ma & Yue Du & Jingli Wang, 2022. "Model detection and variable selection for mode varying coefficient model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 321-341, June.
    2. Germán Aneiros & Philippe Vieu, 2015. "Partial linear modelling with multi-functional covariates," Computational Statistics, Springer, vol. 30(3), pages 647-671, September.
    3. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    4. Wang, Kangning & Li, Shaomin, 2021. "Robust distributed modal regression for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    5. Ullah, Aman & Wang, Tao & Yao, Weixin, 2023. "Semiparametric partially linear varying coefficient modal regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 1001-1026.
    6. Wang, Kangning & Li, Shaomin & Sun, Xiaofei & Lin, Lu, 2019. "Modal regression statistical inference for longitudinal data semivarying coefficient models: Generalized estimating equations, empirical likelihood and variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 257-276.
    7. Lv, Zhike & Zhu, Huiming & Yu, Keming, 2014. "Robust variable selection for nonlinear models with diverging number of parameters," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 90-97.
    8. Lin, Lu & Zhu, Lixing & Gai, Yujie, 2016. "Inference for biased models: A quasi-instrumental variable approach," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 22-36.
    9. Guang Cheng & Hao Zhang & Zuofeng Shang, 2015. "Sparse and efficient estimation for partial spline models with increasing dimension," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(1), pages 93-127, February.
    10. Lian, Heng & Liang, Hua, 2016. "Separation of linear and index covariates in partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 56-70.
    11. Yang, Jing & Yang, Hu, 2016. "A robust penalized estimation for identification in semiparametric additive models," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 268-277.
    12. Cai, Xizhen & Zhu, Yeying & Huang, Yuan & Ghosh, Debashis, 2022. "High-dimensional causal mediation analysis based on partial linear structural equation models," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    13. Xue-Jun Ma & Jing-Xiao Zhang, 2016. "A new variable selection approach for varying coefficient models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 79(1), pages 59-72, January.
    14. Muhammad Amin & Lixin Song & Milton Abdul Thorlie & Xiaoguang Wang, 2015. "SCAD-penalized quantile regression for high-dimensional data analysis and variable selection," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 69(3), pages 212-235, August.
    15. Du, Pang & Cheng, Guang & Liang, Hua, 2012. "Semiparametric regression models with additive nonparametric components and high dimensional parametric components," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 2006-2017.
    16. Loann David Denis Desboulets, 2018. "A Review on Variable Selection in Regression Analysis," Econometrics, MDPI, vol. 6(4), pages 1-27, November.
    17. Lee, Ji Hyung & Shi, Zhentao & Gao, Zhan, 2022. "On LASSO for predictive regression," Journal of Econometrics, Elsevier, vol. 229(2), pages 322-349.
    18. Cui, Wenquan & Cheng, Haoyang & Sun, Jiajing, 2018. "An RKHS-based approach to double-penalized regression in high-dimensional partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 168(C), pages 201-210.
    19. Marcelo M. Taddeo & Pedro A. Morettin, 2023. "Bayesian P-Splines Applied to Semiparametric Models with Errors Following a Scale Mixture of Normals," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 85(2), pages 1331-1355, August.
    20. Xin Geng & Carlos Martins-Filho & Feng Yao, 2015. "Estimation of a Partially Linear Regression in Triangular Systems," Working Papers 15-46, Department of Economics, West Virginia University.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:61:y:2020:i:5:d:10.1007_s00362-018-1013-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.