IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v148y2016icp34-48.html
   My bibliography  Save this article

Weighted composite quantile regression for single-index models

Author

Listed:
  • Jiang, Rong
  • Qian, Wei-Min
  • Zhou, Zhan-Gong

Abstract

In this paper we propose a weighted composite quantile regression (WCQR) estimation for single-index models. For parametric part, the WCQR is augmented using a data-driven weighting scheme. With the error distribution unspecified, the proposed estimators share robustness from quantile regression and achieve nearly the same efficiency as the semiparametric maximum likelihood estimator for a variety of error distributions including the Normal, Student’s t, Cauchy distributions, etc. Furthermore, based on the proposed WCQR, we use the adaptive-LASSO to study variable selection for parametric part in the single-index models. For nonparametric part, the WCQR is augmented combining the equal weighted estimators with possibly different weights. Because of the use of weights, the estimation bias is eliminated asymptotically. By comparing asymptotic relative efficiency theoretically and numerically, WCQR estimation all outperforms the CQR estimation and some other estimate methods. Under regularity conditions, the asymptotic properties of the proposed estimations are established. The simulation studies and two real data applications are conducted to illustrate the finite sample performance of the proposed methods.

Suggested Citation

  • Jiang, Rong & Qian, Wei-Min & Zhou, Zhan-Gong, 2016. "Weighted composite quantile regression for single-index models," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 34-48.
    • Handle: RePEc:eee:jmvana:v:148:y:2016:i:c:p:34-48
    DOI: 10.1016/j.jmva.2016.02.015
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X16000592
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2016.02.015?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Yu Y. & Ruppert D., 2002. "Penalized Spline Estimation for Partially Linear Single-Index Models," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1042-1054, December.
    3. Rong Jiang & Wei-Min Qian & Zhan-Gong Zhou, 2016. "Single-index composite quantile regression with heteroscedasticity and general error distributions," Statistical Papers, Springer, vol. 57(1), pages 185-203, March.
    4. Ruppert, D. & Wand, M.P. & Holst, U. & Hossjer, O., "undated". "Local Polynomial Variance Function Estimation," Statistics Working Paper _007, Australian Graduate School of Management.
    5. Jiang, Rong & Qian, Weimin & Zhou, Zhangong, 2012. "Variable selection and coefficient estimation via composite quantile regression with randomly censored data," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 308-317.
    6. Yingcun Xia & Howell Tong & W. K. Li & Li‐Xing Zhu, 2002. "An adaptive estimation of dimension reduction space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 363-410, August.
    7. Bo Kai & Runze Li & Hui Zou, 2010. "Local composite quantile regression smoothing: an efficient and safe alternative to local polynomial regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 49-69, January.
    8. Feng, Long & Zou, Changliang & Wang, Zhaojun, 2012. "Rank-based inference for the single-index model," Statistics & Probability Letters, Elsevier, vol. 82(3), pages 535-541.
    9. Tang, Linjun & Zhou, Zhangong & Wu, Changchun, 2012. "Weighted composite quantile estimation and variable selection method for censored regression model," Statistics & Probability Letters, Elsevier, vol. 82(3), pages 653-663.
    10. Jiang, Rong & Zhou, Zhan-Gong & Qian, Wei-Min & Chen, Yong, 2013. "Two step composite quantile regression for single-index models," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 180-191.
    11. Wu, Tracy Z. & Yu, Keming & Yu, Yan, 2010. "Single-index quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 101(7), pages 1607-1621, August.
    12. Rong Jiang & Wei-Min Qian & Jing-Ru Li, 2014. "Testing in linear composite quantile regression models," Computational Statistics, Springer, vol. 29(5), pages 1381-1402, October.
    13. Wang, Hansheng & Li, Guodong & Jiang, Guohua, 2007. "Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 347-355, July.
    14. Xia, Yingcun & Härdle, Wolfgang, 2006. "Semi-parametric estimation of partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 97(5), pages 1162-1184, May.
    15. Ning, Zijun & Tang, Linjun, 2014. "Estimation and test procedures for composite quantile regression with covariates missing at random," Statistics & Probability Letters, Elsevier, vol. 95(C), pages 15-25.
    16. Liu, Jicai & Zhang, Riquan & Zhao, Weihua & Lv, Yazhao, 2013. "A robust and efficient estimation method for single index models," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 226-238.
    17. Zhu, Li-Ping & Zhu, Li-Xing, 2009. "Nonconcave penalized inverse regression in single-index models with high dimensional predictors," Journal of Multivariate Analysis, Elsevier, vol. 100(5), pages 862-875, May.
    18. Wei Lin & K. B. Kulasekera, 2007. "Identifiability of single-index models and additive-index models," Biometrika, Biometrika Trust, vol. 94(2), pages 496-501.
    19. Hansheng Wang & Runze Li & Chih-Ling Tsai, 2007. "Tuning parameter selectors for the smoothly clipped absolute deviation method," Biometrika, Biometrika Trust, vol. 94(3), pages 553-568.
    20. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(2), pages 186-199, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yujing Shao & Lei Wang, 2022. "Optimal subsampling for composite quantile regression model in massive data," Statistical Papers, Springer, vol. 63(4), pages 1139-1161, August.
    2. Peixin Zhao & Xiaoshuang Zhou, 2018. "Robust empirical likelihood for partially linear models via weighted composite quantile regression," Computational Statistics, Springer, vol. 33(2), pages 659-674, June.
    3. Hong-Xia Xu & Guo-Liang Fan & Zhen-Long Chen & Jiang-Feng Wang, 2018. "Weighted quantile regression and testing for varying-coefficient models with randomly truncated data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(4), pages 565-588, October.
    4. Fengrui Di & Lei Wang, 2022. "Multi-round smoothed composite quantile regression for distributed data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(5), pages 869-893, October.
    5. Zhen Yu & Keming Yu & Wolfgang K. Härdle & Xueliang Zhang & Kai Wang & Maozai Tian, 2022. "Bayesian spatio‐temporal modeling for the inpatient hospital costs of alcohol‐related disorders," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 644-667, December.
    6. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    7. Jiang, Rong & Yu, Keming, 2020. "Single-index composite quantile regression for massive data," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    8. Rong Jiang & Mengxian Sun, 2022. "Single-index composite quantile regression for ultra-high-dimensional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(2), pages 443-460, June.
    9. Sottile, Gianluca & Frumento, Paolo, 2022. "Robust estimation and regression with parametric quantile functions," Computational Statistics & Data Analysis, Elsevier, vol. 171(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rong Jiang & Wei-Min Qian & Zhan-Gong Zhou, 2016. "Single-index composite quantile regression with heteroscedasticity and general error distributions," Statistical Papers, Springer, vol. 57(1), pages 185-203, March.
    2. Jiang, Rong & Zhou, Zhan-Gong & Qian, Wei-Min & Chen, Yong, 2013. "Two step composite quantile regression for single-index models," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 180-191.
    3. Jiang, Rong & Qian, Wei-Min, 2016. "Quantile regression for single-index-coefficient regression models," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 305-317.
    4. Jing Sun, 2016. "Composite quantile regression for single-index models with asymmetric errors," Computational Statistics, Springer, vol. 31(1), pages 329-351, March.
    5. Jiang, Rong & Yu, Keming, 2020. "Single-index composite quantile regression for massive data," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    6. Yang, Hu & Yang, Jing, 2014. "A robust and efficient estimation and variable selection method for partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 227-242.
    7. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    8. Feng, Sanying & Xue, Liugen, 2015. "Model detection and estimation for single-index varying coefficient model," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 227-244.
    9. Xiaohui Yuan & Yong Li & Xiaogang Dong & Tianqing Liu, 2022. "Optimal subsampling for composite quantile regression in big data," Statistical Papers, Springer, vol. 63(5), pages 1649-1676, October.
    10. Lian, Heng & Liang, Hua, 2016. "Separation of linear and index covariates in partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 56-70.
    11. Lai, Peng & Wang, Qihua & Zhou, Xiao-Hua, 2014. "Variable selection and semiparametric efficient estimation for the heteroscedastic partially linear single-index model," Computational Statistics & Data Analysis, Elsevier, vol. 70(C), pages 241-256.
    12. Huybrechts F. Bindele & Ash Abebe & Karlene N. Meyer, 2018. "General rank-based estimation for regression single index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(5), pages 1115-1146, October.
    13. Ash Abebe & Huybrechts F. Bindele & Masego Otlaadisa & Boikanyo Makubate, 2021. "Robust estimation of single index models with responses missing at random," Statistical Papers, Springer, vol. 62(5), pages 2195-2225, October.
    14. Bang, Sungwan & Jhun, Myoungshic, 2012. "Simultaneous estimation and factor selection in quantile regression via adaptive sup-norm regularization," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 813-826.
    15. Qingming Zou & Zhongyi Zhu, 2014. "M-estimators for single-index model using B-spline," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(2), pages 225-246, February.
    16. Yazhao Lv & Riquan Zhang & Weihua Zhao & Jicai Liu, 2015. "Quantile regression and variable selection of partial linear single-index model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(2), pages 375-409, April.
    17. Yazhao Lv & Riquan Zhang & Weihua Zhao & Jicai Liu, 2014. "Quantile regression and variable selection for the single-index model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(7), pages 1565-1577, July.
    18. Wang, Jiang-Feng & Ma, Wei-Min & Zhang, Hui-Zeng & Wen, Li-Min, 2013. "Asymptotic normality for a local composite quantile regression estimator of regression function with truncated data," Statistics & Probability Letters, Elsevier, vol. 83(6), pages 1571-1579.
    19. Claudio Agostinelli & Ana M. Bianco & Graciela Boente, 2020. "Robust estimation in single-index models when the errors have a unimodal density with unknown nuisance parameter," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 855-893, June.
    20. Huilan Liu & Hu Yang & Changgen Peng, 2019. "Weighted composite quantile regression for single index model with missing covariates at random," Computational Statistics, Springer, vol. 34(4), pages 1711-1740, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:148:y:2016:i:c:p:34-48. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.