IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v74y2022i5d10.1007_s10463-021-00816-0.html
   My bibliography  Save this article

Multi-round smoothed composite quantile regression for distributed data

Author

Listed:
  • Fengrui Di

    (Nankai University)

  • Lei Wang

    (Nankai University)

Abstract

Statistical analysis of large-scale dataset is challenging due to the limited memory constraint and computation source and calls for the efficient distributed methods. In this paper, we mainly study the distributed estimation and inference for composite quantile regression (CQR). For computational and statistical efficiency, we propose to apply a smoothing idea to the CQR loss function for the distributed data and then successively refine the estimator via multiple rounds of aggregations. Based on the Bahadur representation, we derive the asymptotic normality of the proposed multi-round smoothed CQR estimator and show that it also achieves the same efficiency of the ideal CQR estimator by analyzing the entire dataset simultaneously. Moreover, to improve the efficiency of the CQR, we propose a multi-round smoothed weighted CQR estimator. Extensive numerical experiments on both simulated and real data validate the superior performance of the proposed estimators.

Suggested Citation

  • Fengrui Di & Lei Wang, 2022. "Multi-round smoothed composite quantile regression for distributed data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(5), pages 869-893, October.
    • Handle: RePEc:spr:aistmt:v:74:y:2022:i:5:d:10.1007_s10463-021-00816-0
    DOI: 10.1007/s10463-021-00816-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10463-021-00816-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10463-021-00816-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joel L. Horowitz, 1998. "Bootstrap Methods for Median Regression Models," Econometrica, Econometric Society, vol. 66(6), pages 1327-1352, November.
    2. Runze Li & Dennis K.J. Lin & Bing Li, 2013. "Statistical inference in massive data sets," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 29(5), pages 399-409, September.
    3. Bo Kai & Runze Li & Hui Zou, 2010. "Local composite quantile regression smoothing: an efficient and safe alternative to local polynomial regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 49-69, January.
    4. Jiang, Xuejun & Li, Jingzhi & Xia, Tian & Yan, Wanfeng, 2016. "Robust and efficient estimation with weighted composite quantile regression," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 457(C), pages 413-423.
    5. Kaplan, David M. & Sun, Yixiao, 2017. "Smoothed Estimating Equations For Instrumental Variables Quantile Regression," Econometric Theory, Cambridge University Press, vol. 33(1), pages 105-157, February.
    6. Whang, Yoon-Jae, 2006. "Smoothed Empirical Likelihood Methods For Quantile Regression Models," Econometric Theory, Cambridge University Press, vol. 22(2), pages 173-205, April.
    7. Jiang, Rong & Qian, Wei-Min & Zhou, Zhan-Gong, 2016. "Weighted composite quantile regression for single-index models," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 34-48.
    8. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    9. Shi, Chengchun & Lu, Wenbin & Song, Rui, 2018. "A massive data framework for M-estimators with cubic-rate," LSE Research Online Documents on Economics 102111, London School of Economics and Political Science, LSE Library.
    10. Chengchun Shi & Wenbin Lu & Rui Song, 2018. "A Massive Data Framework for M-Estimators with Cubic-Rate," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1698-1709, October.
    11. Heller, Glenn, 2007. "Smoothed Rank Regression With Censored Data," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 552-559, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    2. Rong Jiang & Wei-wei Chen & Xin Liu, 2021. "Adaptive quantile regressions for massive datasets," Statistical Papers, Springer, vol. 62(4), pages 1981-1995, August.
    3. He, Xuming & Pan, Xiaoou & Tan, Kean Ming & Zhou, Wen-Xin, 2023. "Smoothed quantile regression with large-scale inference," Journal of Econometrics, Elsevier, vol. 232(2), pages 367-388.
    4. Zhen Yu & Keming Yu & Wolfgang K. Härdle & Xueliang Zhang & Kai Wang & Maozai Tian, 2022. "Bayesian spatio‐temporal modeling for the inpatient hospital costs of alcohol‐related disorders," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(S2), pages 644-667, December.
    5. Marcelo Fernandes & Emmanuel Guerre & Eduardo Horta, 2021. "Smoothing Quantile Regressions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 338-357, January.
    6. Tae-Hwy Lee & Aman Ullah & He Wang, 2023. "The Second-order Bias and Mean Squared Error of Quantile Regression Estimators," Working Papers 202313, University of California at Riverside, Department of Economics.
    7. de Castro, Luciano & Galvao, Antonio F. & Kaplan, David M. & Liu, Xin, 2019. "Smoothed GMM for quantile models," Journal of Econometrics, Elsevier, vol. 213(1), pages 121-144.
    8. Fan, Yanqin & Liu, Ruixuan, 2016. "A direct approach to inference in nonparametric and semiparametric quantile models," Journal of Econometrics, Elsevier, vol. 191(1), pages 196-216.
    9. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    10. Kaplan, David M. & Sun, Yixiao, 2017. "Smoothed Estimating Equations For Instrumental Variables Quantile Regression," Econometric Theory, Cambridge University Press, vol. 33(1), pages 105-157, February.
    11. Hong-Xia Xu & Guo-Liang Fan & Zhen-Long Chen & Jiang-Feng Wang, 2018. "Weighted quantile regression and testing for varying-coefficient models with randomly truncated data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 102(4), pages 565-588, October.
    12. Firpo, Sergio & Galvao, Antonio F. & Pinto, Cristine & Poirier, Alexandre & Sanroman, Graciela, 2022. "GMM quantile regression," Journal of Econometrics, Elsevier, vol. 230(2), pages 432-452.
    13. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    14. Bruins, Marianne & Duffy, James A. & Keane, Michael P. & Smith, Anthony A., 2018. "Generalized indirect inference for discrete choice models," Journal of Econometrics, Elsevier, vol. 205(1), pages 177-203.
    15. Victor Chernozhukov & Christian Hansen & Kaspar Wuthrich, 2020. "Instrumental Variable Quantile Regression," Papers 2009.00436, arXiv.org.
    16. Escanciano, J.C. & Goh, S.C., 2014. "Specification analysis of linear quantile models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 495-507.
    17. Xiaofeng Lv & Rui Li, 2013. "Smoothed empirical likelihood analysis of partially linear quantile regression models with missing response variables," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 97(4), pages 317-347, October.
    18. Sottile, Gianluca & Frumento, Paolo, 2022. "Robust estimation and regression with parametric quantile functions," Computational Statistics & Data Analysis, Elsevier, vol. 171(C).
    19. Escanciano, Juan Carlos & Velasco, Carlos, 2010. "Specification tests of parametric dynamic conditional quantiles," Journal of Econometrics, Elsevier, vol. 159(1), pages 209-221, November.
    20. Xiaofeng Lv & Gupeng Zhang & Xinkuo Xu & Qinghai Li, 2019. "Weighted quantile regression for censored data with application to export duration data," Statistical Papers, Springer, vol. 60(4), pages 1161-1192, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:74:y:2022:i:5:d:10.1007_s10463-021-00816-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.