IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i5p837-d1603908.html

A Selective Overview of Quantile Regression for Large-Scale Data

Author

Listed:
  • Shanshan Wang

    (School of Economics and Management, Beihang University, Beijing 100191, China
    MOE Key Laboratory of Complex System Analysis and Management Decision, Beihang University, Beijing 100191, China)

  • Wei Cao

    (School of Economics and Management, Beihang University, Beijing 100191, China)

  • Xiaoxue Hu

    (School of Economics and Management, Beihang University, Beijing 100191, China)

  • Hanyu Zhong

    (School of Economics and Management, Beihang University, Beijing 100191, China)

  • Weixi Sun

    (School of Economics and Management, Beihang University, Beijing 100191, China
    Sino-French Engineering School, Beihang University, Beijing 100191, China)

Abstract

Large-scale data, characterized by heterogeneity due to heteroskedastic variance or inhomogeneous covariate effects, arises in diverse fields of scientific research and technological development. Quantile regression (QR) is a valuable tool for detecting heteroskedasticity, and numerous QR statistical methods for large-scale data have been rapidly developed. This paper provides a selective review of recent advances in QR theory, methods, and implementations, particularly in the context of massive and streaming data. We focus on three key strategies for large-scale QR analysis: (1) distributed computing, (2) subsampling methods, and (3) online updating. The main contribution of this paper is a comprehensive review of existing work and advancements in these areas, addressing challenges such as managing the non-smooth QR loss function, developing distributed and online updating formulations, and conducting statistical inference. Finally, we highlight several issues that require further study.

Suggested Citation

  • Shanshan Wang & Wei Cao & Xiaoxue Hu & Hanyu Zhong & Weixi Sun, 2025. "A Selective Overview of Quantile Regression for Large-Scale Data," Mathematics, MDPI, vol. 13(5), pages 1-30, March.
    • Handle: RePEc:gam:jmathe:v:13:y:2025:i:5:p:837-:d:1603908
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/5/837/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/13/5/837/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joel L. Horowitz, 1998. "Bootstrap Methods for Median Regression Models," Econometrica, Econometric Society, vol. 66(6), pages 1327-1352, November.
    2. Ye Fan & Nan Lin & Liqun Yu, 2024. "Distributed quantile regression for longitudinal big data," Computational Statistics, Springer, vol. 39(2), pages 751-779, April.
    3. Runze Li & Dennis K.J. Lin & Bing Li, 2013. "Statistical inference in massive data sets," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 29(5), pages 399-409, September.
    4. He, Xuming & Pan, Xiaoou & Tan, Kean Ming & Zhou, Wen-Xin, 2023. "Smoothed quantile regression with large-scale inference," Journal of Econometrics, Elsevier, vol. 232(2), pages 367-388.
    5. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    6. Rong Jiang & Keming Yu, 2024. "Unconditional Quantile Regression for Streaming Datasets," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(4), pages 1143-1154, October.
    7. Jianfeng Wei & Jian Yang & Xuewen Cheng & Jie Ding & Shengquan Li, 2023. "Adaptive Regression Analysis of Heterogeneous Data Streams via Models with Dynamic Effects," Mathematics, MDPI, vol. 11(24), pages 1-18, December.
    8. Qifa Xu & Chao Cai & Cuixia Jiang & Fang Sun & Xue Huang, 2020. "Block average quantile regression for massive dataset," Statistical Papers, Springer, vol. 61(1), pages 141-165, February.
    9. HaiYing Wang & Min Yang & John Stufken, 2019. "Information-Based Optimal Subdata Selection for Big Data Linear Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 393-405, January.
    10. Yu, Keming & Moyeed, Rana A., 2001. "Bayesian quantile regression," Statistics & Probability Letters, Elsevier, vol. 54(4), pages 437-447, October.
    11. Xingcai Zhou & Zhaoyang Jing & Chao Huang, 2024. "Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression," Mathematics, MDPI, vol. 12(5), pages 1-53, February.
    12. Michael I. Jordan & Jason D. Lee & Yun Yang, 2019. "Communication-Efficient Distributed Statistical Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 668-681, April.
    13. Chen, Lanjue & Zhou, Yong, 2020. "Quantile regression in big data: A divide and conquer based strategy," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    14. Baur, Dirk G., 2013. "The structure and degree of dependence: A quantile regression approach," Journal of Banking & Finance, Elsevier, vol. 37(3), pages 786-798.
    15. Haiying Wang & Yanyuan Ma, 2021. "Optimal subsampling for quantile regression in big data," Biometrika, Biometrika Trust, vol. 108(1), pages 99-112.
    16. Xuetong Li & Yuan Gao & Hong Chang & Danyang Huang & Yingying Ma & Rui Pan & Haobo Qi & Feifei Wang & Shuyuan Wu & Ke Xu & Jing Zhou & Xuening Zhu & Yingqiu Zhu & Hansheng Wang, 2024. "A selective review on statistical methods for massive data computation: distributed computing, subsampling, and minibatch techniques," Statistical Theory and Related Fields, Taylor & Francis Journals, vol. 8(3), pages 163-185, July.
    17. HaiYing Wang & Rong Zhu & Ping Ma, 2018. "Optimal Subsampling for Large Sample Logistic Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 829-844, April.
    18. T. J. Cole, 1988. "Fitting Smoothed Centile Curves to Reference Data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 151(3), pages 385-406, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Enyi, Patrick Enyi & Adebawojo, Oladipupo Akindehinde & Ahannaya, Gandolph Chinedu & Alu, Chituru & Eze, Ogbonnaya Nweze, 2026. "Reassessing Risk Integration in Investment Appraisal: A Comparative Evaluation of Traditional and Simplified Analytical Models," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 10(2), pages 7873-7887, February.
    2. Jia-Yuan Liang & Yi-Yang Zhou & Rong Jiang, 2026. "Distributed Composite Quantile Regression for High-Dimensional Data," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 88(1), pages 36-58, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jun Jin & Qinghan Liang, 2026. "Communication-efficient distributed composite quantile regression via convolution smoothing and poisson subsampling," Statistical Papers, Springer, vol. 67(1), pages 1-55, February.
    2. Jia-Yuan Liang & Yi-Yang Zhou & Rong Jiang, 2026. "Distributed Composite Quantile Regression for High-Dimensional Data," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 88(1), pages 36-58, February.
    3. Feifei Wang & Danyang Huang & Tianchen Gao & Shuyuan Wu & Hansheng Wang, 2022. "Sequential one‐step estimator by sub‐sampling for customer churn analysis with massive data sets," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1753-1786, November.
    4. Haixiang Zhang & HaiYing Wang, 2026. "Refitted cross-validation estimation for high-dimensional subsamples from low-dimension full data," Computational Statistics, Springer, vol. 41(2), pages 1-15, February.
    5. Cheng Li & Ruihan Luo & Jian-Feng Yang, 2025. "Optimal distributed Poisson subsampling for modal regression with massive data," Statistical Papers, Springer, vol. 66(5), pages 1-32, August.
    6. Zou, Hang & Jiang, Yunlu, 2026. "Communication-efficient distributed robust variable selection for heterogeneous massive data," Statistics & Probability Letters, Elsevier, vol. 228(C).
    7. Xiaohui Yuan & Shiting Zhou & Yue Wang, 2025. "Optimal subsampling algorithm for composite quantile regression with distributed data," Computational Statistics, Springer, vol. 40(9), pages 4901-4936, December.
    8. Min Ren & Shengli Zhao & Mingqiu Wang & Xinbei Zhu, 2024. "Robust optimal subsampling based on weighted asymmetric least squares," Statistical Papers, Springer, vol. 65(4), pages 2221-2251, June.
    9. Fan, Ye & Lin, Nan, 2025. "Sequential quantile regression for stream data by least squares," Journal of Econometrics, Elsevier, vol. 249(PA).
    10. Yue Chao & Lei Huang & Xuejun Ma & Jiajun Sun, 2024. "Optimal subsampling for modal regression in massive data," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 87(4), pages 379-409, May.
    11. Jun Yu & Jiaqi Liu & HaiYing Wang, 2023. "Information-based optimal subdata selection for non-linear models," Statistical Papers, Springer, vol. 64(4), pages 1069-1093, August.
    12. Wang, Kangning & Li, Shaomin, 2021. "Robust distributed modal regression for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    13. Jun Yu & HaiYing Wang, 2022. "Subdata selection algorithm for linear model discrimination," Statistical Papers, Springer, vol. 63(6), pages 1883-1906, December.
    14. Lu Lin & Feng Li, 2023. "Global debiased DC estimations for biased estimators via pro forma regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 726-758, June.
    15. Tianzhen Wang & Haixiang Zhang, 2022. "Optimal subsampling for multiplicative regression with massive data," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 76(4), pages 418-449, November.
    16. Ziyang Wang & HaiYing Wang & Nalini Ravishanker, 2023. "Subsampling in Longitudinal Models," Methodology and Computing in Applied Probability, Springer, vol. 25(1), pages 1-29, March.
    17. Wang, Kangning & Zhang, Jingyu & Sun, Xiaofei, 2025. "Adaptive distributed smooth composite quantile regression estimation for large-scale data," Computational Statistics & Data Analysis, Elsevier, vol. 204(C).
    18. Deng, Jiayi & Huang, Danyang & Ding, Yi & Zhu, Yingqiu & Jing, Bingyi & Zhang, Bo, 2024. "Subsampling spectral clustering for stochastic block models in large-scale networks," Computational Statistics & Data Analysis, Elsevier, vol. 189(C).
    19. Zhang, Haixiang & Wang, HaiYing, 2021. "Distributed subdata selection for big data via sampling-based approach," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    20. Baolin Chen & Shanshan Song & Yong Zhou, 2024. "Estimation and testing of expectile regression with efficient subsampling for massive data," Statistical Papers, Springer, vol. 65(9), pages 5593-5613, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:5:p:837-:d:1603908. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.