IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v249y2025ipas0304407623000714.html
   My bibliography  Save this article

Feature-splitting algorithms for ultrahigh dimensional quantile regression

Author

Listed:
  • Wen, Jiawei
  • Yang, Songshan
  • Wang, Christina Dan
  • Jiang, Yifan
  • Li, Runze

Abstract

This paper is concerned with computational issues related to penalized quantile regression (PQR) with ultrahigh dimensional predictors. Various algorithms have been developed for PQR, but they become ineffective and/or infeasible in the presence of ultrahigh dimensional predictors due to the storage and scalability limitations. The variable updating schema of the feature-splitting algorithm that directly applies the ordinary alternating direction method of multiplier (ADMM) to ultrahigh dimensional PQR may make the algorithm fail to converge. To tackle this hurdle, we propose an efficient and parallelizable algorithm for ultrahigh dimensional PQR based on the three-block ADMM. The compatibility of the proposed algorithm with parallel computing alleviates the storage and scalability limitations of a single machine in the large-scale data processing. We establish the rate of convergence of the newly proposed algorithm. In addition, Monte Carlo simulations are conducted to compare the finite sample performance of the proposed algorithm with that of other existing algorithms. The numerical comparison implies that the proposed algorithm significantly outperforms the existing ones. We further illustrate the proposed algorithm via an empirical analysis of a real-world data set.

Suggested Citation

  • Wen, Jiawei & Yang, Songshan & Wang, Christina Dan & Jiang, Yifan & Li, Runze, 2025. "Feature-splitting algorithms for ultrahigh dimensional quantile regression," Journal of Econometrics, Elsevier, vol. 249(PA).
    • Handle: RePEc:eee:econom:v:249:y:2025:i:pa:s0304407623000714
    DOI: 10.1016/j.jeconom.2023.01.028
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407623000714
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jeconom.2023.01.028?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Liqun Yu & Nan Lin, 2017. "ADMM for Penalized Quantile Regression in Big Data," International Statistical Review, International Statistical Institute, vol. 85(3), pages 494-518, December.
    2. Deren Han & Defeng Sun & Liwei Zhang, 2018. "Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming," Mathematics of Operations Research, INFORMS, vol. 43(2), pages 622-637, May.
    3. Roger Koenker, 2017. "Quantile Regression: 40 Years On," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 155-176, September.
    4. Kean Ming Tan & Lan Wang & Wen‐Xin Zhou, 2022. "High‐dimensional quantile regression: Convolution smoothing and concave regularization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(1), pages 205-233, February.
    5. Altunbaş, Yener & Thornton, John, 2019. "The impact of financial development on income inequality: A quantile regression approach," Economics Letters, Elsevier, vol. 175(C), pages 51-56.
    6. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    7. Roger Koenker, 2017. "Quantile regression 40 years on," CeMMAP working papers CWP36/17, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    8. D’Haultfœuille, Xavier & Maurel, Arnaud & Zhang, Yichong, 2018. "Extremal quantile regressions for selection models and the black–white wage gap," Journal of Econometrics, Elsevier, vol. 203(1), pages 129-142.
    9. He, Xuming & Pan, Xiaoou & Tan, Kean Ming & Zhou, Wen-Xin, 2023. "Smoothed quantile regression with large-scale inference," Journal of Econometrics, Elsevier, vol. 232(2), pages 367-388.
    10. Giessing, Alexander & He, Xuming, 2019. "On the predictive risk in misspecified quantile regression," Journal of Econometrics, Elsevier, vol. 213(1), pages 235-260.
    11. Roger Koenker & Ivan Mizera, 2014. "Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 674-685, June.
    12. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    13. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    14. Gimenes, Nathalie & Guerre, Emmanuel, 2022. "Quantile regression methods for first-price auctions," Journal of Econometrics, Elsevier, vol. 226(2), pages 224-247.
    15. Gu, Jiaying & Volgushev, Stanislav, 2019. "Panel data quantile regression with grouped fixed effects," Journal of Econometrics, Elsevier, vol. 213(1), pages 68-91.
    16. Eun Ryung Lee & Hohsuk Noh & Byeong U. Park, 2014. "Model Selection via Bayesian Information Criterion for Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 216-229, March.
    17. Firpo, Sergio & Galvao, Antonio F. & Pinto, Cristine & Poirier, Alexandre & Sanroman, Graciela, 2022. "GMM quantile regression," Journal of Econometrics, Elsevier, vol. 230(2), pages 432-452.
    18. Wang, Hansheng, 2009. "Forward Regression for Ultra-High Dimensional Variable Screening," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1512-1524.
    19. Roger Koenker, 2017. "Quantile regression 40 years on," CeMMAP working papers 36/17, Institute for Fiscal Studies.
    20. Lan Wang & Yichao Wu & Runze Li, 2012. "Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 214-222, March.
    21. Narisetty, Naveen & Koenker, Roger, 2022. "Censored quantile regression survival models with a cure proportion," Journal of Econometrics, Elsevier, vol. 226(1), pages 192-203.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Le-Yu & Lee, Sokbae, 2023. "Sparse quantile regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 2195-2217.
    2. Lee, Sokbae & Liao, Yuan & Seo, Myung Hwan & Shin, Youngki, 2025. "Fast inference for quantile regression with tens of millions of observations," Journal of Econometrics, Elsevier, vol. 249(PA).
    3. Chen, Zhao & Cheng, Vivian Xinyi & Liu, Xu, 2024. "Reprint: Hypothesis testing on high dimensional quantile regression," Journal of Econometrics, Elsevier, vol. 239(2).
    4. Honda, Toshio & 本田, 敏雄 & Lin, Chien-Tong, 2022. "Forward variable selection for ultra-high dimensional quantile regression models," Discussion Papers 2021-02, Graduate School of Economics, Hitotsubashi University.
    5. Shu, Lei & Hao, Yifan & Chen, Yu & Yang, Qing, 2025. "SFQRA: Scaled factor-augmented quantile regression with aggregation in conditional mean forecasting," Journal of Multivariate Analysis, Elsevier, vol. 207(C).
    6. Chen, Zhao & Cheng, Vivian Xinyi & Liu, Xu, 2024. "Hypothesis testing on high dimensional quantile regression," Journal of Econometrics, Elsevier, vol. 238(1).
    7. Toshio Honda & Chien-Tong Lin, 2023. "Forward variable selection for ultra-high dimensional quantile regression models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(3), pages 393-424, June.
    8. Haoze Hou & Wei Huang & Zheng Zhang, 2025. "Non-parametric Quantile Regression and Uniform Inference with Unknown Error Distribution," Papers 2504.01761, arXiv.org.
    9. Fan, Ye & Lin, Nan, 2025. "Sequential quantile regression for stream data by least squares," Journal of Econometrics, Elsevier, vol. 249(PA).
    10. Chong-Chuo Chang & Oshamah Lin Lin & Oshamah Yu-Cheng Chang & Oshamah Kun-Zhan Hsu, 2023. "Impact of Financial Liberalization on Firm Risk," Advances in Decision Sciences, Asia University, Taiwan, vol. 27(3), pages 14-45, September.
    11. Damian Clarke & Manuel Llorca Jaña & Daniel Pailañir, 2023. "The use of quantile methods in economic history," Historical Methods: A Journal of Quantitative and Interdisciplinary History, Taylor & Francis Journals, vol. 56(2), pages 115-132, April.
    12. Sulkhan Chavleishvili & Simone Manganelli, 2024. "Forecasting and stress testing with quantile vector autoregression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 66-85, January.
    13. Sun, Zhaoyang & Liu, Ling & Pan, Runquan & Wang, Yiwei & Zhang, Bingbing, 2025. "Tourism and economic growth: The role of institutional quality," International Review of Economics & Finance, Elsevier, vol. 98(C).
    14. Xianling Ren & Xinping Yu, 2024. "Hedging performance analysis of energy markets: Evidence from copula quantile regression," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 44(3), pages 432-450, March.
    15. Xie, Jinhan & Yan, Xiaodong & Jiang, Bei & Kong, Linglong, 2025. "Statistical inference for smoothed quantile regression with streaming data," Journal of Econometrics, Elsevier, vol. 249(PA).
    16. Petrella, Lea & Raponi, Valentina, 2019. "Joint estimation of conditional quantiles in multivariate linear regression models with an application to financial distress," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 70-84.
    17. Matthew Pietrosanu & Jueyu Gao & Linglong Kong & Bei Jiang & Di Niu, 2021. "Advanced algorithms for penalized quantile and composite quantile regression," Computational Statistics, Springer, vol. 36(1), pages 333-346, March.
    18. Hatice Jenkins & Ezuldeen Alshareef & Amer Mohamad, 2023. "The impact of corruption on commercial banks' credit risk: Evidence from a panel quantile regression," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 1364-1375, April.
    19. Camehl, Annika & Fok, Dennis & Gruber, Kathrin, 2025. "On superlevel sets of conditional densities and multivariate quantile regression," Journal of Econometrics, Elsevier, vol. 249(PA).
    20. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Optimal Forecast Combination for Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202514, University of Kansas, Department of Economics, revised May 2025.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:249:y:2025:i:pa:s0304407623000714. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.