IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v136y2019icp12-29.html
   My bibliography  Save this article

Sparse wavelet estimation in quantile regression with multiple functional predictors

Author

Listed:
  • Yu, Dengdeng
  • Zhang, Li
  • Mizera, Ivan
  • Jiang, Bei
  • Kong, Linglong

Abstract

To study quantile regression in partial functional linear model where response is scalar and predictors include both scalars and multiple functions, wavelet basis are usually adopted to better approximate functional slopes while effectively detect local features. The sparse group lasso penalty is imposed to select important functional predictors while capture shared information among them. The estimation problem can be reformulated into a standard second-order cone program and then solved by an interior point method. A novel algorithm is proposed by using alternating direction method of multipliers (ADMM) which was recently employed by many researchers in solving penalized quantile regression problems. The asymptotic properties such as the convergence rate and prediction error bound have been established. Simulations and a real data from ADHD-200 fMRI data are investigated to show the superiority of our proposed method.

Suggested Citation

  • Yu, Dengdeng & Zhang, Li & Mizera, Ivan & Jiang, Bei & Kong, Linglong, 2019. "Sparse wavelet estimation in quantile regression with multiple functional predictors," Computational Statistics & Data Analysis, Elsevier, vol. 136(C), pages 12-29.
    • Handle: RePEc:eee:csdana:v:136:y:2019:i:c:p:12-29
    DOI: 10.1016/j.csda.2018.12.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947318302810
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2018.12.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jelena Bradic & Jianqing Fan & Weiwei Wang, 2011. "Penalized composite quasi‐likelihood for ultrahigh dimensional variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(3), pages 325-349, June.
    2. Cardot, Hervé & Ferraty, Frédéric & Sarda, Pascal, 1999. "Functional linear model," Statistics & Probability Letters, Elsevier, vol. 45(1), pages 11-22, October.
    3. Yao, Fang & Sue-Chee, Shivon & Wang, Fan, 2017. "Regularized partially functional quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 156(C), pages 39-56.
    4. Bo Kai & Runze Li & Hui Zou, 2010. "Local composite quantile regression smoothing: an efficient and safe alternative to local polynomial regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 49-69, January.
    5. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, January.
    6. Weihua Zhao & Riquan Zhang & Jicai Liu, 2014. "Sparse group variable selection based on quantile hierarchical Lasso," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(8), pages 1658-1677, August.
    7. Collazos, Julian A.A. & Dias, Ronaldo & Zambom, Adriano Z., 2016. "Consistent variable selection for functional regression models," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 63-71.
    8. Hyonho Chun & Sündüz Keleş, 2010. "Sparse partial least squares regression for simultaneous dimension reduction and variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 3-25, January.
    9. Luo, Ruiyan & Qi, Xin, 2015. "Sparse wavelet regression with multiple predictive curves," Journal of Multivariate Analysis, Elsevier, vol. 134(C), pages 33-49.
    10. Yiguo Sun, 2005. "Semiparametric Efficient Estimation of Partially Linear Quantile Regression Models," Annals of Economics and Finance, Society for AEF, vol. 6(1), pages 105-127, May.
    11. Dehan Kong & Kaijie Xue & Fang Yao & Hao H. Zhang, 2016. "Partially functional linear regression in high dimensions," Biometrika, Biometrika Trust, vol. 103(1), pages 147-159.
    12. Koenker, Roger & Park, Beum J., 1996. "An interior point algorithm for nonlinear quantile regression," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 265-283.
    13. Müller, Hans-Georg & Yao, Fang, 2008. "Functional Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1534-1544.
    14. Nicolai Meinshausen & Peter Bühlmann, 2010. "Stability selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 417-473, September.
    15. Ping Yu & Zhongzhan Zhang & Jiang Du, 2016. "A test of linearity in partial functional linear regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 79(8), pages 953-969, November.
    16. Antoniadis, Anestis & Bigot, Jeremie & Sapatinas, Theofanis, 2001. "Wavelet Estimators in Nonparametric Regression: A Comparative Simulation Study," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 6(i06).
    17. Zhang, Yiyun & Li, Runze & Tsai, Chih-Ling, 2010. "Regularization Parameter Selections via Generalized Information Criterion," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 312-323.
    18. Ying Lu & Jiang Du & Zhimeng Sun, 2014. "Functional partially linear quantile regression model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 77(2), pages 317-332, February.
    19. Li, Youjuan & Liu, Yufeng & Zhu, Ji, 2007. "Quantile Regression in Reproducing Kernel Hilbert Spaces," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 255-268, March.
    20. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    21. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    22. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Park, Seyoung & Kim, Hyunjin & Lee, Eun Ryung, 2023. "Regional quantile regression for multiple responses," Computational Statistics & Data Analysis, Elsevier, vol. 188(C).
    2. Liu, Yuzi & Peng, Ling & Liu, Qing & Lian, Heng & Liu, Xiaohui, 2023. "Functional additive expectile regression in the reproducing kernel Hilbert space," Journal of Multivariate Analysis, Elsevier, vol. 198(C).
    3. Ufuk Beyaztas & Han Lin Shang & Aylin Alin, 2022. "Function-on-Function Partial Quantile Regression," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 27(1), pages 149-174, March.
    4. Sanying Feng & Menghan Zhang & Tiejun Tong, 2022. "Variable selection for functional linear models with strong heredity constraint," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(2), pages 321-339, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tian, Yuzhu & Song, Xinyuan, 2020. "Bayesian bridge-randomized penalized quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    2. Ma, Haiqiang & Li, Ting & Zhu, Hongtu & Zhu, Zhongyi, 2019. "Quantile regression for functional partially linear model in ultra-high dimensions," Computational Statistics & Data Analysis, Elsevier, vol. 129(C), pages 135-147.
    3. Aneiros, Germán & Novo, Silvia & Vieu, Philippe, 2022. "Variable selection in functional regression models: A review," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    4. Ping Yu & Zhongyi Zhu & Zhongzhan Zhang, 2019. "Robust exponential squared loss-based estimation in semi-functional linear regression models," Computational Statistics, Springer, vol. 34(2), pages 503-525, June.
    5. Zhu, Hanbing & Zhang, Riquan & Yu, Zhou & Lian, Heng & Liu, Yanghui, 2019. "Estimation and testing for partially functional linear errors-in-variables models," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 296-314.
    6. Crambes, Christophe & Gannoun, Ali & Henchiri, Yousri, 2013. "Support vector machine quantile regression approach for functional data: Simulation and application studies," Journal of Multivariate Analysis, Elsevier, vol. 121(C), pages 50-68.
    7. Zhang, Ting & Wang, Lei, 2020. "Smoothed empirical likelihood inference and variable selection for quantile regression with nonignorable missing response," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    8. Torossian, Léonard & Picheny, Victor & Faivre, Robert & Garivier, Aurélien, 2020. "A review on quantile regression for stochastic computer experiments," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    9. Bousebata, Meryem & Enjolras, Geoffroy & Girard, Stéphane, 2023. "Extreme partial least-squares," Journal of Multivariate Analysis, Elsevier, vol. 194(C).
    10. Christophe Crambes & Ali Gannoun & Yousri Henchiri, 2014. "Modelling functional additive quantile regression using support vector machines approach," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(4), pages 639-668, December.
    11. Park, Jinho & Kim, Jeankyung, 2011. "Quantile regression with an epsilon-insensitive loss in a reproducing kernel Hilbert space," Statistics & Probability Letters, Elsevier, vol. 81(1), pages 62-70, January.
    12. Yao, Fang & Sue-Chee, Shivon & Wang, Fan, 2017. "Regularized partially functional quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 156(C), pages 39-56.
    13. Li, Degui & Li, Runze, 2016. "Local composite quantile regression smoothing for Harris recurrent Markov processes," Journal of Econometrics, Elsevier, vol. 194(1), pages 44-56.
    14. Guangrui Tang & Neng Fan, 2022. "A Survey of Solution Path Algorithms for Regression and Classification Models," Annals of Data Science, Springer, vol. 9(4), pages 749-789, August.
    15. Petrella, Lea & Raponi, Valentina, 2019. "Joint estimation of conditional quantiles in multivariate linear regression models with an application to financial distress," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 70-84.
    16. Songfeng Zheng, 2014. "A generalized Newton algorithm for quantile regression models," Computational Statistics, Springer, vol. 29(6), pages 1403-1426, December.
    17. Luo, Ruiyan & Qi, Xin, 2015. "Sparse wavelet regression with multiple predictive curves," Journal of Multivariate Analysis, Elsevier, vol. 134(C), pages 33-49.
    18. Sang, Peijun & Lockhart, Richard A. & Cao, Jiguo, 2018. "Sparse estimation for functional semiparametric additive models," Journal of Multivariate Analysis, Elsevier, vol. 168(C), pages 105-118.
    19. Cai, Jia & Xiang, Dao-Hong, 2016. "Statistical consistency of coefficient-based conditional quantile regression," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 1-12.
    20. Huang, Lele & Zhao, Junlong & Wang, Huiwen & Wang, Siyang, 2016. "Robust shrinkage estimation and selection for functional multiple linear model through LAD loss," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 384-400.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:136:y:2019:i:c:p:12-29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.