IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v52y2008i12p5296-5304.html
   My bibliography  Save this article

Regularized simultaneous model selection in multiple quantiles regression

Author

Listed:
  • Zou, Hui
  • Yuan, Ming

Abstract

Simultaneously estimating multiple conditional quantiles is often regarded as a more appropriate regression tool than the usual conditional mean regression for exploring the stochastic relationship between the response and covariates. When multiple quantile regressions are considered, it is of great importance to share strength among them. In this paper, we propose a novel regularization method that explores the similarity among multiple quantile regressions by selecting a common subset of covariates to model multiple conditional quantiles simultaneously. The penalty we employ is a matrix norm that encourages sparsity in a column-wise fashion. We demonstrate the effectiveness of the proposed method using both simulations and an application of gene expression data analysis.

Suggested Citation

  • Zou, Hui & Yuan, Ming, 2008. "Regularized simultaneous model selection in multiple quantiles regression," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5296-5304, August.
    • Handle: RePEc:eee:csdana:v:52:y:2008:i:12:p:5296-5304
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(08)00273-9
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Koenker, Roger, 2004. "Quantile regression for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 91(1), pages 74-89, October.
    2. Li, Youjuan & Liu, Yufeng & Zhu, Ji, 2007. "Quantile Regression in Reproducing Kernel Hilbert Spaces," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 255-268, March.
    3. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    4. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    5. Koenker R. & Geling O., 2001. "Reappraising Medfly Longevity: A Quantile Regression Survival Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 458-468, June.
    6. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    7. X. He & P. Ng & S. Portnoy, 1998. "Bivariate quantile smoothing splines," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(3), pages 537-550.
    8. Roger Koenker & Kevin F. Hallock, 2001. "Quantile Regression," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 143-156, Fall.
    9. Ming Yuan & Yi Lin, 2006. "Model selection and estimation in regression with grouped variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(1), pages 49-67, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chakraborty, Sounak, 2009. "Simultaneous cancer classification and gene selection with Bayesian nearest neighbor method: An integrated approach," Computational Statistics & Data Analysis, Elsevier, vol. 53(4), pages 1462-1474, February.
    2. Y. Andriyana & I. Gijbels & A. Verhasselt, 2014. "P-splines quantile regression estimation in varying coefficient models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(1), pages 153-194, March.
    3. Yufeng Liu & Yichao Wu, 2011. "Simultaneous multiple non-crossing quantile regression estimation using kernel constraints," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(2), pages 415-437.
    4. Y. Andriyana & I. Gijbels & A. Verhasselt, 2018. "Quantile regression in varying-coefficient models: non-crossing quantile curves and heteroscedasticity," Statistical Papers, Springer, vol. 59(4), pages 1589-1621, December.
    5. Bang, Sungwan & Jhun, Myoungshic, 2012. "Simultaneous estimation and factor selection in quantile regression via adaptive sup-norm regularization," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 813-826.
    6. Kei Nakagawa & Shuhei Noma & Masaya Abe, 2020. "RM-CVaR: Regularized Multiple $\beta$-CVaR Portfolio," Papers 2004.13347, arXiv.org, revised May 2020.
    7. Tang, Yanlin & Wang, Huixia Judy, 2015. "Penalized regression across multiple quantiles under random censoring," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 132-146.
    8. Ji, Yonggang & Lin, Nan & Zhang, Baoxue, 2012. "Model selection in binary and tobit quantile regression using the Gibbs sampler," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 827-839.
    9. Jiang, Liewen & Bondell, Howard D. & Wang, Huixia Judy, 2014. "Interquantile shrinkage and variable selection in quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 208-219.
    10. Alexander Aue & Rex C. Y. Cheung & Thomas C. M. Lee & Ming Zhong, 2014. "Segmented Model Selection in Quantile Regression Using the Minimum Description Length Principle," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1241-1256, September.
    11. Chakraborty, Sounak, 2009. "Bayesian binary kernel probit model for microarray based cancer classification and gene selection," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4198-4209, October.
    12. Vahid Nassiri & Ignace Loris, 2014. "An efficient algorithm for structured sparse quantile regression," Computational Statistics, Springer, vol. 29(5), pages 1321-1343, October.
    13. He, Qianchuan & Kong, Linglong & Wang, Yanhua & Wang, Sijian & Chan, Timothy A. & Holland, Eric, 2016. "Regularized quantile regression under heterogeneous sparsity with application to quantitative genetic traits," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 222-239.
    14. Schnabel, Sabine K. & Eilers, Paul H.C., 2009. "Optimal expectile smoothing," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4168-4177, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bang, Sungwan & Jhun, Myoungshic, 2012. "Simultaneous estimation and factor selection in quantile regression via adaptive sup-norm regularization," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 813-826.
    2. Jiang, Rong & Qian, Weimin & Zhou, Zhangong, 2012. "Variable selection and coefficient estimation via composite quantile regression with randomly censored data," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 308-317.
    3. Yufeng Liu & Yichao Wu, 2011. "Simultaneous multiple non-crossing quantile regression estimation using kernel constraints," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(2), pages 415-437.
    4. Maria Marino & Alessio Farcomeni, 2015. "Linear quantile regression models for longitudinal experiments: an overview," METRON, Springer;Sapienza Università di Roma, vol. 73(2), pages 229-247, August.
    5. Sungwan Bang & Soo-Heang Eo & Yong Mee Cho & Myoungshic Jhun & HyungJun Cho, 2016. "Non-crossing weighted kernel quantile regression with right censored data," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 22(1), pages 100-121, January.
    6. Firpo, Sergio & Galvao, Antonio F. & Pinto, Cristine & Poirier, Alexandre & Sanroman, Graciela, 2022. "GMM quantile regression," Journal of Econometrics, Elsevier, vol. 230(2), pages 432-452.
    7. Guilherme Resende Oliveira & Benjamin Miranda Tabak & José Guilherme de Lara Resende & Daniel Oliveira Cajueiro, 2012. "Determinantes da Estrutura de Capital das Empresas Brasileiras: uma abordagem em regressão quantílica," Working Papers Series 272, Central Bank of Brazil, Research Department.
    8. Jooyong Shim & Changha Hwang & Kyungha Seok, 2014. "Composite support vector quantile regression estimation," Computational Statistics, Springer, vol. 29(6), pages 1651-1665, December.
    9. Gilles Dufrenot & Valerie Mignon & Charalambos Tsangarides, 2010. "The trade-growth nexus in the developing countries: a quantile regression approach," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 146(4), pages 731-761, December.
    10. José Manuel Pastor & Jose M. Pavía & Lorenzo Serrano & Emili Tortosa-Ausina, 2017. "Rich regions, poor regions and bank branch deregulation in Spain," Regional Studies, Taylor & Francis Journals, vol. 51(11), pages 1678-1694, November.
    11. Joachim Wagner, 2016. "From Estimation Results to Stylized Facts: Twelve Recommendations for Empirical Research in International Activities of Heterogeneous Firms," World Scientific Book Chapters, in: Microeconometrics of International Trade, chapter 15, pages 479-514, World Scientific Publishing Co. Pte. Ltd..
    12. Vahid Nassiri & Ignace Loris, 2014. "An efficient algorithm for structured sparse quantile regression," Computational Statistics, Springer, vol. 29(5), pages 1321-1343, October.
    13. Wang, Shaojian & Zeng, Jingyuan & Liu, Xiaoping, 2019. "Examining the multiple impacts of technological progress on CO2 emissions in China: A panel quantile regression approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 103(C), pages 140-150.
    14. Marcus Alexander & Matthew Harding & Carlos Lamarche, 2011. "Quantifying the impact of economic crises on infant mortality in advanced economies," Applied Economics, Taylor & Francis Journals, vol. 43(24), pages 3313-3323.
    15. Park, Jinho & Kim, Jeankyung, 2011. "Quantile regression with an epsilon-insensitive loss in a reproducing kernel Hilbert space," Statistics & Probability Letters, Elsevier, vol. 81(1), pages 62-70, January.
    16. Chih-Chuan Yeh & Kuan-Min Wang & Yu-Bo Suen, 2011. "A quantile framework for analysing the links between inflation uncertainty and inflation dynamics across countries," Applied Economics, Taylor & Francis Journals, vol. 43(20), pages 2593-2602.
    17. Wu, Chaojiang & Yu, Yan, 2014. "Partially linear modeling of conditional quantiles using penalized splines," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 170-187.
    18. Mohamed Ouhourane & Yi Yang & Andréa L. Benedet & Karim Oualkacha, 2022. "Group penalized quantile regression," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(3), pages 495-529, September.
    19. Lin, Guixian & He, Xuming & Portnoy, Stephen, 2012. "Quantile regression with doubly censored data," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 797-812.
    20. Petrella, Lea & Raponi, Valentina, 2019. "Joint estimation of conditional quantiles in multivariate linear regression models with an application to financial distress," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 70-84.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:52:y:2008:i:12:p:5296-5304. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.