IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v28y2013i6p2861-2873.html
   My bibliography  Save this article

Bayesian lasso binary quantile regression

Author

Listed:
  • Dries Benoit
  • Rahim Alhamzawi
  • Keming Yu

Abstract

In this paper, a Bayesian hierarchical model for variable selection and estimation in the context of binary quantile regression is proposed. Existing approaches to variable selection in a binary classification context are sensitive to outliers, heteroskedasticity or other anomalies of the latent response. The method proposed in this study overcomes these problems in an attractive and straightforward way. A Laplace likelihood and Laplace priors for the regression parameters are proposed and estimated with Bayesian Markov Chain Monte Carlo. The resulting model is equivalent to the frequentist lasso procedure. A conceptional result is that by doing so, the binary regression model is moved from a Gaussian to a full Laplacian framework without sacrificing much computational efficiency. In addition, an efficient Gibbs sampler to estimate the model parameters is proposed that is superior to the Metropolis algorithm that is used in previous studies on Bayesian binary quantile regression. Both the simulation studies and the real data analysis indicate that the proposed method performs well in comparison to the other methods. Moreover, as the base model is binary quantile regression, a much more detailed insight in the effects of the covariates is provided by the approach. An implementation of the lasso procedure for binary quantile regression models is available in the R-package bayesQR. Copyright Springer-Verlag Berlin Heidelberg 2013

Suggested Citation

  • Dries Benoit & Rahim Alhamzawi & Keming Yu, 2013. "Bayesian lasso binary quantile regression," Computational Statistics, Springer, vol. 28(6), pages 2861-2873, December.
    • Handle: RePEc:spr:compst:v:28:y:2013:i:6:p:2861-2873
    DOI: 10.1007/s00180-013-0439-0
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s00180-013-0439-0
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s00180-013-0439-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. R. Alhamzawi & K. Yu & D. F. Benoit, 2011. "Bayesian adaptive Lasso quantile regression," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 11/728, Ghent University, Faculty of Economics and Business Administration.
    2. Koenker, Roger, 2004. "Quantile regression for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 91(1), pages 74-89, October.
    3. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, January.
    4. Gregory Kordas, 2006. "Smoothed binary regression quantiles," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(3), pages 387-407.
    5. Park, Trevor & Casella, George, 2008. "The Bayesian Lasso," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 681-686, June.
    6. Wang, Hansheng & Li, Guodong & Jiang, Guohua, 2007. "Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 347-355, July.
    7. Hideo Kozumi & Genya Kobayashi, 2009. "Gibbs Sampling Methods for Bayesian Quantile Regression," Discussion Papers 2009-02, Kobe University, Graduate School of Business Administration.
    8. Manski, Charles F., 1975. "Maximum score estimation of the stochastic utility model of choice," Journal of Econometrics, Elsevier, vol. 3(3), pages 205-228, August.
    9. Yu, Keming & Moyeed, Rana A., 2001. "Bayesian quantile regression," Statistics & Probability Letters, Elsevier, vol. 54(4), pages 437-447, October.
    10. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    11. Florios, Kostas & Skouras, Spyros, 2008. "Exact computation of max weighted score estimators," Journal of Econometrics, Elsevier, vol. 146(1), pages 86-91, September.
    12. Manski, Charles F., 1985. "Semiparametric analysis of discrete response : Asymptotic properties of the maximum score estimator," Journal of Econometrics, Elsevier, vol. 27(3), pages 313-333, March.
    13. Yu, Keming & Stander, Julian, 2007. "Bayesian analysis of a Tobit quantile regression model," Journal of Econometrics, Elsevier, vol. 137(1), pages 260-276, March.
    14. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    15. Dries F. Benoit & Dirk Van den Poel, 2012. "Binary quantile regression: a Bayesian approach based on the asymmetric Laplace distribution," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(7), pages 1174-1188, November.
    16. Rahim Alhamzawi & Haithem Taha Mohammad Ali, 2018. "Bayesian quantile regression for ordinal longitudinal data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 45(5), pages 815-828, April.
    17. Tony Lancaster & Sung Jae Jun, 2010. "Bayesian quantile regression methods," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(2), pages 287-307.
    18. Alhamzawi, Rahim & Yu, Keming, 2013. "Conjugate priors and variable selection for Bayesian quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 209-219.
    19. Ole E. Barndorff‐Nielsen & Neil Shephard, 2001. "Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 167-241.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rahim Alhamzawi & Haithem Taha Mohammad Ali, 2020. "Brq: an R package for Bayesian quantile regression," METRON, Springer;Sapienza Università di Roma, vol. 78(3), pages 313-328, December.
    2. Alhamzawi, Rahim, 2016. "Bayesian model selection in ordinal quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 68-78.
    3. Mike K. P. So & Wing Ki Liu & Amanda M. Y. Chu, 2018. "Bayesian Shrinkage Estimation Of Time-Varying Covariance Matrices In Financial Time Series," Advances in Decision Sciences, Asia University, Taiwan, vol. 22(1), pages 369-404, December.
    4. Priya Kedia & Damitri Kundu & Kiranmoy Das, 2023. "A Bayesian variable selection approach to longitudinal quantile regression," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(1), pages 149-168, March.
    5. Victor Muthama Musau & Carlo Gaetan & Paolo Girardi, 2022. "Clustering of bivariate satellite time series: A quantile approach," Environmetrics, John Wiley & Sons, Ltd., vol. 33(7), November.
    6. Georges Bresson & Guy Lacroix & Mohammad Arshad Rahman, 2021. "Bayesian panel quantile regression for binary outcomes with correlated random effects: an application on crime recidivism in Canada," Empirical Economics, Springer, vol. 60(1), pages 227-259, January.
    7. Manini Ojha & Mohammad Arshad Rahman, 2020. "Do Online Courses Provide an Equal Educational Value Compared to In-Person Classroom Teaching? Evidence from US Survey Data using Quantile Regression," Papers 2007.06994, arXiv.org.
    8. Zhao, Kaifeng & Lian, Heng, 2016. "The Expectation–Maximization approach for Bayesian quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 96(C), pages 1-11.
    9. Ana Pérez-González & Tomás R. Cotos-Yáñez & Wenceslao González-Manteiga & Rosa M. Crujeiras-Casais, 2021. "Goodness-of-fit tests for quantile regression with missing responses," Statistical Papers, Springer, vol. 62(3), pages 1231-1264, June.
    10. Taha Alshaybawee & Habshah Midi & Rahim Alhamzawi, 2017. "Bayesian elastic net single index quantile regression," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(5), pages 853-871, April.
    11. Mai Dao & Min Wang & Souparno Ghosh & Keying Ye, 2022. "Bayesian variable selection and estimation in quantile regression using a quantile-specific prior," Computational Statistics, Springer, vol. 37(3), pages 1339-1368, July.
    12. Tsai-Hung Fan & Yi-Fu Wang & Yi-Chen Zhang, 2014. "Bayesian model selection in linear mixed effects models with autoregressive(p) errors using mixture priors," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(8), pages 1814-1829, August.
    13. Rahim Alhamzawi, 2016. "Bayesian Analysis of Composite Quantile Regression," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 8(2), pages 358-373, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ji, Yonggang & Lin, Nan & Zhang, Baoxue, 2012. "Model selection in binary and tobit quantile regression using the Gibbs sampler," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 827-839.
    2. R. Alhamzawi & K. Yu & D. F. Benoit, 2011. "Bayesian adaptive Lasso quantile regression," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 11/728, Ghent University, Faculty of Economics and Business Administration.
    3. Alhamzawi, Rahim, 2016. "Bayesian model selection in ordinal quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 68-78.
    4. A. Aghamohammadi & S. Mohammadi, 2017. "Bayesian analysis of penalized quantile regression for longitudinal data," Statistical Papers, Springer, vol. 58(4), pages 1035-1053, December.
    5. Bernardi, Mauro & Bottone, Marco & Petrella, Lea, 2018. "Bayesian quantile regression using the skew exponential power distribution," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 92-111.
    6. Genya Kobayashi & Hideo Kozumi, 2012. "Bayesian analysis of quantile regression for censored dynamic panel data," Computational Statistics, Springer, vol. 27(2), pages 359-380, June.
    7. Ali Aghamohammadi, 2018. "Bayesian analysis of dynamic panel data by penalized quantile regression," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(1), pages 91-108, March.
    8. Alhamzawi, Rahim & Yu, Keming, 2013. "Conjugate priors and variable selection for Bayesian quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 209-219.
    9. Oh, Man-Suk & Park, Eun Sug & So, Beong-Soo, 2016. "Bayesian variable selection in binary quantile regression," Statistics & Probability Letters, Elsevier, vol. 118(C), pages 177-181.
    10. Yunwen Yang & Huixia Judy Wang & Xuming He, 2016. "Posterior Inference in Bayesian Quantile Regression with Asymmetric Laplace Likelihood," International Statistical Review, International Statistical Institute, vol. 84(3), pages 327-344, December.
    11. Yu-Zhu Tian & Man-Lai Tang & Wai-Sum Chan & Mao-Zai Tian, 2021. "Bayesian bridge-randomized penalized quantile regression for ordinal longitudinal data, with application to firm’s bond ratings," Computational Statistics, Springer, vol. 36(2), pages 1289-1319, June.
    12. Seongil Jo & Taeyoung Roh & Taeryon Choi, 2016. "Bayesian spectral analysis models for quantile regression with Dirichlet process mixtures," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(1), pages 177-206, March.
    13. Tian, Yuzhu & Song, Xinyuan, 2020. "Bayesian bridge-randomized penalized quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    14. Jayabrata Biswas & Kiranmoy Das, 2021. "A Bayesian quantile regression approach to multivariate semi-continuous longitudinal data," Computational Statistics, Springer, vol. 36(1), pages 241-260, March.
    15. Rahim Alhamzawi & Haithem Taha Mohammad Ali, 2020. "Brq: an R package for Bayesian quantile regression," METRON, Springer;Sapienza Università di Roma, vol. 78(3), pages 313-328, December.
    16. Feng, Xiang-Nan & Wang, Yifan & Lu, Bin & Song, Xin-Yuan, 2017. "Bayesian regularized quantile structural equation models," Journal of Multivariate Analysis, Elsevier, vol. 154(C), pages 234-248.
    17. Yuzhu Tian & Er’qian Li & Maozai Tian, 2016. "Bayesian joint quantile regression for mixed effects models with censoring and errors in covariates," Computational Statistics, Springer, vol. 31(3), pages 1031-1057, September.
    18. Jiang, Rong & Qian, Weimin & Zhou, Zhangong, 2012. "Variable selection and coefficient estimation via composite quantile regression with randomly censored data," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 308-317.
    19. D. F. Benoit & D. Van Den Poel, 2010. "Binary quantile regression: A Bayesian approach based on the asymmetric Laplace density," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 10/662, Ghent University, Faculty of Economics and Business Administration.
    20. Georges Bresson & Guy Lacroix & Mohammad Arshad Rahman, 2021. "Bayesian panel quantile regression for binary outcomes with correlated random effects: an application on crime recidivism in Canada," Empirical Economics, Springer, vol. 60(1), pages 227-259, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:28:y:2013:i:6:p:2861-2873. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.