IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v33y2024i1d10.1007_s11749-023-00884-9.html
   My bibliography  Save this article

Variable selection in function-on-scalar single-index model via the alternating direction method of multipliers

Author

Listed:
  • Rahul Ghosal

    (University of South Carolina)

  • Arnab Maity

    (North Carolina State University)

Abstract

We develop a new method for variable selection in a function-on-scalar single-index model. The proposed method goes beyond existing additive function-on-scalar regression framework and models dynamic effects of multiple scalar covariates via a varying coefficient single-index model. The unknown bivariate link function is modeled with splines. A computationally efficient alternating direction method of multipliers-based algorithm is used for simultaneous selection of the influential covariates and estimation of the single-index coefficients and the link function. The proposed method provides a flexible framework for variable selection in function-on-scalar regression, particularly in the presence of nonlinear and interaction effects. Numerical analysis using simulations illustrates satisfactory finite sample performance of the proposed method in terms of selection and estimation accuracy. An application is demonstrated on the CD4+ cell counts data. Software implementation of the proposed method is provided in R.

Suggested Citation

  • Rahul Ghosal & Arnab Maity, 2024. "Variable selection in function-on-scalar single-index model via the alternating direction method of multipliers," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 33(1), pages 106-126, March.
    • Handle: RePEc:spr:testjl:v:33:y:2024:i:1:d:10.1007_s11749-023-00884-9
    DOI: 10.1007/s11749-023-00884-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-023-00884-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11749-023-00884-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jiahua Chen & Zehua Chen, 2008. "Extended Bayesian information criteria for model selection with large model spaces," Biometrika, Biometrika Trust, vol. 95(3), pages 759-771.
    2. Wang, Hai-Bin, 2009. "Bayesian estimation and variable selection for single index models," Computational Statistics & Data Analysis, Elsevier, vol. 53(7), pages 2617-2627, May.
    3. Reiss Philip T. & Huang Lei & Mennes Maarten, 2010. "Fast Function-on-Scalar Regression with Penalized Basis Expansions," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-30, August.
    4. Jing Lei & Max G’Sell & Alessandro Rinaldo & Ryan J. Tibshirani & Larry Wasserman, 2018. "Distribution-Free Predictive Inference for Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1094-1111, July.
    5. Xinchao Luo & Lixing Zhu & Hongtu Zhu, 2016. "Single‐index varying coefficient model for functional responses," Biometrics, The International Biometric Society, vol. 72(4), pages 1275-1284, December.
    6. Jeff Goldsmith & Vadim Zipunnikov & Jennifer Schrack, 2015. "Generalized multilevel function-on-scalar regression and principal component analysis," Biometrics, The International Biometric Society, vol. 71(2), pages 344-353, June.
    7. Efang Kong & Yingcun Xia, 2007. "Variable selection for the single‐index model," Biometrika, Biometrika Trust, vol. 94(1), pages 217-229.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rahul Ghosal & Arnab Maity, 2023. "Variable selection in nonlinear function‐on‐scalar regression," Biometrics, The International Biometric Society, vol. 79(1), pages 292-303, March.
    2. Xie, Haihan & Kong, Linglong, 2023. "Gaussian copula function-on-scalar regression in reproducing kernel Hilbert space," Journal of Multivariate Analysis, Elsevier, vol. 198(C).
    3. Ruiyan Luo & Xin Qi, 2023. "Nonlinear function‐on‐scalar regression via functional universal approximation," Biometrics, The International Biometric Society, vol. 79(4), pages 3319-3331, December.
    4. Wai-Yin Poon & Hai-Bin Wang, 2014. "Multivariate partially linear single-index models: Bayesian analysis," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(4), pages 755-768, December.
    5. Yazhao Lv & Riquan Zhang & Weihua Zhao & Jicai Liu, 2014. "Quantile regression and variable selection for the single-index model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(7), pages 1565-1577, July.
    6. Fan, Zhaohu & Reimherr, Matthew, 2017. "High-dimensional adaptive function-on-scalar regression," Econometrics and Statistics, Elsevier, vol. 1(C), pages 167-183.
    7. Li, Yehua & Qiu, Yumou & Xu, Yuhang, 2022. "From multivariate to functional data analysis: Fundamentals, recent developments, and emerging areas," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    8. Renat Sergazinov & Andrew Leroux & Erjia Cui & Ciprian Crainiceanu & R. Nisha Aurora & Naresh M. Punjabi & Irina Gaynanova, 2023. "A case study of glucose levels during sleep using multilevel fast function on scalar regression inference," Biometrics, The International Biometric Society, vol. 79(4), pages 3873-3882, December.
    9. Jianbo Li & Yuan Li & Riquan Zhang, 2017. "B spline variable selection for the single index models," Statistical Papers, Springer, vol. 58(3), pages 691-706, September.
    10. Zhang, Xiaoke & Zhong, Qixian & Wang, Jane-Ling, 2020. "A new approach to varying-coefficient additive models with longitudinal covariates," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).
    11. Frommlet, Florian & Ruhaltinger, Felix & Twaróg, Piotr & Bogdan, Małgorzata, 2012. "Modified versions of Bayesian Information Criterion for genome-wide association studies," Computational Statistics & Data Analysis, Elsevier, vol. 56(5), pages 1038-1051.
    12. Acharki, Naoufal & Bertoncello, Antoine & Garnier, Josselin, 2023. "Robust prediction interval estimation for Gaussian processes by cross-validation method," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    13. Zak-Szatkowska, Malgorzata & Bogdan, Malgorzata, 2011. "Modified versions of the Bayesian Information Criterion for sparse Generalized Linear Models," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 2908-2924, November.
    14. Xinchao Luo & Lixing Zhu & Hongtu Zhu, 2016. "Single‐index varying coefficient model for functional responses," Biometrics, The International Biometric Society, vol. 72(4), pages 1275-1284, December.
    15. Xiaotong Shen & Wei Pan & Yunzhang Zhu & Hui Zhou, 2013. "On constrained and regularized high-dimensional regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(5), pages 807-832, October.
    16. Xingcai Zhou & Dehan Kong & Matthew Stephen Pietrosanu & Linglong Kong & Rohana J. Karunamuni, 2024. "Empirical likelihood M‐estimation for the varying‐coefficient model with functional response," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 51(3), pages 1357-1387, September.
    17. Shan Luo & Zehua Chen, 2014. "Sequential Lasso Cum EBIC for Feature Selection With Ultra-High Dimensional Feature Space," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1229-1240, September.
    18. Lu Tang & Ling Zhou & Peter X. K. Song, 2019. "Fusion learning algorithm to combine partially heterogeneous Cox models," Computational Statistics, Springer, vol. 34(1), pages 395-414, March.
    19. Molly C. Klanderman & Kathryn B. Newhart & Tzahi Y. Cath & Amanda S. Hering, 2020. "Fault isolation for a complex decentralized waste water treatment facility," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(4), pages 931-951, August.
    20. Lai, Peng & Wang, Qihua & Lian, Heng, 2012. "Bias-corrected GEE estimation and smooth-threshold GEE variable selection for single-index models with clustered data," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 422-432.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:33:y:2024:i:1:d:10.1007_s11749-023-00884-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.