IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0322937.html
   My bibliography  Save this article

The variable selection of two-part regression model for semicontinuous data

Author

Listed:
  • Yahui Lu
  • Aiyi Liu
  • Tao Jiang

Abstract

In many research fields, measurement data containing too many zeros are often called semicontinuous data. For semicontinuous data, the most common method is the two-part model, which establishes the corresponding regression model for both the zero-valued part and the nonzero-valued part. Considering that each part of the two-part regression model often encounters a large number of candidate variables, the variable selection becomes an important problem in semicontinuous data analysis. However, there is little research literature on this topic. To bridge this gap, we propose a new type of variable selection methods for the two-part regression model. In this paper, the Bernoulli-Normal two-part (BNT) regression model is presented, and a variable selection method based on Lasso penalty function is proposed. To solve the problem that Lasso estimator does not have Oracle attribute, we then propose a variable selection method based on adaptive Lasso penalty function. The simulation results show that both methods can select variables for BNT regression model and are easy to implement, and the performance of adaptive Lasso method is superior to the Lasso method. We demonstrate the effectiveness of the proposed tools using dietary intake data to further analyze the important factors affecting dietary intake of patients.

Suggested Citation

  • Yahui Lu & Aiyi Liu & Tao Jiang, 2025. "The variable selection of two-part regression model for semicontinuous data," PLOS ONE, Public Library of Science, vol. 20(6), pages 1-22, June.
  • Handle: RePEc:plo:pone00:0322937
    DOI: 10.1371/journal.pone.0322937
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0322937
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0322937&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0322937?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Frees, Edward W. & Meyers, Glenn & Cummings, A. David, 2011. "Summarizing Insurance Scores Using a Gini Index," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1085-1098.
    2. Jared D. Huling & Maureen A. Smith & Guanhua Chen, 2020. "A Two-Part Framework for Estimating Individualized Treatment Rules From Semicontinuous Outcomes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(533), pages 210-223, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Deprez, Laurens & Antonio, Katrien & Boute, Robert, 2021. "Pricing service maintenance contracts using predictive analytics," European Journal of Operational Research, Elsevier, vol. 290(2), pages 530-545.
    2. Chuancun Yin, 2019. "Stochastic ordering of Gini indexes for multivariate elliptical random variables," Papers 1908.01943, arXiv.org, revised Sep 2019.
    3. Kim, Bara & Kim, Jeongsim, 2019. "Stochastic ordering of Gini indexes for multivariate elliptical risks," Insurance: Mathematics and Economics, Elsevier, vol. 88(C), pages 151-158.
    4. Zifeng Zhao & Peng Shi & Xiaoping Feng, 2021. "Knowledge Learning of Insurance Risks Using Dependence Models," INFORMS Journal on Computing, INFORMS, vol. 33(3), pages 1177-1196, July.
    5. Gu, Zheng & Li, Yunxian & Zhang, Minghui & Liu, Yifei, 2023. "Modelling economic losses from earthquakes using regression forests: Application to parametric insurance," Economic Modelling, Elsevier, vol. 125(C).
    6. Jeong, Himchan & Valdez, Emiliano A., 2020. "Predictive compound risk models with dependence," Insurance: Mathematics and Economics, Elsevier, vol. 94(C), pages 182-195.
    7. Garashchuk, Anna & Castillo, Fernando Isla & Rivera, Pablo Podadera, 2023. "Economic cohesion and development of the European Union's regions and member states - A methodological proposal to measure and identify the degree of regional economic cohesion," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    8. Liang Yang & Zhengxiao Li & Shengwang Meng, 2020. "Risk Loadings in Classification Ratemaking," Papers 2002.01798, arXiv.org, revised Jan 2022.
    9. Denuit, Michel & Sznajder, Dominik & Trufin, Julien, 2019. "Model selection based on Lorenz and concentration curves, Gini indices and convex order," Insurance: Mathematics and Economics, Elsevier, vol. 89(C), pages 128-139.
    10. Gao, Suhao & Yu, Zhen, 2023. "Parametric expectile regression and its application for premium calculation," Insurance: Mathematics and Economics, Elsevier, vol. 111(C), pages 242-256.
    11. Giovanni Maria Giorgi, 2019. "The Gini concentration ratio: Back to the future," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 73(2), pages 5-14, April-Jun.
    12. Edward W. Frees & Gee Lee & Lu Yang, 2016. "Multivariate Frequency-Severity Regression Models in Insurance," Risks, MDPI, vol. 4(1), pages 1-36, February.
    13. Gao, Lisa & Shi, Peng, 2022. "Leveraging high-resolution weather information to predict hail damage claims: A spatial point process for replicated point patterns," Insurance: Mathematics and Economics, Elsevier, vol. 107(C), pages 161-179.
    14. Barry C. Arnold & José María Sarabia, 2018. "Analytic Expressions for Multivariate Lorenz Surfaces," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(1), pages 84-111, December.
    15. Deprez, Laurens & Antonio, Katrien & Boute, Robert, 2023. "Empirical risk assessment of maintenance costs under full-service contracts," European Journal of Operational Research, Elsevier, vol. 304(2), pages 476-493.
    16. Hao Mei & Ruofan Jia & Guanzhong Qiao & Zhenqiu Lin & Shuangge Ma, 2023. "Human disease clinical treatment network for the elderly: analysis of the medicare inpatient length of stay and readmission data," Biometrics, The International Biometric Society, vol. 79(1), pages 404-416, March.
    17. Denuit, Michel & Huyghe, Julie & Trufin, Julien & Verdebout, Thomas, 2024. "Testing for auto-calibration with Lorenz and Concentration curves," Insurance: Mathematics and Economics, Elsevier, vol. 117(C), pages 130-139.
    18. Gao, Guangyuan & Li, Jiahong, 2023. "Dependence modeling of frequency-severity of insurance claims using waiting time," Insurance: Mathematics and Economics, Elsevier, vol. 109(C), pages 29-51.
    19. Kaiwen Wang & Jiehui Ding & Kristen R. Lidwell & Scott Manski & Gee Y. Lee & Emilio Xavier Esposito, 2019. "Treatment Level and Store Level Analyses of Healthcare Data," Risks, MDPI, vol. 7(2), pages 1-22, April.
    20. Kita-Wojciechowska Kinga & Kidziński Łukasz, 2019. "Google Street View image predicts car accident risk," Central European Economic Journal, Sciendo, vol. 6(53), pages 151-163, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0322937. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.