IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0322937.html
   My bibliography  Save this article

The variable selection of two-part regression model for semicontinuous data

Author

Listed:
  • Yahui Lu
  • Aiyi Liu
  • Tao Jiang

Abstract

In many research fields, measurement data containing too many zeros are often called semicontinuous data. For semicontinuous data, the most common method is the two-part model, which establishes the corresponding regression model for both the zero-valued part and the nonzero-valued part. Considering that each part of the two-part regression model often encounters a large number of candidate variables, the variable selection becomes an important problem in semicontinuous data analysis. However, there is little research literature on this topic. To bridge this gap, we propose a new type of variable selection methods for the two-part regression model. In this paper, the Bernoulli-Normal two-part (BNT) regression model is presented, and a variable selection method based on Lasso penalty function is proposed. To solve the problem that Lasso estimator does not have Oracle attribute, we then propose a variable selection method based on adaptive Lasso penalty function. The simulation results show that both methods can select variables for BNT regression model and are easy to implement, and the performance of adaptive Lasso method is superior to the Lasso method. We demonstrate the effectiveness of the proposed tools using dietary intake data to further analyze the important factors affecting dietary intake of patients.

Suggested Citation

  • Yahui Lu & Aiyi Liu & Tao Jiang, 2025. "The variable selection of two-part regression model for semicontinuous data," PLOS ONE, Public Library of Science, vol. 20(6), pages 1-22, June.
  • Handle: RePEc:plo:pone00:0322937
    DOI: 10.1371/journal.pone.0322937
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0322937
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0322937&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0322937?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Frees, Edward W. & Meyers, Glenn & Cummings, A. David, 2011. "Summarizing Insurance Scores Using a Gini Index," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1085-1098.
    2. Jared D. Huling & Maureen A. Smith & Guanhua Chen, 2020. "A Two-Part Framework for Estimating Individualized Treatment Rules From Semicontinuous Outcomes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(533), pages 210-223, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jeong, Himchan & Valdez, Emiliano A., 2020. "Predictive compound risk models with dependence," Insurance: Mathematics and Economics, Elsevier, vol. 94(C), pages 182-195.
    2. Garashchuk, Anna & Castillo, Fernando Isla & Rivera, Pablo Podadera, 2023. "Economic cohesion and development of the European Union's regions and member states - A methodological proposal to measure and identify the degree of regional economic cohesion," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    3. Liang Yang & Zhengxiao Li & Shengwang Meng, 2020. "Risk Loadings in Classification Ratemaking," Papers 2002.01798, arXiv.org, revised Jan 2022.
    4. Giovanni Maria Giorgi, 2019. "The Gini concentration ratio: Back to the future," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 73(2), pages 5-14, April-Jun.
    5. Edward W. Frees & Gee Lee & Lu Yang, 2016. "Multivariate Frequency-Severity Regression Models in Insurance," Risks, MDPI, vol. 4(1), pages 1-36, February.
    6. Gao, Lisa & Shi, Peng, 2022. "Leveraging high-resolution weather information to predict hail damage claims: A spatial point process for replicated point patterns," Insurance: Mathematics and Economics, Elsevier, vol. 107(C), pages 161-179.
    7. Deprez, Laurens & Antonio, Katrien & Boute, Robert, 2023. "Empirical risk assessment of maintenance costs under full-service contracts," European Journal of Operational Research, Elsevier, vol. 304(2), pages 476-493.
    8. Denuit, Michel & Huyghe, Julie & Trufin, Julien & Verdebout, Thomas, 2024. "Testing for auto-calibration with Lorenz and Concentration curves," Insurance: Mathematics and Economics, Elsevier, vol. 117(C), pages 130-139.
    9. Gao, Guangyuan & Li, Jiahong, 2023. "Dependence modeling of frequency-severity of insurance claims using waiting time," Insurance: Mathematics and Economics, Elsevier, vol. 109(C), pages 29-51.
    10. Denuit, Michel & Trufin, Julien & Verdebout, Thomas, 2021. "Testing for more positive expectation dependence with application to model comparison," Insurance: Mathematics and Economics, Elsevier, vol. 101(PB), pages 163-172.
    11. Oh, Rosy & Jeong, Himchan & Ahn, Jae Youn & Valdez, Emiliano A., 2021. "A multi-year microlevel collective risk model," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 309-328.
    12. Shi, Peng & Feng, Xiaoping & Ivantsova, Anastasia, 2015. "Dependent frequency–severity modeling of insurance claims," Insurance: Mathematics and Economics, Elsevier, vol. 64(C), pages 417-428.
    13. Spark C. Tseung & Ian Weng Chan & Tsz Chai Fung & Andrei L. Badescu & X. Sheldon Lin, 2023. "Improving risk classification and ratemaking using mixture‐of‐experts models with random effects," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 90(3), pages 789-820, September.
    14. Denuit, Michel & Sznajder, Dominik & Trufin, Julien, 2019. "Model selection based on Lorenz and concentration curves, Gini indices and convex order," LIDAM Discussion Papers ISBA 2019006, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    15. Genest Christian & Scherer Matthias, 2020. "Insurance applications of dependence modeling: An interview with Edward (Jed) Frees," Dependence Modeling, De Gruyter, vol. 8(1), pages 93-106, January.
    16. Verschuren, Robert Matthijs, 2022. "Frequency-severity experience rating based on latent Markovian risk profiles," Insurance: Mathematics and Economics, Elsevier, vol. 107(C), pages 379-392.
    17. Lee, Gee Y. & Shi, Peng, 2019. "A dependent frequency–severity approach to modeling longitudinal insurance claims," Insurance: Mathematics and Economics, Elsevier, vol. 87(C), pages 115-129.
    18. Samanthi, Ranadeera Gamage Madhuka & Wei, Wei & Brazauskas, Vytaras, 2016. "Ordering Gini indexes of multivariate elliptical risks," Insurance: Mathematics and Economics, Elsevier, vol. 68(C), pages 84-91.
    19. Deprez, Laurens & Antonio, Katrien & Boute, Robert, 2021. "Pricing service maintenance contracts using predictive analytics," European Journal of Operational Research, Elsevier, vol. 290(2), pages 530-545.
    20. Chuancun Yin, 2019. "Stochastic ordering of Gini indexes for multivariate elliptical random variables," Papers 1908.01943, arXiv.org, revised Sep 2019.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0322937. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.