IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0328696.html

Comparing variable and feature selection strategies for prediction - protocol of a simulation study in low-dimensional transplantation data

Author

Listed:
  • Linard Hoessly
  • Jaromil Frossard
  • Simon Schwab
  • Frédérique Chammartin
  • Alexander Leichtle
  • Peter Werner Schreiber
  • Dionysios Neofytos
  • Michael Koller
  • with the Swiss Transplant Cohort Study (STCS)

Abstract

The integration of machine learning methodologies has become prevalent in the development of clinical prediction models, often suggesting superior performance compared to traditional statistical techniques. Within the scope of low-dimensional datasets, encompassing both classical and machine learning paradigms, we plan to undertake a comparison of variable selection methodologies through simulation-based analysis. The principal aim is the comparison of the variable selection strategies with respect to relative predictive accuracy and its variability, with a secondary aim the comparison of descriptive accuracy. We use six distinct statistical learning approaches across both data generation and model learning. The present manuscript is a protocol for the corresponding simulation study registration (Study registration Open Science Framework ID: k6c8f). We describe the planned steps through the Aims, Data, Estimands, Methods, and Performance framework for simulation study design and reporting.

Suggested Citation

  • Linard Hoessly & Jaromil Frossard & Simon Schwab & Frédérique Chammartin & Alexander Leichtle & Peter Werner Schreiber & Dionysios Neofytos & Michael Koller & with the Swiss Transplant Cohort Study (S, 2025. "Comparing variable and feature selection strategies for prediction - protocol of a simulation study in low-dimensional transplantation data," PLOS ONE, Public Library of Science, vol. 20(8), pages 1-14, August.
  • Handle: RePEc:plo:pone00:0328696
    DOI: 10.1371/journal.pone.0328696
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0328696
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0328696&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0328696?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    2. Davide Fiaschi & Andrea Mario Lavezzi & Angela Parenti, 2020. "Deep and Proximate Determinants of the World Income Distribution," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 66(3), pages 677-710, September.
    3. Zhongqi Liang & Qihua Wang & Yuting Wei, 2022. "Robust model selection with covariables missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 74(3), pages 539-557, June.
    4. Kurisu, Daisuke & Otsu, Taisuke, 2025. "Model averaging for global Fréchet regression," LSE Research Online Documents on Economics 126533, London School of Economics and Political Science, LSE Library.
    5. Bhattacharya, Debopam & Dupas, Pascaline, 2012. "Inferring welfare maximizing treatment assignment under budget constraints," Journal of Econometrics, Elsevier, vol. 167(1), pages 168-196.
    6. Schomaker Michael & Heumann Christian, 2011. "Model Averaging in Factor Analysis: An Analysis of Olympic Decathlon Data," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 7(1), pages 1-15, January.
    7. Tumala, Mohammed M & Olubusoye, Olusanya E & Yaaba, Baba N & Yaya, OlaOluwa S & Akanbi, Olawale B, 2017. "Forecasting Nigerian Inflation using Model Averaging methods: Modelling Frameworks to Central Banks," MPRA Paper 88754, University Library of Munich, Germany, revised Feb 2018.
    8. José Manuel Cordero Ferrera & Manuel Muñiz Pérez & Rosa Simancas Rodríguez, 2015. "The influence of socioeconomic factors on cognitive and non-cognitive educational outcomes," Investigaciones de Economía de la Educación volume 10, in: Marta Rahona López & Jennifer Graves (ed.), Investigaciones de Economía de la Educación 10, edition 1, volume 10, chapter 21, pages 413-438, Asociación de Economía de la Educación.
    9. Naoya Sueishi & Arihiro Yoshimura, 2017. "Focused Information Criterion for Series Estimation in Partially Linear Models," The Japanese Economic Review, Japanese Economic Association, vol. 68(3), pages 352-363, September.
    10. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    11. Miao Han & Liuquan Sun & Yutao Liu & Jun Zhu, 2018. "Joint analysis of recurrent event data with additive–multiplicative hazards model for the terminal event time," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 81(5), pages 523-547, July.
    12. Gildas Mazo & François Portier, 2021. "Parametric versus nonparametric: The fitness coefficient," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(4), pages 1344-1383, December.
    13. Anwen Yin, 2024. "Predictive model averaging with parameter instability and heteroskedasticity," Bulletin of Economic Research, Wiley Blackwell, vol. 76(2), pages 418-442, April.
    14. Gerda Claeskens & Fabrizio Consentino, 2008. "Variable Selection with Incomplete Covariate Data," Biometrics, The International Biometric Society, vol. 64(4), pages 1062-1069, December.
    15. Cornelius Fritz & Michael Lebacher & Göran Kauermann, 2020. "Tempus volat, hora fugit: A survey of tie‐oriented dynamic network models in discrete and continuous time," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 74(3), pages 275-299, August.
    16. Edvard Bakhitov, 2020. "Frequentist Shrinkage under Inequality Constraints," Papers 2001.10586, arXiv.org.
    17. Li, Degui & Linton, Oliver & Lu, Zudi, 2015. "A flexible semiparametric forecasting model for time series," Journal of Econometrics, Elsevier, vol. 187(1), pages 345-357.
    18. Rina Wu & Jiquan Zhang & Yuhai Bao & Enliang Guo, 2019. "Run Theory and Copula-Based Drought Risk Analysis for Songnen Grassland in Northeastern China," Sustainability, MDPI, vol. 11(21), pages 1-17, October.
    19. Jäckel, Christoph, 2013. "Model uncertainty and expected return proxies," MPRA Paper 51978, University Library of Munich, Germany.
    20. Heiler, Phillip & Mareckova, Jana, 2021. "Shrinkage for categorical regressors," Journal of Econometrics, Elsevier, vol. 223(1), pages 161-189.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0328696. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.