IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0283094.html
   My bibliography  Save this article

Machine learning models trained on synthetic datasets of multiple sample sizes for the use of predicting blood pressure from clinical data in a national dataset

Author

Listed:
  • Anmol Arora
  • Ananya Arora

Abstract

Introduction: The potential for synthetic data to act as a replacement for real data in research has attracted attention in recent months due to the prospect of increasing access to data and overcoming data privacy concerns when sharing data. The field of generative artificial intelligence and synthetic data is still early in its development, with a research gap evidencing that synthetic data can adequately be used to train algorithms that can be used on real data. This study compares the performance of a series machine learning models trained on real data and synthetic data, based on the National Diet and Nutrition Survey (NDNS). Methods: Features identified to be potentially of relevance by directed acyclic graphs were isolated from the NDNS dataset and used to construct synthetic datasets and impute missing data. Recursive feature elimination identified only four variables needed to predict mean arterial blood pressure: age, sex, weight and height. Bayesian generalised linear regression, random forest and neural network models were constructed based on these four variables to predict blood pressure. Models were trained on the real data training set (n = 2408), a synthetic data training set (n = 2408) and larger synthetic data training set (n = 4816) and a combination of the real and synthetic data training set (n = 4816). The same test set (n = 424) was used for each model. Results: Synthetic datasets demonstrated a high degree of fidelity with the real dataset. There was no significant difference between the performance of models trained on real, synthetic or combined datasets. Mean average error across all models and all training data ranged from 8.12 To 8.33. This indicates that synthetic data was capable of training equally accurate machine learning models as real data. Discussion: Further research is needed on a variety of datasets to confirm the utility of synthetic data to replace the use of potentially identifiable patient data. There is also further urgent research needed into evidencing that synthetic data can truly protect patient privacy against adversarial attempts to re-identify real individuals from the synthetic dataset.

Suggested Citation

  • Anmol Arora & Ananya Arora, 2023. "Machine learning models trained on synthetic datasets of multiple sample sizes for the use of predicting blood pressure from clinical data in a national dataset," PLOS ONE, Public Library of Science, vol. 18(3), pages 1-10, March.
  • Handle: RePEc:plo:pone00:0283094
    DOI: 10.1371/journal.pone.0283094
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0283094
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0283094&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0283094?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Chao Yan & Yao Yan & Zhiyu Wan & Ziqi Zhang & Larsson Omberg & Justin Guinney & Sean D. Mooney & Bradley A. Malin, 2022. "A Multifaceted benchmarking of synthetic electronic health record generation models," Nature Communications, Nature, vol. 13(1), pages 1-18, December.
    2. Nowok, Beata & Raab, Gillian M. & Dibben, Chris, 2016. "synthpop: Bespoke Creation of Synthetic Data in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 74(i11).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Bietsch & Robert Stahlbock & Stefan Voß, 2023. "Synthetic Data as a Proxy for Real-World Electronic Health Records in the Patient Length of Stay Prediction," Sustainability, MDPI, vol. 15(18), pages 1-30, September.
    2. Qi Chang & Zhennan Yan & Mu Zhou & Hui Qu & Xiaoxiao He & Han Zhang & Lohendran Baskaran & Subhi Al’Aref & Hongsheng Li & Shaoting Zhang & Dimitris N. Metaxas, 2023. "Mining multi-center heterogeneous medical data with distributed synthetic learning," Nature Communications, Nature, vol. 14(1), pages 1-16, December.
    3. Brandon Theodorou & Cao Xiao & Jimeng Sun, 2023. "Synthesize high-dimensional longitudinal electronic health records via hierarchical autoregressive language model," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    4. Gunjan Chandra & Pekka Siirtola & Satu Tamminen & Mikael J. Knip & Riitta Veijola & Juha Röning, 2022. "Impacts of Data Synthesis: A Metric for Quantifiable Data Standards and Performances," Data, MDPI, vol. 7(12), pages 1-26, December.
    5. James Jackson & Robin Mitra & Brian Francis & Iain Dove, 2022. "Using saturated count models for user‐friendly synthesis of large confidential administrative databases," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 185(4), pages 1613-1643, October.
    6. Severin Elvatun & Daan Knoors & Simon Brant & Christian Jonasson & Jan F Nygård, 2025. "Synthetic data as external control arms in scarce single-arm clinical trials," PLOS Digital Health, Public Library of Science, vol. 4(1), pages 1-13, January.
    7. Daiho Uhm & Sunghae Jun, 2022. "Zero-Inflated Patent Data Analysis Using Generating Synthetic Samples," Future Internet, MDPI, vol. 14(7), pages 1-11, July.
    8. Felix Ritchie & Jim Smith, 2019. "Confidentiality and linked data," Papers 1907.06465, arXiv.org.
    9. Fabian Sven Karst & Mahei Manhai Li & Jan Marco Leimeister, 2025. "SynDEc: A Synthetic Data Ecosystem," Electronic Markets, Springer;IIM University of St. Gallen, vol. 35(1), pages 1-28, December.
    10. Joshua Snoke & Gillian M. Raab & Beata Nowok & Chris Dibben & Aleksandra Slavkovic, 2018. "General and specific utility measures for synthetic data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(3), pages 663-688, June.
    11. Wesley J. Marrero & Mariel S. Lavieri & Jeremy B. Sussman, 2021. "Optimal cholesterol treatment plans and genetic testing strategies for cardiovascular diseases," Health Care Management Science, Springer, vol. 24(1), pages 1-25, March.
    12. Jahangir Alam M. & Dostie Benoit & Drechsler Jörg & Vilhuber Lars, 2020. "Applying data synthesis for longitudinal business data across three countries," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 212-236, August.
    13. Erik D. Mueller & J. S. Onésimo Sandoval & Srikanth P. Mudigonda & Michael Elliott, 2019. "Extending cluster-based ensemble learning through synthetic population generation for modeling disparities in health insurance coverage across Missouri," Journal of Computational Social Science, Springer, vol. 2(2), pages 271-291, July.
    14. Asunur Cezar & Srinivasan Raghunathan & Sumit Sarkar, 2020. "Adversarial Classification: Impact of Agents’ Faking Cost on Firms and Agents," Production and Operations Management, Production and Operations Management Society, vol. 29(12), pages 2789-2807, December.
    15. Mayana Pereira & Meghana Kshirsagar & Sumit Mukherjee & Rahul Dodhia & Juan Lavista Ferres & Rafael de Sousa, 2024. "Assessment of differentially private synthetic data for utility and fairness in end-to-end machine learning pipelines for tabular data," PLOS ONE, Public Library of Science, vol. 19(2), pages 1-24, February.
    16. Speidel, Matthias & Drechsler, Jörg & Jolani, Shahab, 2018. "R package hmi: a convenient tool for hierarchical multiple imputation and beyond," IAB-Discussion Paper 201816, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    17. Soumya Mukherjee & Aratrika Mustafi & Aleksandra Slavkovic & Lars Vilhuber, 2024. "Improving Privacy for Respondents in Randomized Controlled Trials: A Differential Privacy Approach," NBER Chapters, in: Data Privacy Protection and the Conduct of Applied Research: Methods, Approaches and their Consequences, National Bureau of Economic Research, Inc.
    18. Lau Lilleholt & Ingo Zettler & Cornelia Betsch & Robert Böhm, 2023. "Development and validation of the pandemic fatigue scale," Nature Communications, Nature, vol. 14(1), pages 1-19, December.
    19. Stefan Wimmer & Robert Finger, 2023. "A note on synthetic data for replication purposes in agricultural economics," Journal of Agricultural Economics, Wiley Blackwell, vol. 74(1), pages 316-323, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0283094. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.