IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0213007.html
   My bibliography  Save this article

Development of an intelligent decision support system for ischemic stroke risk assessment in a population-based electronic health record database

Author

Listed:
  • Chen-Ying Hung
  • Ching-Heng Lin
  • Tsuo-Hung Lan
  • Giia-Sheun Peng
  • Chi-Chun Lee

Abstract

Background: Intelligent decision support systems (IDSS) have been applied to tasks of disease management. Deep neural networks (DNNs) are artificial intelligent techniques to achieve high modeling power. The application of DNNs to large-scale data for estimating stroke risk needs to be assessed and validated. This study aims to apply a DNN for deriving a stroke predictive model using a big electronic health record database. Methods and results: The Taiwan National Health Insurance Research Database was used to conduct a retrospective population-based study. The database was divided into one development dataset for model training (~70% of total patients for training and ~10% for parameter tuning) and two testing datasets (each ~10%). A total of 11,192,916 claim records from 840,487 patients were used. The primary outcome was defined as any ischemic stroke in inpatient records within 3 years after study enrollment. The DNN was evaluated using the area under the receiver operating characteristic curve (AUC or c-statistic). The development dataset included 672,214 patients (a total of 8,952,000 records) of whom 2,060 patients had stroke events. The mean age of the population was 35.5±20.2 years, with 48.5% men. The model achieved AUC values of 0.920 (95% confidence interval [CI], 0.908–0.932) in testing dataset 1 and 0.925 (95% CI, 0.914–0.937) in testing dataset 2. Under a high sensitivity operating point, the sensitivity and specificity were 92.5% and 79.8% for testing dataset 1; 91.8% and 79.9% for testing dataset 2. Under a high specificity operating point, the sensitivity and specificity were 80.3% and 87.5% for testing dataset 1; 83.7% and 87.5% for testing dataset 2. The DNN model maintained high predictability 5 years after being developed. The model achieved similar performance to other clinical risk assessment scores. Conclusions: Using a DNN algorithm on this large electronic health record database is capable of obtaining a high performing model for assessment of ischemic stroke risk. Further research is needed to determine whether such a DNN-based IDSS could lead to an improvement in clinical practice.

Suggested Citation

  • Chen-Ying Hung & Ching-Heng Lin & Tsuo-Hung Lan & Giia-Sheun Peng & Chi-Chun Lee, 2019. "Development of an intelligent decision support system for ischemic stroke risk assessment in a population-based electronic health record database," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-16, March.
    • Handle: RePEc:plo:pone00:0213007
    DOI: 10.1371/journal.pone.0213007
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0213007
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0213007&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0213007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andre Esteva & Brett Kuprel & Roberto A. Novoa & Justin Ko & Susan M. Swetter & Helen M. Blau & Sebastian Thrun, 2017. "Dermatologist-level classification of skin cancer with deep neural networks," Nature, Nature, vol. 542(7639), pages 115-118, February.
    2. Zoubin Ghahramani, 2015. "Probabilistic machine learning and artificial intelligence," Nature, Nature, vol. 521(7553), pages 452-459, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Broekhuizen, Thijs & Dekker, Henri & de Faria, Pedro & Firk, Sebastian & Nguyen, Dinh Khoi & Sofka, Wolfgang, 2023. "AI for managing open innovation: Opportunities, challenges, and a research agenda," Journal of Business Research, Elsevier, vol. 167(C).
    2. Masafumi Nakano & Akihiko Takahashi & Soichiro Takahashi, 2018. "State Space Approach to Adaptive Artificial Intelligence Modeling: Application to Financial Portfolio with Fuzzy System," CARF F-Series CARF-F-422, Center for Advanced Research in Finance, Faculty of Economics, The University of Tokyo.
    3. Wilson, Christopher & van der Velden, Maja, 2022. "Sustainable AI: An integrated model to guide public sector decision-making," Technology in Society, Elsevier, vol. 68(C).
    4. Yi, Jing & Canning, Patrick N. & Ge, Houtian & Rehkamp, Sarah & Gomez, Miguel I., 2023. "A national database of highly perishable fresh produce production with temporal and spatial resolution," 2023 Annual Meeting, July 23-25, Washington D.C. 335590, Agricultural and Applied Economics Association.
    5. Li, Yi & Liu, Kailong & Foley, Aoife M. & Zülke, Alana & Berecibar, Maitane & Nanini-Maury, Elise & Van Mierlo, Joeri & Hoster, Harry E., 2019. "Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 113(C), pages 1-1.
    6. Lin Lu & Laurent Dercle & Binsheng Zhao & Lawrence H. Schwartz, 2021. "Deep learning for the prediction of early on-treatment response in metastatic colorectal cancer from serial medical imaging," Nature Communications, Nature, vol. 12(1), pages 1-11, December.
    7. Zheng Yan & Wenqian Robertson & Yaosheng Lou & Tom W. Robertson & Sung Yong Park, 2021. "Finding leading scholars in mobile phone behavior: a mixed-method analysis of an emerging interdisciplinary field," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9499-9517, December.
    8. Freddy Gabbay & Rotem Lev Aharoni & Ori Schweitzer, 2022. "Deep Neural Network Memory Performance and Throughput Modeling and Simulation Framework," Mathematics, MDPI, vol. 10(21), pages 1-20, November.
    9. Sebastian Gehrmann & Franck Dernoncourt & Yeran Li & Eric T Carlson & Joy T Wu & Jonathan Welt & John Foote Jr. & Edward T Moseley & David W Grant & Patrick D Tyler & Leo A Celi, 2018. "Comparing deep learning and concept extraction based methods for patient phenotyping from clinical narratives," PLOS ONE, Public Library of Science, vol. 13(2), pages 1-19, February.
    10. Kim, Sung Wook & Oh, Ki-Yong & Lee, Seungchul, 2022. "Novel informed deep learning-based prognostics framework for on-board health monitoring of lithium-ion batteries," Applied Energy, Elsevier, vol. 315(C).
    11. Xuequn Wang & Xiaolin Lin & Bin Shao, 2023. "Artificial intelligence changes the way we work: A close look at innovating with chatbots," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(3), pages 339-353, March.
    12. Jungyoon Kim & Jihye Lim, 2021. "A Deep Neural Network-Based Method for Prediction of Dementia Using Big Data," IJERPH, MDPI, vol. 18(10), pages 1-13, May.
    13. Gang Yu & Kai Sun & Chao Xu & Xing-Hua Shi & Chong Wu & Ting Xie & Run-Qi Meng & Xiang-He Meng & Kuan-Song Wang & Hong-Mei Xiao & Hong-Wen Deng, 2021. "Accurate recognition of colorectal cancer with semi-supervised deep learning on pathological images," Nature Communications, Nature, vol. 12(1), pages 1-13, December.
    14. Yue Sun & Songmin Dai & Jide Li & Yin Zhang & Xiaoqiang Li, 2019. "Tooth-Marked Tongue Recognition Using Gradient-Weighted Class Activation Maps," Future Internet, MDPI, vol. 11(2), pages 1-12, February.
    15. DonHee Lee & Seong No Yoon, 2021. "Application of Artificial Intelligence-Based Technologies in the Healthcare Industry: Opportunities and Challenges," IJERPH, MDPI, vol. 18(1), pages 1-18, January.
    16. Wenjuan Fan & Jingnan Liu & Shuwan Zhu & Panos M. Pardalos, 2020. "Investigating the impacting factors for the healthcare professionals to adopt artificial intelligence-based medical diagnosis support system (AIMDSS)," Annals of Operations Research, Springer, vol. 294(1), pages 567-592, November.
    17. Himanshu Sharma & Anu G. Aggarwal, 2022. "Segmenting Reviewers Based on Reviewer and Review Characteristics," International Journal of Business Analytics (IJBAN), IGI Global, vol. 9(1), pages 1-20, January.
    18. Fekadu Agmas Wassie & László Péter Lakatos, 2024. "Artificial intelligence and the future of the internal audit function," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    19. Young Jae Kim & Seung Seog Han & Hee Joo Yang & Sung Eun Chang, 2020. "Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-9, June.
    20. Claus Zippel & Sabine Bohnet-Joschko, 2021. "Rise of Clinical Studies in the Field of Machine Learning: A Review of Data Registered in ClinicalTrials.gov," IJERPH, MDPI, vol. 18(10), pages 1-14, May.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0213007. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.