IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v36y2025i3p1478-1501.html

An Explainable Artificial Intelligence Approach Using Graph Learning to Predict Intensive Care Unit Length of Stay

Author

Listed:
  • Tianjian Guo

    (McCombs School of Business, The University of Texas at Austin, Austin, Texas 78705)

  • Indranil R. Bardhan

    (McCombs School of Business, The University of Texas at Austin, Austin, Texas 78705)

  • Ying Ding

    (School of Information, The University of Texas at Austin, Austin, Texas 78701)

  • Shichang Zhang

    (Harvard Business School, Harvard University, Boston, Massachusetts 02163)

Abstract

Intensive care units (ICUs) are critical for treating severe health conditions but represent significant hospital expenditures. Accurate prediction of ICU length of stay (LoS) can enhance hospital resource management, reduce readmissions, and improve patient care. In recent years, widespread adoption of electronic health records and advancements in artificial intelligence (AI) have facilitated accurate predictions of ICU LoS. However, there is a notable gap in the literature on explainable artificial intelligence (XAI) methods that identify interactions between model input features to predict patient health outcomes. This gap is especially noteworthy as the medical literature suggests that complex interactions between clinical features are likely to significantly impact patient health outcomes. We propose a novel graph learning-based approach that offers state-of-the-art prediction and greater interpretability for ICU LoS prediction. Specifically, our graph-based XAI model can generate interaction-based explanations supported by evidence-based medicine, which provide rich patient-level insights compared with existing XAI methods. We test the statistical significance of our XAI approach using a distance-based separation index and utilize perturbation analyses to examine the sensitivity of our model explanations to changes in input features. Finally, we validate the explanations of our graph learning model using the conceptual evaluation property (Co-12) framework and a small-scale user study of ICU clinicians. Our approach offers interpretable predictions of ICU LoS grounded in design science research, which can facilitate greater integration of AI-enabled decision support systems in clinical workflows, thereby enabling clinicians to derive greater value.

Suggested Citation

  • Tianjian Guo & Indranil R. Bardhan & Ying Ding & Shichang Zhang, 2025. "An Explainable Artificial Intelligence Approach Using Graph Learning to Predict Intensive Care Unit Length of Stay," Information Systems Research, INFORMS, vol. 36(3), pages 1478-1501, September.
  • Handle: RePEc:inm:orisre:v:36:y:2025:i:3:p:1478-1501
    DOI: 10.1287/isre.2023.0029
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2023.0029
    Download Restriction: no

    File URL: https://libkey.io/10.1287/isre.2023.0029?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Arun Rai, 2020. "Explainable AI: from black box to glass box," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 137-141, January.
    2. Karan Singhal & Shekoofeh Azizi & Tao Tu & S. Sara Mahdavi & Jason Wei & Hyung Won Chung & Nathan Scales & Ajay Tanwani & Heather Cole-Lewis & Stephen Pfohl & Perry Payne & Martin Seneviratne & Paul G, 2023. "Publisher Correction: Large language models encode clinical knowledge," Nature, Nature, vol. 620(7973), pages 19-19, August.
    3. Jeong‐ha (Cath) Oh & Zhiqiang (Eric) Zheng & Indranil R. Bardhan, 2018. "Sooner or Later? Health Information Technology, Length of Stay, and Readmission Risk," Production and Operations Management, Production and Operations Management Society, vol. 27(11), pages 2038-2053, November.
    4. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl & Joshua Gawlitza, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Information Systems Research, INFORMS, vol. 32(3), pages 713-735, September.
    5. Kevin Bauer & Moritz von Zahn & Oliver Hinz, 2023. "Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information Processing," Information Systems Research, INFORMS, vol. 34(4), pages 1582-1602, December.
    6. Marc Roubens & Michel Grabisch, 1999. "An axiomatic approach to the concept of interaction among players in cooperative games," International Journal of Game Theory, Springer;Game Theory Society, vol. 28(4), pages 547-565.
    7. repec:dar:wpaper:137446 is not listed on IDEAS
    8. Simon Meyer Lauritsen & Mads Kristensen & Mathias Vassard Olsen & Morten Skaarup Larsen & Katrine Meyer Lauritsen & Marianne Johansson Jørgensen & Jeppe Lange & Bo Thiesson, 2020. "Explainable artificial intelligence model to predict acute critical illness from electronic health records," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    9. Ahmed Abbasi & Jeffrey Parsons & Gautam Pant & Olivia R. Liu Sheng & Suprateek Sarker, 2024. "Pathways for Design Research on Artificial Intelligence," Information Systems Research, INFORMS, vol. 35(2), pages 441-459, June.
    10. Sebastian Bach & Alexander Binder & Grégoire Montavon & Frederick Klauschen & Klaus-Robert Müller & Wojciech Samek, 2015. "On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-46, July.
    11. Kyuhan Lee & Sudha Ram, 2024. "Explainable Deep Learning for False Information Identification: An Argumentation Theory Approach," Information Systems Research, INFORMS, vol. 35(2), pages 890-907, June.
    12. Karan Singhal & Shekoofeh Azizi & Tao Tu & S. Sara Mahdavi & Jason Wei & Hyung Won Chung & Nathan Scales & Ajay Tanwani & Heather Cole-Lewis & Stephen Pfohl & Perry Payne & Martin Seneviratne & Paul G, 2023. "Large language models encode clinical knowledge," Nature, Nature, vol. 620(7972), pages 172-180, August.
    13. Yuanyang Liu & Gautam Pant & Olivia R. L. Sheng, 2020. "Predicting Labor Market Competition: Leveraging Interfirm Network and Employee Skills," Information Systems Research, INFORMS, vol. 31(4), pages 1443-1466, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ahmed Abbasi & Jeffrey Parsons & Gautam Pant & Olivia R. Liu Sheng & Suprateek Sarker, 2024. "Pathways for Design Research on Artificial Intelligence," Information Systems Research, INFORMS, vol. 35(2), pages 441-459, June.
    2. Tian Lu & Yingjie Zhang, 2025. "1 + 1 > 2? Information, Humans, and Machines," Information Systems Research, INFORMS, vol. 36(1), pages 394-418, March.
    3. Femi Olan & Konstantina Spanaki & Wasim Ahmed & Guoqing Zhao, 2025. "Enabling Explainable Artificial Intelligence capabilities in Supply Chain Decision Support Making," Post-Print hal-05018234, HAL.
    4. Maxime Griot & Coralie Hemptinne & Jean Vanderdonckt & Demet Yuksel, 2025. "Large Language Models lack essential metacognition for reliable medical reasoning," Nature Communications, Nature, vol. 16(1), pages 1-10, December.
    5. Ching-Nam Hang & Pei-Duo Yu & Roberto Morabito & Chee-Wei Tan, 2024. "Large Language Models Meet Next-Generation Networking Technologies: A Review," Future Internet, MDPI, vol. 16(10), pages 1-29, October.
    6. Arslon Ruziboev & Dilmurod Turimov & Jiyoun Kim & Wooseong Kim, 2025. "Multiclass Classification of Sarcopenia Severity in Korean Adults Using Machine Learning and Model Fusion Approaches," Mathematics, MDPI, vol. 13(18), pages 1-22, September.
    7. Chao-Chun Hsu & Ziad Obermeyer & Chenhao Tan, 2025. "A machine learning model using clinical notes to identify physician fatigue," Nature Communications, Nature, vol. 16(1), pages 1-10, December.
    8. Ali Nemati & Mohammad Assadi Shalmani & Qiang Lu & Jake Luo, 2025. "Benchmarking Large Language Models from Open and Closed Source Models to Apply Data Annotation for Free-Text Criteria in Healthcare," Future Internet, MDPI, vol. 17(4), pages 1-27, March.
    9. Yang Zhao & Pu Wang & Yibo Zhao & Hongru Du & Hao Frank Yang, 2025. "SafeTraffic Copilot: adapting large language models for trustworthy traffic safety assessments and decision interventions," Nature Communications, Nature, vol. 16(1), pages 1-17, December.
    10. Zhao Shi & Bingqian Wu & Bin Hu & Jian Zhong & Zezhong Li & Fandong Zhang & Zijian Chen & Chun Yang & Bangjun Guo & Qinmei Xu & Huimin Pang & Han Wang & Yueyan Wang & Jinlong Zhao & Jing Xu & Yizhou Y, 2026. "A large language model for clinical outcome adjudication from telephone follow-up interviews: a secondary analysis of a multicenter randomized clinical trial," Nature Communications, Nature, vol. 17(1), pages 1-13, December.
    11. Ofir Ben Shoham & Nadav Rappoport, 2024. "CPLLM: Clinical prediction with large language models," PLOS Digital Health, Public Library of Science, vol. 3(12), pages 1-15, December.
    12. Sheng Wang & Fangyuan Zhao & Dechao Bu & Yunwei Lu & Ming Gong & Hongjie Liu & Zhaohui Yang & Xiaoxi Zeng & Zhiyuan Yuan & Baoping Wan & Jingbo Sun & Yang Wu & Lianhe Zhao & Xirun Wan & Wei Huang & Ta, 2025. "LINS: A general medical Q&A framework for enhancing the quality and credibility of LLM-generated responses," Nature Communications, Nature, vol. 16(1), pages 1-20, December.
    13. Zainab Al-Lataifeh & Mark A. Harris & James Smith & Amita Goyal Chin, 2026. "Generative AI Health Assistants in Modern Healthcare: Drivers and Barriers to Adoption," Information Systems Frontiers, Springer, vol. 28(1), pages 273-296, February.
    14. Aqeel Ahmed Khan1, Bushra Shaheen2, Masroor Ahmed, 2026. "Using Machine Learning and LLM for Classifying of Benign and Malignant Cells from Breast Cancer Dataset," International Journal of Innovations in Science & Technology, 50sea, vol. 8(3), pages 190-202, May.
    15. Venkat Ram Reddy Ganuthula & Krishna Kumar Balaraman, 2025. "The Paradox of Professional Input: How Expert Collaboration with AI Systems Shapes Their Future Value," Papers 2504.12654, arXiv.org.
    16. Cheng-Yi Li & Kao-Jung Chang & Cheng-Fu Yang & Hsin-Yu Wu & Wenting Chen & Hritik Bansal & Ling Chen & Yi-Ping Yang & Yu-Chun Chen & Shih-Pin Chen & Shih-Jen Chen & Jiing-Feng Lirng & Kai-Wei Chang & , 2025. "Towards a holistic framework for multimodal LLM in 3D brain CT radiology report generation," Nature Communications, Nature, vol. 16(1), pages 1-14, December.
    17. Jiamin Yin & Kee Yuan Ngiam & Sharon Swee-Lin Tan & Hock Hai Teo, 2025. "Designing AI-Based Work Processes: How the Timing of AI Advice Affects Diagnostic Decision Making," Management Science, INFORMS, vol. 71(11), pages 9361-9383, November.
    18. Xi Chen & Hanyu Zhou & Huahui Yi & Mingke You & WeiZhi Liu & Li Wang & Ziyuan Qin & Hairui Li & Xue Zhang & Yingman Guo & Songlin Li & Yunan Hu & Qianjiang Xiong & Rongxiao Li & Lei Fan & Qicheng Lao , 2026. "Grounding large language models in clinical diagnostics," Nature Communications, Nature, vol. 17(1), pages 1-19, December.
    19. Erick-Nicolae FURDUESCU, 2025. "Strategic Management Of Llm-Based Chatbots: Transforming Internal Collaboration And Decision-Making In Organizations," Business Excellence and Management, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 15(5), pages 81-91, September.
    20. Kevin Wu & Eric Wu & Kevin Wei & Angela Zhang & Allison Casasola & Teresa Nguyen & Sith Riantawan & Patricia Shi & Daniel Ho & James Zou, 2025. "An automated framework for assessing how well LLMs cite relevant medical references," Nature Communications, Nature, vol. 16(1), pages 1-10, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:36:y:2025:i:3:p:1478-1501. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.