IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0259864.html
   My bibliography  Save this article

External validation of the PAR-Risk Score to assess potentially avoidable hospital readmission risk in internal medicine patients

Author

Listed:
  • Lukas Higi
  • Angela Lisibach
  • Patrick E Beeler
  • Monika Lutters
  • Anne-Laure Blanc
  • Andrea M Burden
  • Dominik Stämpfli

Abstract

Background: Readmission prediction models have been developed and validated for targeted in-hospital preventive interventions. We aimed to externally validate the Potentially Avoidable Readmission-Risk Score (PAR-Risk Score), a 12-items prediction model for internal medicine patients with a convenient scoring system, for our local patient cohort. Methods: A cohort study using electronic health record data from the internal medicine ward of a Swiss tertiary teaching hospital was conducted. The individual PAR-Risk Score values were calculated for each patient. Univariable logistic regression was used to predict potentially avoidable readmissions (PARs), as identified by the SQLape algorithm. For additional analyses, patients were stratified into low, medium, and high risk according to tertiles based on the PAR-Risk Score. Statistical associations between predictor variables and PAR as outcome were assessed using both univariable and multivariable logistic regression. Results: The final dataset consisted of 5,985 patients. Of these, 340 patients (5.7%) experienced a PAR. The overall PAR-Risk Score showed rather poor discriminatory power (C statistic 0.605, 95%-CI 0.575–0.635). When using stratified groups (low, medium, high), patients in the high-risk group were at statistically significant higher odds (OR 2.63, 95%-CI 1.33–5.18) of being readmitted within 30 days compared to low risk patients. Multivariable logistic regression identified previous admission within six months, anaemia, heart failure, and opioids to be significantly associated with PAR in this patient cohort. Conclusion: This external validation showed a limited overall performance of the PAR-Risk Score, although higher scores were associated with an increased risk for PAR and patients in the high-risk group were at significantly higher odds of being readmitted within 30 days. This study highlights the importance of externally validating prediction models.

Suggested Citation

  • Lukas Higi & Angela Lisibach & Patrick E Beeler & Monika Lutters & Anne-Laure Blanc & Andrea M Burden & Dominik Stämpfli, 2021. "External validation of the PAR-Risk Score to assess potentially avoidable hospital readmission risk in internal medicine patients," PLOS ONE, Public Library of Science, vol. 16(11), pages 1-14, November.
    • Handle: RePEc:plo:pone00:0259864
    DOI: 10.1371/journal.pone.0259864
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0259864
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0259864&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0259864?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Anne-Laure Blanc & Thierry Fumeaux & Jérôme Stirnemann & Elise Dupuis Lozeron & Aimad Ourhamoune & Jules Desmeules & Pierre Chopard & Arnaud Perrier & Nicolas Schaad & Pascal Bonnabry, 2019. "Development of a predictive score for potentially avoidable hospital readmissions for general internal medicine patients," PLOS ONE, Public Library of Science, vol. 14(7), pages 1-16, July.
    2. Grolemund, Garrett & Wickham, Hadley, 2011. "Dates and Times Made Easy with lubridate," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 40(i03).
    3. Karel G M Moons & Joris A H de Groot & Walter Bouwmeester & Yvonne Vergouwe & Susan Mallett & Douglas G Altman & Johannes B Reitsma & Gary S Collins, 2014. "Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies: The CHARMS Checklist," PLOS Medicine, Public Library of Science, vol. 11(10), pages 1-12, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laha, A. K. & Putatunda, Sayan, 2017. "Travel Time Prediction for Taxi-GPS Data Streams," IIMA Working Papers WP 2017-03-03, Indian Institute of Management Ahmedabad, Research and Publication Department.
    2. Santiago Ferrière-Steinert & Joaquín Valenzuela Jiménez & Sebastián Heskia Araya & Thomas Kouyoumdjian & José Ramos-Rojas & Abraham I J Gajardo, 2024. "Early high-sensitivity troponin elevation in predicting short-term mortality in sepsis: A protocol for a systematic review with meta-analysis," PLOS ONE, Public Library of Science, vol. 19(10), pages 1-10, October.
    3. Fraccaroli, Nicolò & Giovannini, Alessandro & Jamet, Jean-François & Persson, Eric, 2022. "Ideology and monetary policy. The role of political parties’ stances in the European Central Bank’s parliamentary hearings," European Journal of Political Economy, Elsevier, vol. 74(C).
    4. Michael A Ruderman & Deirdra F Wilson & Savanna Reid, 2015. "Does Prison Crowding Predict Higher Rates of Substance Use Related Parole Violations? A Recurrent Events Multi-Level Survival Analysis," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-19, October.
    5. Aljoscha Benjamin Hwang & Guido Schuepfer & Mario Pietrini & Stefan Boes, 2021. "External validation of EPIC’s Risk of Unplanned Readmission model, the LACE+ index and SQLape as predictors of unplanned hospital readmissions: A monocentric, retrospective, diagnostic cohort study in," PLOS ONE, Public Library of Science, vol. 16(11), pages 1-33, November.
    6. Jiaxin Li & Zijun Zhou & Jianyu Dong & Ying Fu & Yuan Li & Ze Luan & Xin Peng, 2021. "Predicting breast cancer 5-year survival using machine learning: A systematic review," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-23, April.
    7. Loke Schmalensee & Pauline Caillault & Katrín Hulda Gunnarsdóttir & Karl Gotthard & Philipp Lehmann, 2023. "Seasonal specialization drives divergent population dynamics in two closely related butterflies," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    8. Igor Martins & Hedibert Freitas Lopes, 2024. "What events matter for exchange rate volatility ?," Papers 2411.16244, arXiv.org.
    9. Fangyue Chen & Piyawat Kantagowit & Tanawin Nopsopon & Arisa Chuklin & Krit Pongpirul, 2023. "Prediction and diagnosis of chronic kidney disease development and progression using machine-learning: Protocol for a systematic review and meta-analysis of reporting standards and model performance," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-10, February.
    10. Wanting Zu & Xuemiao Huang & Tianxin Xu & Lin Du & Yiming Wang & Lisheng Wang & Wenbo Nie, 2023. "Machine learning in predicting outcomes for stroke patients following rehabilitation treatment: A systematic review," PLOS ONE, Public Library of Science, vol. 18(6), pages 1-14, June.
    11. Koch, Steven F. & Nkuna, Blessings & Ye, Yuxiang, 2024. "Income elasticity of residential electricity consumption in rural South Africa," Energy Economics, Elsevier, vol. 131(C).
    12. repec:irf:wpaper:010 is not listed on IDEAS
    13. Anna M van Boekel & Siri L van der Meijden & Sesmu M Arbous & Rob G H H Nelissen & Karin E Veldkamp & Emma B Nieswaag & Kim F T Jochems & Jeroen Holtz & Annekee van IJlzinga Veenstra & Jeroen Reijman , 2024. "Systematic evaluation of machine learning models for postoperative surgical site infection prediction," PLOS ONE, Public Library of Science, vol. 19(12), pages 1-17, December.
    14. Verena K. Brändle & Olga Eisele, 2023. "A Thin Line: Governmental Border Communication in Times of European Crises," Journal of Common Market Studies, Wiley Blackwell, vol. 61(3), pages 597-615, May.
    15. Fazel, Seena & Burghart, Matthias & Fanshawe, Thomas & Gil, Sharon Danielle & Monahan, John & Yu, Rongqin, 2022. "The predictive performance of criminal risk assessment tools used at sentencing: Systematic review of validation studies," Journal of Criminal Justice, Elsevier, vol. 81(C).
    16. Fisaha Haile Tesfay & Kathryn Backholer & Christina Zorbas & Steven J. Bowe & Laura Alston & Catherine M. Bennett, 2022. "The Magnitude of NCD Risk Factors in Ethiopia: Meta-Analysis and Systematic Review of Evidence," IJERPH, MDPI, vol. 19(9), pages 1-19, April.
    17. Haider, Saira M. & Benscoter, Allison M. & Pearlstine, Leonard & D'Acunto, Laura E. & Romañach, Stephanie S., 2021. "Landscape-scale drivers of endangered Cape Sable Seaside Sparrow (Ammospiza maritima mirabilis) presence using an ensemble modeling approach," Ecological Modelling, Elsevier, vol. 461(C).
    18. Nicholas Tierney & Dianne Cook, 2018. "Expanding tidy data principles to facilitate missing data exploration, visualization and assessment of imputations," Monash Econometrics and Business Statistics Working Papers 14/18, Monash University, Department of Econometrics and Business Statistics.
    19. Shamil D. Cooray & Lihini A. Wijeyaratne & Georgia Soldatos & John Allotey & Jacqueline A. Boyle & Helena J. Teede, 2020. "The Unrealised Potential for Predicting Pregnancy Complications in Women with Gestational Diabetes: A Systematic Review and Critical Appraisal," IJERPH, MDPI, vol. 17(9), pages 1-20, April.
    20. Helder Novais Bastos & Nuno S Osório & António Gil Castro & Angélica Ramos & Teresa Carvalho & Leonor Meira & David Araújo & Leonor Almeida & Rita Boaventura & Patrícia Fragata & Catarina Chaves & Pat, 2016. "A Prediction Rule to Stratify Mortality Risk of Patients with Pulmonary Tuberculosis," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-14, September.
    21. Gregory Eady & Tom Paskhalis & Jan Zilinsky & Richard Bonneau & Jonathan Nagler & Joshua A. Tucker, 2023. "Exposure to the Russian Internet Research Agency foreign influence campaign on Twitter in the 2016 US election and its relationship to attitudes and voting behavior," Nature Communications, Nature, vol. 14(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0259864. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.