IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v204y2020ics0951832020306876.html
   My bibliography  Save this article

Evaluation of patient safety culture using a random forest algorithm

Author

Listed:
  • Simsekler, Mecit Can Emre
  • Qazi, Abroon
  • Alalami, Mohammad Amjad
  • Ellahham, Samer
  • Ozonoff, Al

Abstract

Safety culture is a multidimensional concept that may be associated with medical errors and patient safety events in healthcare delivery systems. However, limited evidence is available regarding which safety culture dimensions drive overall patient safety. Moreover, the use of advanced statistical analysis has been limited in past studies of safety culture data. To address these issues, we use hospital-level aggregate survey data from U.S. hospitals to analyze the relationship between the defined safety culture dimensions and the patient safety grade. We use a tree-based machine learning algorithm, random forests, to estimate accurate and stable associations. The results of our analysis show that safety perception, management support, and supervisor/manager expectations are the leading drivers of patient safety grade. More specifically, safety problems in the work unit and work climate provided by hospital management are specific drivers of patient safety outcomes. The random forest model sheds new light on the most important cultural features relevant to patient safety.

Suggested Citation

  • Simsekler, Mecit Can Emre & Qazi, Abroon & Alalami, Mohammad Amjad & Ellahham, Samer & Ozonoff, Al, 2020. "Evaluation of patient safety culture using a random forest algorithm," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
  • Handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306876
    DOI: 10.1016/j.ress.2020.107186
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832020306876
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2020.107186?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marleen Smits & Cordula Wagner & Peter Spreeuwenberg & Danielle RM Timmermans & Gerrit van der Wal & Peter P Groenewegen, 2012. "The role of patient safety culture in the causation of unintended events in hospitals," Journal of Clinical Nursing, John Wiley & Sons, vol. 21(23-24), pages 3392-3401, December.
    2. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    3. Provan, David J. & Woods, David D. & Dekker, Sidney W.A. & Rae, Andrew J., 2020. "Safety II professionals: How resilience engineering can transform safety practice," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    4. Leveson, Nancy, 2015. "A systems approach to risk management through leading safety indicators," Reliability Engineering and System Safety, Elsevier, vol. 136(C), pages 17-34.
    5. Kabir, Elnaz & Guikema, Seth & Kane, Brian, 2018. "Statistical modeling of tree failures during storms," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 68-79.
    6. Frank Giarratani & Geoffrey J.D. Hewings & Philip McCann (ed.), 2013. "Handbook of Industry Studies and Economic Geography," Books, Edward Elgar Publishing, number 3542.
    7. Storlie, Curtis B. & Swiler, Laura P. & Helton, Jon C. & Sallaberry, Cedric J., 2009. "Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models," Reliability Engineering and System Safety, Elsevier, vol. 94(11), pages 1735-1763.
    8. Mengolini, A. & Debarberis, L., 2007. "Safety culture enhancement through the implementation of IAEA guidelines," Reliability Engineering and System Safety, Elsevier, vol. 92(4), pages 520-529.
    9. de Boer, Angela G. E. M. & Wijker, Wouter & de Haes, Hanneke C. J. M., 1997. "Predictors of health care utilization in the chronically ill: a review of the literature," Health Policy, Elsevier, vol. 42(2), pages 101-115, November.
    10. Erman Çakıt & Andrzej Jan Olak & Atsuo Murata & Waldemar Karwowski & Omar Alrehaili & Tadeusz Marek, 2019. "Assessment of the perceived safety culture in the petrochemical industry in Japan: A cross-sectional study," PLOS ONE, Public Library of Science, vol. 14(12), pages 1-18, December.
    11. Stroeve, Sybert H. & Sharpanskykh, Alexei & Kirwan, Barry, 2011. "Agent-based organizational modelling for analysis of safety culture at an air navigation service provider," Reliability Engineering and System Safety, Elsevier, vol. 96(5), pages 515-533.
    12. Novak, Jeremy & Farr-Wharton, Ben & Brunetto, Yvonne & Shacklock, Kate & Brown, Kerry, 2017. "Safety outcomes for engineering asset management organizations: Old problem with new solutions?," Reliability Engineering and System Safety, Elsevier, vol. 160(C), pages 67-73.
    13. Rachman, Andika & Ratnayake, R.M. Chandima, 2019. "Machine learning approach for risk-based inspection screening assessment," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 518-532.
    14. Sujan, Mark A., 2012. "A novel tool for organisational learning and its impact on safety culture in a hospital dispensary," Reliability Engineering and System Safety, Elsevier, vol. 101(C), pages 21-34.
    15. Oedewald, Pia & Gotcheva, Nadezhda, 2015. "Safety culture and subcontractor network governance in a complex safety critical project," Reliability Engineering and System Safety, Elsevier, vol. 141(C), pages 106-114.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. de Araujo, Matheus Soares & da Silva, Leandro Dias & Sobrinho, Ã lvaro & Cunha, Paulo & Montecchi, Leonardo, 2022. "Reliability analysis of multi-parameter monitoring systems for Intensive Care Units," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    2. Senthil Kumar Jagatheesaperumal & Snegha Rajkumar & Joshinika Venkatesh Suresh & Abdu H. Gumaei & Noura Alhakbani & Md. Zia Uddin & Mohammad Mehedi Hassan, 2023. "An IoT-Based Framework for Personalized Health Assessment and Recommendations Using Machine Learning," Mathematics, MDPI, vol. 11(12), pages 1-21, June.
    3. Sumaya Almaazmi & Mecit Can Emre Simsekler & Andreas Henschel & Abroon Qazi & Dounia Marbouh & Rana Adel Mahmoud Ali Luqman, 2023. "Evaluating Drivers of the Patient Experience Triangle: Stress, Anxiety, and Frustration," IJERPH, MDPI, vol. 20(7), pages 1-13, April.
    4. Ortiz-Barrios, Miguel & Arias-Fonseca, Sebastián & Ishizaka, Alessio & Barbati, Maria & Avendaño-Collante, Betty & Navarro-Jiménez, Eduardo, 2023. "Artificial intelligence and discrete-event simulation for capacity management of intensive care units during the Covid-19 pandemic: A case study," Journal of Business Research, Elsevier, vol. 160(C).
    5. Mahmoud, Hussam & Kirsch, Thomas & O'Neil, Dan & Anderson, Shelby, 2023. "The resilience of health care systems following major disruptive events: Current practice and a path forward," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    6. Ching-Hsue Cheng & Ming-Chi Tsai, 2022. "An Intelligent Homogeneous Model Based on an Enhanced Weighted Kernel Self-Organizing Map for Forecasting House Prices," Land, MDPI, vol. 11(8), pages 1-17, July.
    7. Simsekler, Mecit Can Emre & Rodrigues, Clarence & Qazi, Abroon & Ellahham, Samer & Ozonoff, Al, 2021. "A comparative study of patient and staff safety evaluation using tree-based machine learning algorithms," Reliability Engineering and System Safety, Elsevier, vol. 208(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Xiaoyi & Lu, Pan & Zheng, Zijian & Tolliver, Denver & Keramati, Amin, 2020. "Accident Prediction Accuracy Assessment for Highway-Rail Grade Crossings Using Random Forest Algorithm Compared with Decision Tree," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
    2. Simsekler, Mecit Can Emre & Rodrigues, Clarence & Qazi, Abroon & Ellahham, Samer & Ozonoff, Al, 2021. "A comparative study of patient and staff safety evaluation using tree-based machine learning algorithms," Reliability Engineering and System Safety, Elsevier, vol. 208(C).
    3. Helton, Jon C. & Brooks, Dusty M. & Sallaberry, Cédric J., 2020. "Margins associated with loss of assured safety for systems with multiple weak links and strong links," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    4. Wei, Pengfei & Liu, Fuchao & Tang, Chenghu, 2018. "Reliability and reliability-based importance analysis of structural systems using multiple response Gaussian process model," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 183-195.
    5. Chabridon, Vincent & Balesdent, Mathieu & Bourinet, Jean-Marc & Morio, Jérôme & Gayton, Nicolas, 2018. "Reliability-based sensitivity estimators of rare event probability in the presence of distribution parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 178(C), pages 164-178.
    6. Elmar Plischke & Emanuele Borgonovo, 2020. "Fighting the Curse of Sparsity: Probabilistic Sensitivity Measures From Cumulative Distribution Functions," Risk Analysis, John Wiley & Sons, vol. 40(12), pages 2639-2660, December.
    7. Tatsuya Sakurahara & Seyed Reihani & Ernie Kee & Zahra Mohaghegh, 2020. "Global importance measure methodology for integrated probabilistic risk assessment," Journal of Risk and Reliability, , vol. 234(2), pages 377-396, April.
    8. Kim, Taeyong & Song, Junho, 2018. "Generalized Reliability Importance Measure (GRIM) using Gaussian mixture," Reliability Engineering and System Safety, Elsevier, vol. 173(C), pages 105-115.
    9. Helton, Jon C. & Johnson, Jay D. & Sallaberry, Cédric J., 2011. "Quantification of margins and uncertainties: Example analyses from reactor safety and radioactive waste disposal involving the separation of aleatory and epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 96(9), pages 1014-1033.
    10. S. Cucurachi & E. Borgonovo & R. Heijungs, 2016. "A Protocol for the Global Sensitivity Analysis of Impact Assessment Models in Life Cycle Assessment," Risk Analysis, John Wiley & Sons, vol. 36(2), pages 357-377, February.
    11. Carlino, Gerald & Kerr, William R., 2015. "Agglomeration and Innovation," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 349-404, Elsevier.
    12. Asma Shaheen & Javed Iqbal, 2018. "Spatial Distribution and Mobility Assessment of Carcinogenic Heavy Metals in Soil Profiles Using Geostatistics and Random Forest, Boruta Algorithm," Sustainability, MDPI, vol. 10(3), pages 1-20, March.
    13. Matieyendou Lamboni, 2020. "Uncertainty quantification: a minimum variance unbiased (joint) estimator of the non-normalized Sobol’ indices," Statistical Papers, Springer, vol. 61(5), pages 1939-1970, October.
    14. Chen, Chao & Yang, Ming & Reniers, Genserik, 2021. "A dynamic stochastic methodology for quantifying HAZMAT storage resilience," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    15. Tian, Wei & Song, Jitian & Li, Zhanyong & de Wilde, Pieter, 2014. "Bootstrap techniques for sensitivity analysis and model selection in building thermal performance analysis," Applied Energy, Elsevier, vol. 135(C), pages 320-328.
    16. Khastgir, Siddartha & Brewerton, Simon & Thomas, John & Jennings, Paul, 2021. "Systems Approach to Creating Test Scenarios for Automated Driving Systems," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    17. Shang, Xiaobing & Su, Li & Fang, Hai & Zeng, Bowen & Zhang, Zhi, 2023. "An efficient multi-fidelity Kriging surrogate model-based method for global sensitivity analysis," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    18. Matteo Rucco & Giovanna Viticchi & Lorenzo Falsetti, 2020. "Towards Personalized Diagnosis of Glioblastoma in Fluid-Attenuated Inversion Recovery (FLAIR) by Topological Interpretable Machine Learning," Mathematics, MDPI, vol. 8(5), pages 1-27, May.
    19. Wang, Tianzhe & Chen, Zequan & Li, Guofa & He, Jialong & Liu, Chao & Du, Xuejiao, 2024. "A novel method for high-dimensional reliability analysis based on activity score and adaptive Kriging," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    20. Tianyang Wang & James S. Dyer & Warren J. Hahn, 2017. "Sensitivity analysis of decision making under dependent uncertainties using copulas," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 5(1), pages 117-139, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306876. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.