IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v200y2020ics0951832019308580.html
   My bibliography  Save this article

Accident Prediction Accuracy Assessment for Highway-Rail Grade Crossings Using Random Forest Algorithm Compared with Decision Tree

Author

Listed:
  • Zhou, Xiaoyi
  • Lu, Pan
  • Zheng, Zijian
  • Tolliver, Denver
  • Keramati, Amin

Abstract

Safety is a major concern of transportation planners and engineers in their design of highway rail grade crossings (HRGCs). Safety agencies rely on prediction models to allocate their crossing safety improvement resources. The prediction accuracy performance of those models is under-researched. This paper performs model forecasting accuracy comparison analysis for a proposed random forest method. Compared with the decision tree, the random forest method is capable of improving unbalanced data forecasting performance because of its bootstrap characteristic, which is a common resampling method to handle imbalanced data. Data imbalance is frequently encountered in safety analysis, where the use of inadequate performance metrics, such as accuracy, and specificity, will lead to overestimated generalization results. That is because the model/classifiers tend to predict the dominant class, non-crash class, in the area of safety analysis. The proposed random forest method is evaluated by various prediction performance measurements and compared with the decision tree. Results show that the random forest method dramatically improves the prediction accuracy without providing additional false negative predictions or false positive predictions which are known as false alarms.

Suggested Citation

  • Zhou, Xiaoyi & Lu, Pan & Zheng, Zijian & Tolliver, Denver & Keramati, Amin, 2020. "Accident Prediction Accuracy Assessment for Highway-Rail Grade Crossings Using Random Forest Algorithm Compared with Decision Tree," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
  • Handle: RePEc:eee:reensy:v:200:y:2020:i:c:s0951832019308580
    DOI: 10.1016/j.ress.2020.106931
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832019308580
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2020.106931?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wei, Pengfei & Lu, Zhenzhou & Song, Jingwen, 2015. "Variable importance analysis: A comprehensive review," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 399-432.
    2. Kabir, Elnaz & Guikema, Seth & Kane, Brian, 2018. "Statistical modeling of tree failures during storms," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 68-79.
    3. Gehl, Pierre & Cavalieri, Francesco & Franchin, Paolo, 2018. "Approximate Bayesian network formulation for the rapid loss assessment of real-world infrastructure systems," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 80-93.
    4. Sabri Boughorbel & Fethi Jarray & Mohammed El-Anbari, 2017. "Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-17, June.
    5. Rachman, Andika & Ratnayake, R.M. Chandima, 2019. "Machine learning approach for risk-based inspection screening assessment," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 518-532.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Simsekler, Mecit Can Emre & Qazi, Abroon & Alalami, Mohammad Amjad & Ellahham, Samer & Ozonoff, Al, 2020. "Evaluation of patient safety culture using a random forest algorithm," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    2. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    3. Cheng, Jin & Wang, Jian & Wu, Xuezhou & Wang, Shuo, 2019. "An improved polynomial-based nonlinear variable importance measure and its application to degradation assessment for high-voltage transformer under imbalance data," Reliability Engineering and System Safety, Elsevier, vol. 185(C), pages 175-191.
    4. Asma Shaheen & Javed Iqbal, 2018. "Spatial Distribution and Mobility Assessment of Carcinogenic Heavy Metals in Soil Profiles Using Geostatistics and Random Forest, Boruta Algorithm," Sustainability, MDPI, vol. 10(3), pages 1-20, March.
    5. Matteo Rucco & Giovanna Viticchi & Lorenzo Falsetti, 2020. "Towards Personalized Diagnosis of Glioblastoma in Fluid-Attenuated Inversion Recovery (FLAIR) by Topological Interpretable Machine Learning," Mathematics, MDPI, vol. 8(5), pages 1-27, May.
    6. Yun, Wanying & Lu, Zhenzhou & Feng, Kaixuan & Li, Luyi, 2019. "An elaborate algorithm for analyzing the Borgonovo moment-independent sensitivity by replacing the probability density function estimation with the probability estimation," Reliability Engineering and System Safety, Elsevier, vol. 189(C), pages 99-108.
    7. Mohamed Zine & Fouzi Harrou & Mohammed Terbeche & Mohammed Bellahcene & Abdelkader Dairi & Ying Sun, 2023. "E-Learning Readiness Assessment Using Machine Learning Methods," Sustainability, MDPI, vol. 15(11), pages 1-22, June.
    8. Campari, Alessandro & Ustolin, Federico & Alvaro, Antonio & Paltrinieri, Nicola, 2024. "Inspection of hydrogen transport equipment: A data-driven approach to predict fatigue degradation," Reliability Engineering and System Safety, Elsevier, vol. 251(C).
    9. Cheng, Kai & Lu, Zhenzhou, 2018. "Sparse polynomial chaos expansion based on D-MORPH regression," Applied Mathematics and Computation, Elsevier, vol. 323(C), pages 17-30.
    10. Wenxuan Wang & Hangshan Gao & Pengfei Wei & Changcong Zhou, 2017. "Extending first-passage method to reliability sensitivity analysis of motion mechanisms," Journal of Risk and Reliability, , vol. 231(5), pages 573-586, October.
    11. Masayoshi Mase & Art B. Owen & Benjamin B. Seiler, 2022. "Variable importance without impossible data," Papers 2205.15750, arXiv.org, revised Apr 2023.
    12. Hou, Tianfeng & Nuyens, Dirk & Roels, Staf & Janssen, Hans, 2019. "Quasi-Monte Carlo based uncertainty analysis: Sampling efficiency and error estimation in engineering applications," Reliability Engineering and System Safety, Elsevier, vol. 191(C).
    13. Christian Kauten & Ashish Gupta & Xiao Qin & Glenn Richey, 2022. "Predicting Blood Donors Using Machine Learning Techniques," Information Systems Frontiers, Springer, vol. 24(5), pages 1547-1562, October.
    14. Zaitseva, Elena & Levashenko, Vitaly & Rabcan, Jan, 2023. "A new method for analysis of Multi-State systems based on Multi-valued decision diagram under epistemic uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    15. McFarland, John & DeCarlo, Erin, 2020. "A Monte Carlo framework for probabilistic analysis and variance decomposition with distribution parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    16. Mi, Jinhua & Beer, Michael & Li, Yan-Feng & Broggi, Matteo & Cheng, Yuhua, 2020. "Reliability and importance analysis of uncertain system with common cause failures based on survival signature," Reliability Engineering and System Safety, Elsevier, vol. 201(C).
    17. Ehre, Max & Papaioannou, Iason & Straub, Daniel, 2020. "Global sensitivity analysis in high dimensions with PLS-PCE," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    18. Ye Zheng & Yazhou Xie & Xuejiao Long, 2021. "A comprehensive review of Bayesian statistics in natural hazards engineering," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 108(1), pages 63-91, August.
    19. Matthias Bogaert & Michel Ballings & Martijn Hosten & Dirk Van den Poel, 2017. "Identifying Soccer Players on Facebook Through Predictive Analytics," Decision Analysis, INFORMS, vol. 14(4), pages 274-297, December.
    20. David Cemernek & Sandra Cemernek & Heimo Gursch & Ashwini Pandeshwar & Thomas Leitner & Matthias Berger & Gerald Klösch & Roman Kern, 2022. "Machine learning in continuous casting of steel: a state-of-the-art survey," Journal of Intelligent Manufacturing, Springer, vol. 33(6), pages 1561-1579, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:200:y:2020:i:c:s0951832019308580. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.