IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v226y2022ics0951832022003015.html
   My bibliography  Save this article

A novel procedure to evaluate the performance of failure assessment models

Author

Listed:
  • Lingyun, Guo
  • Markus, Niffenegger
  • Jing, Zhou

Abstract

The quantification for overall performance of failure assessment models (FAM) is a challenging task. In the first part of this paper, we propose a novel procedure to evaluate FAM's overall performance based on reliability engineering and system safety. This procedure is composed of three parts: 1. proposing the evaluation index system for FAM's performance based on the uncertainty of Prediction Accuracy (PA); 2. calculating the FAM's overall performance scores, which contains three steps: determining the weights of the criteria in the evaluation index system; calculating the decision matrix for different FAMs; and computing FAM's overall performance; 3. analyzing the evaluation results to give recommendations. In the second part of this paper, we demonstrate the application of the novel procedure to evaluate the performance of 9 FAMs for the integrity assessment of pipes containing axial-oriented part-through cracks on the outer surface. This evaluation is based on 250 well-documented pipe burst experiments. The results show that: R6-Option 2A-local solution (2016) gives the best overall prediction. In addition, different Multi-Criteria Decision Making (MCDM) methods have different focuses. VIKOR and TOPSIS are more considering the impact of high weight criteria, especially VIKOR. SWM and PROMETHEE II care more about FAM's overall performance.

Suggested Citation

  • Lingyun, Guo & Markus, Niffenegger & Jing, Zhou, 2022. "A novel procedure to evaluate the performance of failure assessment models," Reliability Engineering and System Safety, Elsevier, vol. 226(C).
    • Handle: RePEc:eee:reensy:v:226:y:2022:i:c:s0951832022003015
    DOI: 10.1016/j.ress.2022.108667
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832022003015
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2022.108667?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Su, Yue & Li, Jingfa & Yu, Bo & Zhao, Yanlin & Yao, Jun, 2021. "Fast and accurate prediction of failure pressure of oil and gas defective pipelines using the deep learning model," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    2. Lin, Song-Shun & Shen, Shui-Long & Zhou, Annan & Xu, Ye-Shuang, 2021. "Novel model for risk identification during karst excavation," Reliability Engineering and System Safety, Elsevier, vol. 209(C).
    3. Nastaran Chitsaz & Ali Azarnivand, 2017. "Water Scarcity Management in Arid Regions Based on an Extended Multiple Criteria Technique," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 31(1), pages 233-250, January.
    4. Székely, Gábor J. & Rizzo, Maria L., 2013. "The distance correlation t-test of independence in high dimension," Journal of Multivariate Analysis, Elsevier, vol. 117(C), pages 193-213.
    5. Kumar, Ravi & Singal, S.K., 2015. "Penstock material selection in small hydropower plants using MADM methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 52(C), pages 240-255.
    6. Abrahamsen, Eirik Bjorheim & Milazzo, Maria Francesca & Selvik, Jon T. & Asche, Frank & Abrahamsen, HÃ¥kon Bjorheim, 2020. "Prioritising investments in safety measures in the chemical industry by using the Analytic Hierarchy Process," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    7. Kheybari, Siamak & Rezaie, Fariba Mahdi & Farazmand, Hadis, 2020. "Analytic network process: An overview of applications," Applied Mathematics and Computation, Elsevier, vol. 367(C).
    8. Zhang, Hewei & Dong, Shaohua & Ling, Jiatong & Zhang, Laibin & Cheang, Brenda, 2020. "A modified method for the safety factor parameter: The use of big data to improve petroleum pipeline reliability assessment," Reliability Engineering and System Safety, Elsevier, vol. 198(C).
    9. Ahmed, Umair & Carpitella, Silvia & Certa, Antonella, 2021. "An integrated methodological approach for optimising complex systems subjected to predictive maintenance," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    10. Yang, Yang & Li, Suzhen & Zhang, Pengcheng, 2022. "Data-driven accident consequence assessment on urban gas pipeline network based on machine learning," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    11. J. P. Brans & Ph. Vincke, 1985. "Note---A Preference Ranking Organisation Method," Management Science, INFORMS, vol. 31(6), pages 647-656, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Zhanfeng & Li, Xuyao & Wang, Wen & Li, Yan & Shi, Lei & Li, Yuxing, 2023. "Residual strength prediction of corroded pipelines using multilayer perceptron and modified feedforward neural network," Reliability Engineering and System Safety, Elsevier, vol. 231(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Qiongfang & Xu, Nan & Ersoy, Daniel & Liu, Yongming, 2022. "Manifold-based Conditional Bayesian network for aging pipe yield strength estimation with non-destructive measurements," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    2. Yin, Yuanbo & Yang, Hao & Duan, Pengfei & Li, Luling & Zio, Enrico & Liu, Cuiwei & Li, Yuxing, 2022. "Improved quantitative risk assessment of a natural gas pipeline considering high-consequence areas," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    3. Li, Bo & Zhang, Qiling & Yang, Shengmei & Tian, Yaling & Li, Zhi, 2023. "Identification of failure modes and paths of reservoir dams under explosion loads," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    4. Zhou, Jie & Lin, Haifei & Li, Shugang & Jin, Hongwei & Zhao, Bo & Liu, Shihao, 2023. "Leakage diagnosis and localization of the gas extraction pipeline based on SA-PSO BP neural network," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    5. Jiang, Yanping & Liang, Xia & Liang, Haiming & Yang, Ningman, 2018. "Multiple criteria decision making with interval stochastic variables: A method based on interval stochastic dominance," European Journal of Operational Research, Elsevier, vol. 271(2), pages 632-643.
    6. Lin, Sheng-Hau & Zhao, Xiaofeng & Wu, Jiuxing & Liang, Fachao & Li, Jia-Hsuan & Lai, Ren-Ji & Hsieh, Jing-Chzi & Tzeng, Gwo-Hshiung, 2021. "An evaluation framework for developing green infrastructure by using a new hybrid multiple attribute decision-making model for promoting environmental sustainability," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    7. Wu, Jiansong & Zhang, Linlin & Bai, Yiping & Reniers, Genserik, 2022. "A safety investment optimization model for power grid enterprises based on System Dynamics and Bayesian network theory," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    8. Pablo Aragonés‐Beltrán & Mª. Carmen González‐Cruz & Astrid León‐Camargo & Rosario Viñoles‐Cebolla, 2023. "Assessment of regional development needs according to criteria based on the Sustainable Development Goals in the Meta Region (Colombia)," Sustainable Development, John Wiley & Sons, Ltd., vol. 31(2), pages 1101-1121, April.
    9. Juliana Martins Ruzante & Valerie J. Davidson & Julie Caswell & Aamir Fazil & John A. L. Cranfield & Spencer J. Henson & Sven M. Anders & Claudia Schmidt & Jeffrey M. Farber, 2010. "A Multifactorial Risk Prioritization Framework for Foodborne Pathogens," Risk Analysis, John Wiley & Sons, vol. 30(5), pages 724-742, May.
    10. Stanojevic, M. & Vranes, S. & Gökalp, I., 2010. "Green accounting for greener energy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(9), pages 2473-2491, December.
    11. Almoghathawi, Yasser & Barker, Kash & Rocco, Claudio M. & Nicholson, Charles D., 2017. "A multi-criteria decision analysis approach for importance identification and ranking of network components," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 142-151.
    12. Wang, Qun & Jia, Guozhu & Song, Wenyan, 2022. "Identifying critical factors in systems with interrelated components: A method considering heterogeneous influence and strength attenuation," European Journal of Operational Research, Elsevier, vol. 303(1), pages 456-470.
    13. Rauf Ahmad, M., 2019. "A significance test of the RV coefficient in high dimensions," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 116-130.
    14. Lin, Sheng-Hau & Huang, Xianjin & Fu, Guole & Chen, Jia-Tsong & Zhao, Xiaofeng & Li, Jia-Hsuan & Tzeng, Gwo-Hshiung, 2021. "Evaluating the sustainability of urban renewal projects based on a model of hybrid multiple-attribute decision-making," Land Use Policy, Elsevier, vol. 108(C).
    15. Qiang Yang & Ping-an Du & Yong Wang & Bin Liang, 2018. "Developing a rough set based approach for group decision making based on determining weights of decision makers with interval numbers," Operational Research, Springer, vol. 18(3), pages 757-779, October.
    16. Francesco Sica & Francesco Tajani & Maria Rosaria Guarini & Rossana Ranieri, 2023. "A Sensitivity Index to Perform the Territorial Sustainability in Uncertain Decision-Making Conditions," Land, MDPI, vol. 12(2), pages 1-21, February.
    17. Rihab Khemiri & Khaoula Elbedoui-Maktouf & Bernard Grabot & Belhassen Zouari, 2017. "A fuzzy multi-criteria decision making approach for managing performance and risk in integrated procurement-production planning," Post-Print hal-01758604, HAL.
    18. Hyodo, Masashi & Nishiyama, Takahiro & Pavlenko, Tatjana, 2020. "Testing for independence of high-dimensional variables: ρV-coefficient based approach," Journal of Multivariate Analysis, Elsevier, vol. 178(C).
    19. Mohammad Rahman & Lena Jaumann & Nils Lerche & Fabian Renatus & Ann Buchs & Rudolf Gade & Jutta Geldermann & Martin Sauter, 2015. "Selection of the Best Inland Waterway Structure: A Multicriteria Decision Analysis Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 29(8), pages 2733-2749, June.
    20. Martina Kuncova & Jana Seknickova, 2022. "Two-stage weighted PROMETHEE II with results’ visualization," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 30(2), pages 547-571, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:226:y:2022:i:c:s0951832022003015. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.