IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v186y2019icp24-36.html
   My bibliography  Save this article

Comparison of automatic and guided learning for Bayesian networks to analyse pipe failures in the water distribution system

Author

Listed:
  • Tang, Kayu
  • Parsons, David J.
  • Jude, Simon

Abstract

The reliability of the water distribution system is critical to maintaining a secure supply for the population, industry and agriculture, so there is a need for proactive maintenance to help reduce water loss and down times. Bayesian networks are one approach to modelling the complexity of water mains, to assist water utility companies in planning maintenance. This paper compares and analyses how accurately the Bayesian network structure can be derived given a large and highly variable dataset. Method one involved using automated learning algorithms to build the Bayesian network, while method two involved a guided method using a combination of historic failure data, prior knowledge and pre-modelling data exploration of the water mains. By understanding common failure types (circumferential, longitudinal, pinhole and joint), the guided learning Bayesian Network was able to capture the interactions of the surrounding soil environment with the physical properties of pipes. The Bayesian network built using data exploration and literature was able to achieve an overall accuracy of 81.2% when predicting the specific type of water mains failure compared to the 84.4% for the automated method. The slightly greater accuracy from the automated method was traded for a sparser Bayes net where the interpretation of the interactions between the variables was clearer and more meaningful.

Suggested Citation

  • Tang, Kayu & Parsons, David J. & Jude, Simon, 2019. "Comparison of automatic and guided learning for Bayesian networks to analyse pipe failures in the water distribution system," Reliability Engineering and System Safety, Elsevier, vol. 186(C), pages 24-36.
    • Handle: RePEc:eee:reensy:v:186:y:2019:i:c:p:24-36
    DOI: 10.1016/j.ress.2019.02.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832017309377
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2019.02.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kabir, Golam & Tesfamariam, Solomon & Sadiq, Rehan, 2015. "Predicting water main failures using Bayesian model averaging and survival modelling approach," Reliability Engineering and System Safety, Elsevier, vol. 142(C), pages 498-514.
    2. Francis, Royce A. & Guikema, Seth D. & Henneman, Lucas, 2014. "Bayesian Belief Networks for predicting drinking water distribution system pipe breaks," Reliability Engineering and System Safety, Elsevier, vol. 130(C), pages 1-11.
    3. Kuhn, Max, 2008. "Building Predictive Models in R Using the caret Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i05).
    4. M. Islam & Rehan Sadiq & Manuel Rodriguez & Homayoun Najjaran & Alex Francisque & Mina Hoorfar, 2013. "Evaluating Water Quality Failure Potential in Water Distribution Systems: A Fuzzy-TOPSIS-OWA-based Methodology," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 27(7), pages 2195-2216, May.
    5. Scutari, Marco, 2010. "Learning Bayesian Networks with the bnlearn R Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 35(i03).
    6. Mingfeng Lin & Henry C. Lucas & Galit Shmueli, 2013. "Research Commentary ---Too Big to Fail: Large Samples and the p -Value Problem," Information Systems Research, INFORMS, vol. 24(4), pages 906-917, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jia, Rui & Du, Kun & Song, Zhigang & Xu, Wei & Zheng, Feifei, 2024. "Scenario reduction-based simulation method for efficient serviceability assessment of earthquake-damaged water distribution systems," Reliability Engineering and System Safety, Elsevier, vol. 246(C).
    2. Li, Xiaoyue & Yang, Yinfei & Li, Liang & Zhao, Guolong & He, Ning, 2020. "Uncertainty quantification in machining deformation based on Bayesian network," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    3. Xu, Zhaoyi & Saleh, Joseph Homer, 2021. "Machine learning for reliability engineering and safety applications: Review of current status and future opportunities," Reliability Engineering and System Safety, Elsevier, vol. 211(C).
    4. Fan, Xudong & Wang, Xiaowei & Zhang, Xijin & ASCE Xiong (Bill) Yu, P.E.F., 2022. "Machine learning based water pipe failure prediction: The effects of engineering, geology, climate and socio-economic factors," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    5. Dawid Szpak, 2020. "Method for Determining the Probability of a Lack of Water Supply to Consumers," Energies, MDPI, vol. 13(20), pages 1-16, October.
    6. Wu, Jiansong & Bai, Yiping & Fang, Weipeng & Zhou, Rui & Reniers, Genserik & Khakzad, Nima, 2021. "An Integrated Quantitative Risk Assessment Method for Urban Underground Utility Tunnels," Reliability Engineering and System Safety, Elsevier, vol. 213(C).
    7. Robles-Velasco, Alicia & Cortés, Pablo & Muñuzuri, Jesús & Onieva, Luis, 2020. "Prediction of pipe failures in water supply networks using logistic regression and support vector classification," Reliability Engineering and System Safety, Elsevier, vol. 196(C).
    8. Zhang, Qiongfang & Xu, Nan & Ersoy, Daniel & Liu, Yongming, 2022. "Manifold-based Conditional Bayesian network for aging pipe yield strength estimation with non-destructive measurements," Reliability Engineering and System Safety, Elsevier, vol. 223(C).
    9. Rifaai, Talha M. & Abokifa, Ahmed A. & Sela, Lina, 2022. "Integrated approach for pipe failure prediction and condition scoring in water infrastructure systems," Reliability Engineering and System Safety, Elsevier, vol. 220(C).
    10. Wei Liu & Binhao Wang & Zhaoyang Song, 2022. "Failure Prediction of Municipal Water Pipes Using Machine Learning Algorithms," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(4), pages 1271-1285, March.
    11. Wang, Run-Zi & Gu, Hang-Hang & Zhu, Shun-Peng & Li, Kai-Shang & Wang, Ji & Wang, Xiao-Wei & Hideo, Miura & Zhang, Xian-Cheng & Tu, Shan-Tung, 2022. "A data-driven roadmap for creep-fatigue reliability assessment and its implementation in low-pressure turbine disk at elevated temperatures," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    12. Zio, Enrico, 2022. "Prognostics and Health Management (PHM): Where are we and where do we (need to) go in theory and practice," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    13. Yaser Amiri-Ardakani & Mohammad Najafzadeh, 2021. "Pipe Break Rate Assessment While Considering Physical and Operational Factors: A Methodology based on Global Positioning System and Data-Driven Techniques," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(11), pages 3703-3720, September.
    14. Yaxin Shi & Suning Liu & Haiyun Shi, 2022. "Analysis of the Water-Food-Energy Nexus and Water Competition Based on a Bayesian Network," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(9), pages 3349-3366, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Prabal Das & D. A. Sachindra & Kironmala Chanda, 2022. "Machine Learning-Based Rainfall Forecasting with Multiple Non-Linear Feature Selection Algorithms," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(15), pages 6043-6071, December.
    2. Robles-Velasco, Alicia & Cortés, Pablo & Muñuzuri, Jesús & Onieva, Luis, 2020. "Prediction of pipe failures in water supply networks using logistic regression and support vector classification," Reliability Engineering and System Safety, Elsevier, vol. 196(C).
    3. Yu, Jin-Zhu & Whitman, Mackenzie & Kermanshah, Amirhassan & Baroud, Hiba, 2021. "A hierarchical Bayesian approach for assessing infrastructure networks serviceability under uncertainty: A case study of water distribution systems," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    4. Hsin-Han Chen & Hui-Ling Chen & Yi-Tien Lin & Chaou-Wen Lin & Chien-Chang Ho & Hsueh-Yi Lin & Po-Fu Lee, 2020. "The Associations between Functional Fitness Test Performance and Abdominal Obesity in Healthy Elderly People: Results from the National Physical Fitness Examination Survey in Taiwan," IJERPH, MDPI, vol. 18(1), pages 1-14, December.
    5. Paulo Infante & Gonçalo Jacinto & Anabela Afonso & Leonor Rego & Pedro Nogueira & Marcelo Silva & Vitor Nogueira & José Saias & Paulo Quaresma & Daniel Santos & Patrícia Góis & Paulo Rebelo Manuel, 2023. "Factors That Influence the Type of Road Traffic Accidents: A Case Study in a District of Portugal," Sustainability, MDPI, vol. 15(3), pages 1-16, January.
    6. Ephrem Habyarimana & Faheem S Baloch, 2021. "Machine learning models based on remote and proximal sensing as potential methods for in-season biomass yields prediction in commercial sorghum fields," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-23, March.
    7. Crespo, Cristian, 2020. "Two become one: improving the targeting of conditional cash transfers with a predictive model of school dropout," LSE Research Online Documents on Economics 123139, London School of Economics and Political Science, LSE Library.
    8. Yen-Chun Chou & Howard Hao-Chun Chuang, 2018. "A predictive investigation of first-time customer retention in online reservation services," Service Business, Springer;Pan-Pacific Business Association, vol. 12(4), pages 685-699, December.
    9. Roland R. Ramsahai, 2020. "Connecting actuarial judgment to probabilistic learning techniques with graph theory," Papers 2007.15475, arXiv.org.
    10. Alexander Wettstein & Gabriel Jenni & Ida Schneider & Fabienne Kühne & Martin grosse Holtforth & Roberto La Marca, 2023. "Predictors of Psychological Strain and Allostatic Load in Teachers: Examining the Long-Term Effects of Biopsychosocial Risk and Protective Factors Using a LASSO Regression Approach," IJERPH, MDPI, vol. 20(10), pages 1-20, May.
    11. Sujin Park & Ali Tafti & Galit Shmueli, 2024. "Transporting Causal Effects Across Populations Using Structural Causal Modeling: An Illustration to Work-from-Home Productivity," Information Systems Research, INFORMS, vol. 35(2), pages 686-705, June.
    12. Claire Teunenbroek & René Bekkers & Bianca Beersma, 2021. "They ought to do it too: Understanding effects of social information on donation behavior and mood," International Review on Public and Nonprofit Marketing, Springer;International Association of Public and Non-Profit Marketing, vol. 18(2), pages 229-253, June.
    13. Daifeng Xiang & Gangsheng Wang & Jing Tian & Wanyu Li, 2023. "Global patterns and edaphic-climatic controls of soil carbon decomposition kinetics predicted from incubation experiments," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    14. Myriam Patricia Cifuentes & Clara Mercedes Suarez & Ricardo Cifuentes & Noel Malod-Dognin & Sam Windels & Jose Fernando Valderrama & Paul D. Juarez & R. Burciaga Valdez & Cynthia Colen & Charles Phill, 2022. "Big Data to Knowledge Analytics Reveals the Zika Virus Epidemic as Only One of Multiple Factors Contributing to a Year-Over-Year 28-Fold Increase in Microcephaly Incidence," IJERPH, MDPI, vol. 19(15), pages 1-21, July.
    15. Joel Podgorski & Oliver Kracht & Luis Araguas-Araguas & Stefan Terzer-Wassmuth & Jodie Miller & Ralf Straub & Rolf Kipfer & Michael Berg, 2024. "Groundwater vulnerability to pollution in Africa’s Sahel region," Nature Sustainability, Nature, vol. 7(5), pages 558-567, May.
    16. Tranos, Emmanouil & Incera, Andre Carrascal & Willis, George, 2022. "Using the web to predict regional trade flows: data extraction, modelling, and validation," OSF Preprints 9bu5z, Center for Open Science.
    17. Silvia de Juan & Maria Dulce Subida & Andres Ospina-Alvarez & Ainara Aguilar & Miriam Fernandez, 2020. "Disentangling the socio-ecological drivers behind illegal fishing in a small-scale fishery managed by a TURF system," Papers 2012.08970, arXiv.org.
    18. Štefan Lyócsa & Petra Vašaničová & Branka Hadji Misheva & Marko Dávid Vateha, 2022. "Default or profit scoring credit systems? Evidence from European and US peer-to-peer lending markets," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-21, December.
    19. Meineri, Eric & Dahlberg, C. Johan & Hylander, Kristoffer, 2015. "Using Gaussian Bayesian Networks to disentangle direct and indirect associations between landscape physiography, environmental variables and species distribution," Ecological Modelling, Elsevier, vol. 313(C), pages 127-136.
    20. Michail Tsagris, 2021. "A New Scalable Bayesian Network Learning Algorithm with Applications to Economics," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 341-367, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:186:y:2019:i:c:p:24-36. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.