IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v175y2018icp265-282.html
   My bibliography  Save this article

Conservative claims for the probability of perfection of a software-based system using operational experience of previous similar systems

Author

Listed:
  • Zhao, Xingyu
  • Littlewood, Bev
  • Povyakalo, Andrey
  • Strigini, Lorenzo
  • Wright, David

Abstract

We begin by briefly discussing the reasons why claims of probability of non-perfection (pnp) may sometimes be useful in reasoning about the reliability of software-based systems for safety-critical applications. We identify two ways in which this approach may make the system assessment problem easier. The first concerns the need to assess the chance of lifetime freedom from failure of a single system. The second concerns the need to assess the reliability of multi-channel software-diverse fault tolerant systems – in this paper, 1-out-of-2 systems. In earlier work (Littlewood and Rushby 2012; Littlewood and Povyakalo 2013) it was proposed that, in certain applications, claims for possible perfection of one of the channels in such a system may be feasible. It was shown that in such a case there is a particularly simple conservative expression for system pfd (probability of failure on demand), involving the pfd of one channel, and the pnp of the other. In this paper we address the problem of how to assess such a pnp. In previous work (Zhao et al., 2015) we have addressed this problem when the evidence available is only extensive failure-free working of the system in question. Here we consider the case in which there is, in addition, evidence of the previous success of the software development procedures used to build the system: specifically, several previous similar systems built using the same process have exhibited failure-free working during extensive operational exposure.

Suggested Citation

  • Zhao, Xingyu & Littlewood, Bev & Povyakalo, Andrey & Strigini, Lorenzo & Wright, David, 2018. "Conservative claims for the probability of perfection of a software-based system using operational experience of previous similar systems," Reliability Engineering and System Safety, Elsevier, vol. 175(C), pages 265-282.
  • Handle: RePEc:eee:reensy:v:175:y:2018:i:c:p:265-282
    DOI: 10.1016/j.ress.2018.03.032
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832017305781
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2018.03.032?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bunea, C. & Charitos, T. & Cooke, R.M. & Becker, G., 2005. "Two-stage Bayesian models—application to ZEDB project," Reliability Engineering and System Safety, Elsevier, vol. 90(2), pages 123-130.
    2. Zhao, Xingyu & Littlewood, Bev & Povyakalo, Andrey & Strigini, Lorenzo & Wright, David, 2017. "Modeling the probability of failure on demand (pfd) of a 1-out-of-2 system in which one channel is “quasi-perfectâ€," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 230-245.
    3. Aven, Terje & Zio, Enrico, 2011. "Some considerations on the treatment of uncertainties in risk assessment for practical decision making," Reliability Engineering and System Safety, Elsevier, vol. 96(1), pages 64-74.
    4. Vaurio, Jussi K. & Jänkälä, Kalle E., 2006. "Evaluation and comparison of estimation methods for failure rates and probabilities," Reliability Engineering and System Safety, Elsevier, vol. 91(2), pages 209-221.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Qing Tian & Chun-Wu Yeh & Chih-Chiang Fang, 2022. "Bayesian Decision Making of an Imperfect Debugging Software Reliability Growth Model with Consideration of Debuggers’ Learning and Negligence Factors," Mathematics, MDPI, vol. 10(10), pages 1-21, May.
    2. Littlewood, Bev & Salako, Kizito & Strigini, Lorenzo & Zhao, Xingyu, 2020. "On reliability assessment when a software-based system is replaced by a thought-to-be-better one," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    3. Qing Tian & Chih-Chiang Fang & Chun-Wu Yeh, 2022. "Software Release Assessment under Multiple Alternatives with Consideration of Debuggers’ Learning Rate and Imperfect Debugging Environment," Mathematics, MDPI, vol. 10(10), pages 1-24, May.
    4. Popov, Peter, 2021. "Conservative reliability assessment of a 2-channel software system when one of the channels is probably perfect," Reliability Engineering and System Safety, Elsevier, vol. 216(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Littlewood, Bev & Salako, Kizito & Strigini, Lorenzo & Zhao, Xingyu, 2020. "On reliability assessment when a software-based system is replaced by a thought-to-be-better one," Reliability Engineering and System Safety, Elsevier, vol. 197(C).
    2. Quigley, John & Hardman, Gavin & Bedford, Tim & Walls, Lesley, 2011. "Merging expert and empirical data for rare event frequency estimation: Pool homogenisation for empirical Bayes models," Reliability Engineering and System Safety, Elsevier, vol. 96(6), pages 687-695.
    3. Strigini, Lorenzo & Wright, David, 2014. "Bounds on survival probability given mean probability of failure per demand; and the paradoxical advantages of uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 128(C), pages 66-83.
    4. Li, Yanfu & Zio, Enrico, 2012. "Uncertainty analysis of the adequacy assessment model of a distributed generation system," Renewable Energy, Elsevier, vol. 41(C), pages 235-244.
    5. Francis, Royce & Bekera, Behailu, 2014. "A metric and frameworks for resilience analysis of engineered and infrastructure systems," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 90-103.
    6. Aven, Terje, 2013. "A conceptual framework for linking risk and the elements of the data–information–knowledge–wisdom (DIKW) hierarchy," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 30-36.
    7. Amro Nasr & Oskar Larsson Ivanov & Ivar Björnsson & Jonas Johansson & Dániel Honfi, 2021. "Towards a Conceptual Framework for Built Infrastructure Design in an Uncertain Climate: Challenges and Research Needs," Sustainability, MDPI, vol. 13(21), pages 1-19, October.
    8. Ibsen Chivatá Cárdenas & Saad S.H. Al‐Jibouri & Johannes I.M. Halman & Frits A. van Tol, 2014. "Modeling Risk‐Related Knowledge in Tunneling Projects," Risk Analysis, John Wiley & Sons, vol. 34(2), pages 323-339, February.
    9. Nguyen, Son & Chen, Peggy Shu-Ling & Du, Yuquan & Shi, Wenming, 2019. "A quantitative risk analysis model with integrated deliberative Delphi platform for container shipping operational risks," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 129(C), pages 203-227.
    10. Zio, E., 2018. "The future of risk assessment," Reliability Engineering and System Safety, Elsevier, vol. 177(C), pages 176-190.
    11. Bing Wu & Huibin Tian & Xinping Yan & C. Guedes Soares, 2020. "A probabilistic consequence estimation model for collision accidents in the downstream of Yangtze River using Bayesian Networks," Journal of Risk and Reliability, , vol. 234(2), pages 422-436, April.
    12. Baraldi, Piero & Podofillini, Luca & Mkrtchyan, Lusine & Zio, Enrico & Dang, Vinh N., 2015. "Comparing the treatment of uncertainty in Bayesian networks and fuzzy expert systems used for a human reliability analysis application," Reliability Engineering and System Safety, Elsevier, vol. 138(C), pages 176-193.
    13. Ripamonti, G. & Lonati, G. & Baraldi, P. & Cadini, F. & Zio, E., 2013. "Uncertainty propagation in a model for the estimation of the ground level concentration of dioxin/furans emitted from a waste gasification plant," Reliability Engineering and System Safety, Elsevier, vol. 120(C), pages 98-105.
    14. Peng Hou & Xiaojian Yi & Haiping Dong, 2020. "A Spatial Statistic Based Risk Assessment Approach to Prioritize the Pipeline Inspection of the Pipeline Network," Energies, MDPI, vol. 13(3), pages 1-16, February.
    15. Aven, Terje, 2013. "Probabilities and background knowledge as a tool to reflect uncertainties in relation to intentional acts," Reliability Engineering and System Safety, Elsevier, vol. 119(C), pages 229-234.
    16. Deyun Zhou & Yongchuan Tang & Wen Jiang, 2017. "An Improved Belief Entropy and Its Application in Decision-Making," Complexity, Hindawi, vol. 2017, pages 1-15, March.
    17. Aven, Terje, 2013. "Practical implications of the new risk perspectives," Reliability Engineering and System Safety, Elsevier, vol. 115(C), pages 136-145.
    18. Tang, Yang & Liu, Qingyou & Jing, Jiajia & Yang, Yan & Zou, Zhengwei, 2017. "A framework for identification of maintenance significant items in reliability centered maintenance," Energy, Elsevier, vol. 118(C), pages 1295-1303.
    19. Aven, Terje & Krohn, Bodil S., 2014. "A new perspective on how to understand, assess and manage risk and the unforeseen," Reliability Engineering and System Safety, Elsevier, vol. 121(C), pages 1-10.
    20. Tosoni, E. & Salo, A. & Govaerts, J. & Zio, E., 2019. "Comprehensiveness of scenarios in the safety assessment of nuclear waste repositories," Reliability Engineering and System Safety, Elsevier, vol. 188(C), pages 561-573.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:175:y:2018:i:c:p:265-282. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.