IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v204y2020ics0951832020306943.html
   My bibliography  Save this article

Reliability assessment of service-based software under operational profile uncertainty

Author

Listed:
  • Pietrantuono, Roberto
  • Popov, Peter
  • Russo, Stefano

Abstract

We address the problem of operational reliability assessment through testing of software services delivered on-demand such as Web Services. Software reliability assessment is typically done for a specific operational profile: the profile is needed in testing to select or generate test cases (operational testing) in a way statistically similar to the anticipated use of software in operation; the observations of success/failure of test executions are used to predict software reliability in actual operation. It is well known that unless the profile is accurate, software reliability predictions obtained via operational testing cannot be trusted.

Suggested Citation

  • Pietrantuono, Roberto & Popov, Peter & Russo, Stefano, 2020. "Reliability assessment of service-based software under operational profile uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
  • Handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306943
    DOI: 10.1016/j.ress.2020.107193
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832020306943
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ress.2020.107193?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bishop, Peter & Povyakalo, Andrey, 2017. "Deriving a frequentist conservative confidence bound for probability of failure per demand for systems with different operational and test profiles," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 246-253.
    2. Vanslette, Kevin & Tohme, Tony & Youcef-Toumi, Kamal, 2020. "A general model validation and testing tool," Reliability Engineering and System Safety, Elsevier, vol. 195(C).
    3. Ozekici, S. & Soyer, R., 2003. "Reliability of software with an operational profile," European Journal of Operational Research, Elsevier, vol. 149(2), pages 459-474, September.
    4. Følstad, Eirik L. & Helvik, Bjarne E., 2016. "The cost for meeting SLA dependability requirements; implications for customers and providers," Reliability Engineering and System Safety, Elsevier, vol. 145(C), pages 136-146.
    5. Bosse, Sascha & Splieth, Matthias & Turowski, Klaus, 2016. "Multi-objective optimization of IT service availability and costs," Reliability Engineering and System Safety, Elsevier, vol. 147(C), pages 142-155.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rahman Dwi Wahyudi & Moses Laksono Singgih & Mokh Suef, 2022. "Investigation of Product–Service System Components as Control Points for Value Creation and Development Process," Sustainability, MDPI, vol. 14(23), pages 1-23, December.
    2. Li, Xinhong & Jia, Ruichao & Zhang, Renren & Yang, Shangyu & Chen, Guoming, 2022. "A KPCA-BRANN based data-driven approach to model corrosion degradation of subsea oil pipelines," Reliability Engineering and System Safety, Elsevier, vol. 219(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ulrik Franke, 2020. "IT service outage cost: case study and implications for cyber insurance," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 45(4), pages 760-784, October.
    2. Soheil Azizi & Milad Mohammadi, 2023. "Strategy selection for multi-objective redundancy allocation problem in a k-out-of-n system considering the mean time to failure," OPSEARCH, Springer;Operational Research Society of India, vol. 60(2), pages 1021-1044, June.
    3. Landon, Joshua & Özekici, Süleyman & Soyer, Refik, 2013. "A Markov modulated Poisson model for software reliability," European Journal of Operational Research, Elsevier, vol. 229(2), pages 404-410.
    4. Tohme, Tony & Vanslette, Kevin & Youcef-Toumi, Kamal, 2023. "Reliable neural networks for regression uncertainty estimation," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    5. Ledoux, James, 2008. "On a software reliability model by Koch and Spreij," Statistics & Probability Letters, Elsevier, vol. 78(7), pages 904-914, May.
    6. Koutras, V.P. & Malefaki, S. & Platis, A.N., 2017. "Optimization of the dependability and performance measures of a generic model for multi-state deteriorating systems under maintenance," Reliability Engineering and System Safety, Elsevier, vol. 166(C), pages 73-86.
    7. Loretta Mastroeni & Alessandro Mazzoccoli & Maurizio Naldi, 2022. "Pricing Cat Bonds for Cloud Service Failures," JRFM, MDPI, vol. 15(10), pages 1-18, October.
    8. S. Özekici & R. Soyer, 2006. "Semi-Markov modulated Poisson process: probabilistic and statistical analysis," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 64(1), pages 125-144, August.
    9. Carpitella, Silvia & Certa, Antonella & Izquierdo, Joaquín & La Fata, Concetta Manuela, 2018. "A combined multi-criteria approach to support FMECA analyses: A real-world case," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 394-402.
    10. Khastgir, Siddartha & Brewerton, Simon & Thomas, John & Jennings, Paul, 2021. "Systems Approach to Creating Test Scenarios for Automated Driving Systems," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    11. Ulrik Franke, 0. "IT service outage cost: case study and implications for cyber insurance," The Geneva Papers on Risk and Insurance - Issues and Practice, Palgrave Macmillan;The Geneva Association, vol. 0, pages 1-25.
    12. Ríos Insua, David & Ruggeri, Fabrizio & Soyer, Refik & Rasines, Daniel G., 2018. "Adversarial issues in reliability," European Journal of Operational Research, Elsevier, vol. 266(3), pages 1113-1119.
    13. Ashutosh Sharma & Rajiv Kumar & Manar Wasif Abu Talib & Saurabh Srivastava & Razi Iqbal, 2019. "Network modelling and computation of quickest path for service-level agreements using bi-objective optimization," International Journal of Distributed Sensor Networks, , vol. 15(10), pages 15501477198, October.
    14. Ramírez-Cobo, Pepa, 2017. "Findings about the two-state BMMPP for modeling point processes in reliability and queueing systems," DES - Working Papers. Statistics and Econometrics. WS 24622, Universidad Carlos III de Madrid. Departamento de Estadística.
    15. Tohme, Tony & Vanslette, Kevin & Youcef-Toumi, Kamal, 2020. "A generalized Bayesian approach to model calibration," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    16. Bishop, Peter & Povyakalo, Andrey, 2020. "A conservative confidence bound for the probability of failure on demand of a software-based system based on failure-free tests of its components," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    17. Aktekin, Tevfik & Caglar, Toros, 2013. "Imperfect debugging in software reliability: A Bayesian approach," European Journal of Operational Research, Elsevier, vol. 227(1), pages 112-121.
    18. Li, Meng & Sadoughi, Mohammadkazem & Hu, Zhen & Hu, Chao, 2020. "A hybrid Gaussian process model for system reliability analysis," Reliability Engineering and System Safety, Elsevier, vol. 197(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:204:y:2020:i:c:s0951832020306943. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.