IDEAS home Printed from https://ideas.repec.org/a/spr/opsear/v60y2023i4d10.1007_s12597-023-00680-x.html
   My bibliography  Save this article

Testing coverage based software reliability assessment incorporating effort expenditure and error generation

Author

Listed:
  • Sudeep Kumar

    (AIAS, Amity University Uttar Pradesh)

  • Anu G. Aggarwal

    (University of Delhi)

  • Ritu Gupta

    (T A Pai Management Institute)

Abstract

Due to the complexity of software systems, the testing team may be unable to completely eliminate a problem after observing a failure and the participation of numerous external elements in their development, and another fault may replace the identified fault, also known as error generation. Software developers and customers can benefit from test coverage as a software statistic since it can assist them improve the functionality of tested software and identify what additional effort is necessary to increase the reliability of the software. Software reliability growth models (SRGMs) have been cited as one of the effective methods for quantitative evaluation of software quality. The concept of effort spent and error generation are integrated into a model for testing coverage-based software reliability evaluation. Testing effort spent is supposed to follow the Weibull distribution, whereas testing coverage is described by exponential, delayed S-shaped, and logistic functions respectively. Additionally, we look into the cost requirement-based software release time for exponential functions with a reliability constraint. We introduce the genetic algorithm, which is a powerful tool for dealing with search and optimization issues. Two real failure datasets have been used to test different goodness of fit criteria for the model and their performance is evaluated using four goodness-of-fit metrics, including coefficient of determination $$\left({\mathrm{R}}^{2}\right)$$ R 2 , mean square error (MSE), predictive power (PP) and predictive ratio risk (PRR). The acquired results outperform the perfect debugging model and demonstrate notable advancements that are fairly encouraging.

Suggested Citation

  • Sudeep Kumar & Anu G. Aggarwal & Ritu Gupta, 2023. "Testing coverage based software reliability assessment incorporating effort expenditure and error generation," OPSEARCH, Springer;Operational Research Society of India, vol. 60(4), pages 1888-1901, December.
    • Handle: RePEc:spr:opsear:v:60:y:2023:i:4:d:10.1007_s12597-023-00680-x
    DOI: 10.1007/s12597-023-00680-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12597-023-00680-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12597-023-00680-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Abhishek Tandon & Anu G. Aggarwal & Nidhi Nijhawan, 2016. "An NHPP SRGM with Change Point and Multiple Releases," International Journal of Information Systems in the Service Sector (IJISSS), IGI Global, vol. 8(4), pages 57-68, October.
    2. Vibha Verma & Sameer Anand & P. K. Kapur & Anu G. Aggarwal, 2022. "Unified framework to assess software reliability and determine optimal release time in presence of fault reduction factor, error generation and fault removal efficiency," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(5), pages 2429-2441, October.
    3. Vijay Kumar & P. K. Kapur & Ramita Sahni & A. K. Shrivastava, 2018. "Testing Time and Effort-Based Successive Release Modeling of a Software in the Presence of Imperfect Debugging," Springer Proceedings in Business and Economics, in: P.K. Kapur & Uday Kumar & Ajit Kumar Verma (ed.), Quality, IT and Business Operations, pages 421-434, Springer.
    4. Kwang Yoon Song & In Hong Chang & Hoang Pham, 2019. "A Testing Coverage Model Based on NHPP Software Reliability Considering the Software Operating Environment and the Sensitivity Analysis," Mathematics, MDPI, vol. 7(5), pages 1-21, May.
    5. Peng, R. & Li, Y.F. & Zhang, W.J. & Hu, Q.P., 2014. "Testing effort dependent software reliability model for imperfect debugging process considering both detection and correction," Reliability Engineering and System Safety, Elsevier, vol. 126(C), pages 37-43.
    6. Madhu Jain & Anuradha Jain & Ritu Gupta, 2018. "Analysis of Module-Based Software Reliability Growth Model Incorporating Imperfect Debugging and Fault Reduction Factor," Springer Proceedings in Business and Economics, in: P.K. Kapur & Uday Kumar & Ajit Kumar Verma (ed.), Quality, IT and Business Operations, pages 69-80, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nethravathi Rippika & Monika Rani Golla & Sangharatna Godboley, 2025. "Making effective carbon-box testing technique using prioritised-selected test cases driven combinatorial approach," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 16(3), pages 1313-1338, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qing Tian & Chun-Wu Yeh & Chih-Chiang Fang, 2022. "Bayesian Decision Making of an Imperfect Debugging Software Reliability Growth Model with Consideration of Debuggers’ Learning and Negligence Factors," Mathematics, MDPI, vol. 10(10), pages 1-21, May.
    2. Shakshi Singhal & P. K. Kapur & Vivek Kumar & Saurabh Panwar, 2024. "Stochastic debugging based reliability growth models for Open Source Software project," Annals of Operations Research, Springer, vol. 340(1), pages 531-569, September.
    3. Chetna Choudhary & P. K. Kapur & Sunil K. Khatri & R. Muthukumar & Avinash K. Shrivastava, 2020. "Effort based release time of software for detection and correction processes using MAUT," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 11(2), pages 367-378, July.
    4. Ritu Bibyan & Sameer Anand & Anu G. Aggarwal & Abhishek Tandon, 2023. "Multi-release testing coverage-based SRGM considering error generation and change-point incorporating the random effect," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(5), pages 1877-1887, October.
    5. Tahere Yaghoobi & Man-Fai Leung, 2023. "Modeling Software Reliability with Learning and Fatigue," Mathematics, MDPI, vol. 11(16), pages 1-20, August.
    6. Byun, Ji-Eun & Noh, Hee-Min & Song, Junho, 2017. "Reliability growth analysis of k-out-of-N systems using matrix-based system reliability method," Reliability Engineering and System Safety, Elsevier, vol. 165(C), pages 410-421.
    7. Anu Aggarwal & Sudeep Kumar & Ritu Gupta, 2024. "Testing coverage based NHPP software reliability growth modeling with testing effort and change-point," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 15(11), pages 5157-5166, November.
    8. Hiroyuki Okamura & Tadashi Dohi, 2016. "Phase-type software reliability model: parameter estimation algorithms with grouped data," Annals of Operations Research, Springer, vol. 244(1), pages 177-208, September.
    9. Shivani Kushwaha & Ajay Kumar, 2024. "Optimizing software release decisions: a TFN-based uncertainty modeling approach," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 15(8), pages 3940-3953, August.
    10. Congcong Zhou & Zhenzhong Shen & Liqun Xu & Yiqing Sun & Wenbing Zhang & Hongwei Zhang & Jiayi Peng, 2023. "Global Sensitivity Analysis Method for Embankment Dam Slope Stability Considering Seepage–Stress Coupling under Changing Reservoir Water Levels," Mathematics, MDPI, vol. 11(13), pages 1-24, June.
    11. Rajat Arora & Rubina Mittal & Anu Gupta Aggarwal & P. K. Kapur, 2023. "Investigating the impact of effort slippages in software development project," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(3), pages 878-893, June.
    12. Wang, Jinyong & Wu, Zhibo, 2016. "Study of the nonlinear imperfect software debugging model," Reliability Engineering and System Safety, Elsevier, vol. 153(C), pages 180-192.
    13. Qing Tian & Chih-Chiang Fang & Chun-Wu Yeh, 2022. "Software Release Assessment under Multiple Alternatives with Consideration of Debuggers’ Learning Rate and Imperfect Debugging Environment," Mathematics, MDPI, vol. 10(10), pages 1-24, May.
    14. Vikas Dhaka & Nidhi Nijhawan, 2024. "Effect of change in environment on reliability growth modeling integrating fault reduction factor and change point: a general approach," Annals of Operations Research, Springer, vol. 340(1), pages 181-215, September.
    15. Anshul Tickoo & P. K. Kapur & A. K. Shrivastava & Sunil K. Khatri, 2016. "Testing effort based modeling to determine optimal release and patching time of software," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 7(4), pages 427-434, December.
    16. Hoang Pham, 2019. "A New Criterion for Model Selection," Mathematics, MDPI, vol. 7(12), pages 1-12, December.
    17. Nguyen, Khanh T.P. & Fouladirad, Mitra & Grall, Antoine, 2018. "Model selection for degradation modeling and prognosis with health monitoring data," Reliability Engineering and System Safety, Elsevier, vol. 169(C), pages 105-116.
    18. Vishal Pradhan & Ajay Kumar & Joydip Dhar, 2022. "Modelling software reliability growth through generalized inflection S-shaped fault reduction factor and optimal release time," Journal of Risk and Reliability, , vol. 236(1), pages 18-36, February.
    19. Mohammad Ubaidullah Bokhari & Md. Ashraf Siddiqui & Afaq Ahmad, 2021. "Integration of Testing Effort Function into Delayed S-Shaped Software Reliability Growth Model with Imperfect Debugging — a Proposed Bokhari Model," SN Operations Research Forum, Springer, vol. 2(4), pages 1-23, December.
    20. Umashankar Samal & Ajay Kumar, 2024. "A software reliability model incorporating fault removal efficiency and it’s release policy," Computational Statistics, Springer, vol. 39(6), pages 3137-3155, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:opsear:v:60:y:2023:i:4:d:10.1007_s12597-023-00680-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.