IDEAS home Printed from https://ideas.repec.org/a/wly/syseng/v6y2003i3p135-151.html

A methodology for modeling VVT risks and costs

Author

Listed:
  • Avner Engel
  • Miryam Barad

Abstract

The cost of large systems' Verification, Validation, and Testing (VVT) is in the neighborhood of 40% of the total life cycle cost. The cost associated with systems' failures is even more dramatic, often exceeding 10% of industrial organizations turnover. There is a great potential benefit in streamlining and optimizing the VVT process. The first step in accomplishing this aim is to define a VVT strategy and then to quantify the cost and risk associated with carrying it out. This paper provides an overview of the methodologies for risk and cost monitoring for VVT and proposes a novel approach for modeling VVT strategies as decision problems. A quantitative VVT process and risk model is proposed. Due to the nondeterministic nature of risk, simulation is used to generate distributions of possible costs, schedules, and risk outcomes. These distributions represent a probabilistic approach and are analyzed in relation to impact events. The model provides means to explore different VVT strategies for optimizing relevant decision parameters. To demonstrate the proposed procedure the paper describes a case study depicting a planned avionics suite upgrade program for a fighter aircraft. Some simplified partial quantitative results are also presented. © 2003 Wiley Periodicals, Inc. Syst Eng 6: 135–151, 2003

Suggested Citation

  • Avner Engel & Miryam Barad, 2003. "A methodology for modeling VVT risks and costs," Systems Engineering, John Wiley & Sons, vol. 6(3), pages 135-151.
    • Handle: RePEc:wly:syseng:v:6:y:2003:i:3:p:135-151
    DOI: 10.1002/sys.10040
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sys.10040
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sys.10040?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stefan Thomke & David E. Bell, 2001. "Sequential Testing in Product Development," Management Science, INFORMS, vol. 47(2), pages 308-323, February.
    2. Christopher D. Ittner, 1996. "Exploratory Evidence on the Behavior of Quality Costs," Operations Research, INFORMS, vol. 44(1), pages 114-130, February.
    3. Gregory A. Lamm & Yacov Y. Haimes, 2002. "Assessing and managing risks to information assurance: A methodological approach," Systems Engineering, John Wiley & Sons, vol. 5(4), pages 286-314.
    4. Kimberly M. Thompson, 2002. "Variability and Uncertainty Meet Risk Management and Risk Communication," Risk Analysis, John Wiley & Sons, vol. 22(3), pages 647-654, June.
    5. Yacov Y. Haimes & Stan Kaplan & James H. Lambert, 2002. "Risk Filtering, Ranking, and Management Framework Using Hierarchical Holographic Modeling," Risk Analysis, John Wiley & Sons, vol. 22(2), pages 383-397, April.
    6. D. J. Smith, 2000. "Risk Simulation and the Appraisal of Investment Projects," Computers in Higher Education Economics Review, Economics Network, University of Bristol, vol. 14(1), pages 9-13.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Avner Engel & Shalom Shachar, 2006. "Measuring and optimizing systems' quality costs and project duration," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 259-280, September.
    2. Meir Tahan & Joseph Z. Ben‐Asher, 2005. "Modeling and analysis of integration processes for engineering systems," Systems Engineering, John Wiley & Sons, vol. 8(1), pages 62-77.
    3. Edouard Kujawski & Diana Angelis, 2010. "Monitoring risk response actions for effective project risk management," Systems Engineering, John Wiley & Sons, vol. 13(4), pages 353-368, December.
    4. Markus Hoppe & Avner Engel & Shalom Shachar, 2007. "SysTest: Improving the verification, validation, and testing process— Assessing six industrial pilot projects," Systems Engineering, John Wiley & Sons, vol. 10(4), pages 323-347, December.
    5. M Barad & A Engel, 2006. "Optimizing VVT strategies: a decomposition approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(8), pages 965-974, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Avner Engel & Shalom Shachar, 2006. "Measuring and optimizing systems' quality costs and project duration," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 259-280, September.
    2. Markus Hoppe & Avner Engel & Shalom Shachar, 2007. "SysTest: Improving the verification, validation, and testing process— Assessing six industrial pilot projects," Systems Engineering, John Wiley & Sons, vol. 10(4), pages 323-347, December.
    3. James H. Lambert & Rachel K. Jennings & Nilesh N. Joshi, 2006. "Integration of risk identification with business process models," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 187-198, September.
    4. Sean S. Baggott & Joost R. Santos, 2020. "A Risk Analysis Framework for Cyber Security and Critical Infrastructure Protection of the U.S. Electric Power Grid," Risk Analysis, John Wiley & Sons, vol. 40(9), pages 1744-1761, September.
    5. M Barad & A Engel, 2006. "Optimizing VVT strategies: a decomposition approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(8), pages 965-974, August.
    6. Meir Tahan & Joseph Z. Ben‐Asher, 2005. "Modeling and analysis of integration processes for engineering systems," Systems Engineering, John Wiley & Sons, vol. 8(1), pages 62-77.
    7. Nair, Anand & Narasimhan, Ram, 2006. "Dynamics of competing with quality- and advertising-based goodwill," European Journal of Operational Research, Elsevier, vol. 175(1), pages 462-474, November.
    8. Rogerson, Ellen C. & Lambert, James H., 2012. "Prioritizing risks via several expert perspectives with application to runway safety," Reliability Engineering and System Safety, Elsevier, vol. 103(C), pages 22-34.
    9. Jason R. W. Merrick & Laura A. McLay, 2010. "Is Screening Cargo Containers for Smuggled Nuclear Threats Worthwhile?," Decision Analysis, INFORMS, vol. 7(2), pages 155-171, June.
    10. Madelynn R. D. Stackhouse & Robert Stewart, 2017. "Failing to Fix What is Found: Risk Accommodation in the Oil and Gas Industry," Risk Analysis, John Wiley & Sons, vol. 37(1), pages 130-146, January.
    11. Ioanna Ioannou & Jaime E. Cadena & Willy Aspinall & David Lange & Daniel Honfi & Tiziana Rossetto, 2022. "Prioritization of hazards for risk and resilience management through elicitation of expert judgement," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 112(3), pages 2773-2795, July.
    12. Gülbanu Kaptan & Arnout R.H. Fischer & Lynn J. Frewer, 2018. "Extrapolating understanding of food risk perceptions to emerging food safety cases," Journal of Risk Research, Taylor & Francis Journals, vol. 21(8), pages 996-1018, August.
    13. Roxane Foulser‐Piggott & Gary Bowman & Martin Hughes, 2020. "A Framework for Understanding Uncertainty in Seismic Risk Assessment," Risk Analysis, John Wiley & Sons, vol. 40(1), pages 169-182, January.
    14. Richard A. Williams & Kimberly M. Thompson, 2004. "Integrated Analysis: Combining Risk and Economic Assessments While Preserving the Separation of Powers," Risk Analysis, John Wiley & Sons, vol. 24(6), pages 1613-1623, December.
    15. Andrew G. Huff & James S. Hodges & Shaun P. Kennedy & Amy Kircher, 2015. "Evaluation of the Food and Agriculture Sector Criticality Assessment Tool (FASCAT) and the Collected Data," Risk Analysis, John Wiley & Sons, vol. 35(8), pages 1448-1467, August.
    16. Barry Charles Ezell, 2007. "Infrastructure Vulnerability Assessment Model (I‐VAM)," Risk Analysis, John Wiley & Sons, vol. 27(3), pages 571-583, June.
    17. Heckmann, Iris & Comes, Tina & Nickel, Stefan, 2015. "A critical review on supply chain risk – Definition, measure and modeling," Omega, Elsevier, vol. 52(C), pages 119-132.
    18. Jochen Schlapp & Gerrit Schumacher, 2022. "Delegated Concept Testing in New Product Development," Operations Research, INFORMS, vol. 70(5), pages 2732-2748, September.
    19. Alexander Gutfraind, 2023. "On strategies for risk management and decision making under uncertainty shared across multiple fields," Papers 2309.03133, arXiv.org, revised Mar 2025.
    20. Aven, Terje, 2017. "Improving risk characterisations in practical situations by highlighting knowledge aspects, with applications to risk matrices," Reliability Engineering and System Safety, Elsevier, vol. 167(C), pages 42-48.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:syseng:v:6:y:2003:i:3:p:135-151. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)1520-6858 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.