IDEAS home Printed from https://ideas.repec.org/a/wly/syseng/v10y2007i4p323-347.html
   My bibliography  Save this article

SysTest: Improving the verification, validation, and testing process— Assessing six industrial pilot projects

Author

Listed:
  • Markus Hoppe
  • Avner Engel
  • Shalom Shachar

Abstract

The overall objective of the SysTest project was to develop a generic Verification, Validation, and Testing (VVT) methodology guidelines and an economic VVT process model in order to realize improved product quality at reduced cost and time to market. Six real‐life pilot projects were conducted by the SysTest industrial partners in order to assess the effectiveness of the SysTest products. The pilot projects represented diverse industrial segments namely, aircrafts avionics and jet engines, automobile engine castings and embedded software, liquid food packaging manufacturing, and steel production. In this paper, we demonstrate that: (1) The SysTest products are generic and applicable for different industries and (2) a clear trend was established: Namely, the application of the SysTest products improves the process and product quality. In the case of the SysTest pilot project, the average project cost saving was 7.6% with standard deviation of 14.8%. © 2007 Wiley Periodicals, Inc. Syst Eng 10: 323– 347, 2007

Suggested Citation

  • Markus Hoppe & Avner Engel & Shalom Shachar, 2007. "SysTest: Improving the verification, validation, and testing process— Assessing six industrial pilot projects," Systems Engineering, John Wiley & Sons, vol. 10(4), pages 323-347, December.
    • Handle: RePEc:wly:syseng:v:10:y:2007:i:4:p:323-347
    DOI: 10.1002/sys.20082
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sys.20082
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sys.20082?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Avner Engel & Shalom Shachar, 2006. "Measuring and optimizing systems' quality costs and project duration," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 259-280, September.
    2. Christoph H. Loch & Christian Terwiesch & Stefan Thomke, 2001. "Parallel and Sequential Testing of Design Alternatives," Management Science, INFORMS, vol. 47(5), pages 663-678, May.
    3. Don Clausing & Daniel D. Frey, 2005. "Improving system reliability by failure‐mode avoidance including four concept design strategies," Systems Engineering, John Wiley & Sons, vol. 8(3), pages 245-261, September.
    4. Stefan Thomke & David E. Bell, 2001. "Sequential Testing in Product Development," Management Science, INFORMS, vol. 47(2), pages 308-323, February.
    5. S. L. Tang & Raymond Aoieong & Syed Ahmed, 2004. "The use of Process Cost Model (PCM) for measuring quality costs of construction projects: model testing," Construction Management and Economics, Taylor & Francis Journals, vol. 22(3), pages 263-275.
    6. Avner Engel & Miryam Barad, 2003. "A methodology for modeling VVT risks and costs," Systems Engineering, John Wiley & Sons, vol. 6(3), pages 135-151.
    7. Christopher D. Ittner, 1996. "Exploratory Evidence on the Behavior of Quality Costs," Operations Research, INFORMS, vol. 44(1), pages 114-130, February.
    8. Raymond Aoieong & S. L. Tang & Syed Ahmed, 2002. "A process approach in measuring quality costs of construction projects: model development," Construction Management and Economics, Taylor & Francis Journals, vol. 20(2), pages 179-192.
    9. Ernst Fricke & Bernd Gebhard & Herbert Negele & Eduard Igenbergs, 2000. "Coping with changes: Causes, findings, and strategies," Systems Engineering, John Wiley & Sons, vol. 3(4), pages 169-179.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Arekhandia Patrick Eigbe & Brian J. Sauser & John Boardman, 2010. "Soft systems analysis of the unification of test and evaluation and program management: A study of a Federal Aviation Administration's strategy," Systems Engineering, John Wiley & Sons, vol. 13(3), pages 298-310, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Avner Engel & Shalom Shachar, 2006. "Measuring and optimizing systems' quality costs and project duration," Systems Engineering, John Wiley & Sons, vol. 9(3), pages 259-280, September.
    2. Meir Tahan & Joseph Z. Ben‐Asher, 2005. "Modeling and analysis of integration processes for engineering systems," Systems Engineering, John Wiley & Sons, vol. 8(1), pages 62-77.
    3. Thomas Gillier & Sylvain Lenfle, 2015. "Experimenting in the unknown : lessons from the Manhattan project," Working paper serie RMT - Grenoble Ecole de Management hal-01483018, HAL.
    4. Thomas Gillier & Sylvain Lenfle, 2015. "Experimenting in the unknown : lessons from the Manhattan project," Working Papers hal-01483018, HAL.
    5. Avner Engel & Miryam Barad, 2003. "A methodology for modeling VVT risks and costs," Systems Engineering, John Wiley & Sons, vol. 6(3), pages 135-151.
    6. M Barad & A Engel, 2006. "Optimizing VVT strategies: a decomposition approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(8), pages 965-974, August.
    7. Christian Terwiesch & Christoph H. Loch, 2004. "Collaborative Prototyping and the Pricing of Custom-Designed Products," Management Science, INFORMS, vol. 50(2), pages 145-158, February.
    8. Nair, Anand & Narasimhan, Ram, 2006. "Dynamics of competing with quality- and advertising-based goodwill," European Journal of Operational Research, Elsevier, vol. 175(1), pages 462-474, November.
    9. Konrad, Kai A., 2014. "Search duplication in research and design spaces — Exploring the role of local competition," International Journal of Industrial Organization, Elsevier, vol. 37(C), pages 222-228.
    10. Plambeck, Erica L. & Taylor, Terry A., 2004. "Partnership in a Dynamic Production System," Research Papers 1892, Stanford University, Graduate School of Business.
    11. Henning Skirde & Wolfgang Kersten & Meike Schröder, 2016. "Measuring the Cost Effects of Modular Product Architectures — A Conceptual Approach," International Journal of Innovation and Technology Management (IJITM), World Scientific Publishing Co. Pte. Ltd., vol. 13(04), pages 1-23, August.
    12. Bavly, Gilad & Heller, Yuval & Schreiber, Amnon, 2022. "Social welfare in search games with asymmetric information," Journal of Economic Theory, Elsevier, vol. 202(C).
    13. Zhaolin Li & Steven Q. Lu & Jennifer K. Ryan & Daewon Sun, 2021. "Impact of Organizational Structure on Development Strategy under Equity‐Based Incentives," Production and Operations Management, Production and Operations Management Society, vol. 30(4), pages 984-996, April.
    14. Edwin C. Y. Koh, 2017. "A study on the Requirements to Support the Accurate Prediction of Engineering Change Propagation," Systems Engineering, John Wiley & Sons, vol. 20(2), pages 147-157, March.
    15. Sungyong Chang, 2023. "Two faces of decomposability in organizational search: Evidence from singles versus albums in the music industry 1995–2015," Strategic Management Journal, Wiley Blackwell, vol. 44(7), pages 1616-1652, July.
    16. Alfonso Gambardella & Marco Giarratana, 2004. "Chandlerian Firms vs. Entrepreneurship," LEM Papers Series 2004/12, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    17. Gambardella, Alfonso, 2013. "The economic value of patented inventions: Thoughts and some open questions," International Journal of Industrial Organization, Elsevier, vol. 31(5), pages 626-633.
    18. Alexander Gutfraind, 2023. "On strategies for risk management and decision making under uncertainty shared across multiple fields," Papers 2309.03133, arXiv.org, revised Mar 2025.
    19. Stylianos Kavadias & Karl T. Ulrich, 2020. "Innovation and New Product Development: Reflections and Insights from the Research Published in the First 20 Years of Manufacturing & Service Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 84-92, January.
    20. Pascal Le Masson & Armand Hatchuel & Benoit Weil, 2016. "Innovation theory and the logic of generativity: from optimization to design, a new post-decisional paradigm in management science," Post-Print hal-01481881, HAL.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:syseng:v:10:y:2007:i:4:p:323-347. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)1520-6858 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.