IDEAS home Printed from https://ideas.repec.org/a/wly/syseng/v24y2021i1p17-33.html
   My bibliography  Save this article

An evaluation of the optimality of frequent verification for vertically integrated systems

Author

Listed:
  • Aditya U. Kulkarni
  • Alejandro Salado
  • Peng Xu
  • Christian Wernz

Abstract

Verification activities, such as inspection, testing, analysis, and demonstration, improve one's confidence in the system meeting the system requirements during the development process. Frequent verification is often advocated as a strategy that minimizes costs of rework over the entire design process, where frequent verification involves verifying after any change in the design. However, this strategy is yet to be validated. In this paper, we develop a belief‐based model of verification in systems design to determine the conditions under which frequent verification is an optimal strategy for a vertically integrated organization. Our model uses belief distributions to capture the organization's dynamic confidence in the system design meeting a requirement of interest during the development process. It also captures the organization's dynamic confidence in the correctness of its development activities (or design process) as a function of past verification activities and current system maturity. The analysis of our model shows that frequent verification is a cost‐minimizing strategy for any level of belief in satisfying the requirement only when the organization has high confidence in the correctness of its design activities and the expected cost to rework a faulty design is greater than the costs to set up the verification activities throughout the development process. Otherwise, strategies with infrequent verification are superior. Our work contributes to the growing body of literature on the theoretical foundations of systems engineering and engineering design and seeks to provide practitioners with a means to determine optimal verification strategies.

Suggested Citation

  • Aditya U. Kulkarni & Alejandro Salado & Peng Xu & Christian Wernz, 2021. "An evaluation of the optimality of frequent verification for vertically integrated systems," Systems Engineering, John Wiley & Sons, vol. 24(1), pages 17-33, January.
  • Handle: RePEc:wly:syseng:v:24:y:2021:i:1:p:17-33
    DOI: 10.1002/sys.21564
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sys.21564
    Download Restriction: no

    File URL: https://libkey.io/10.1002/sys.21564?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Saul I. Gass, 1983. "Feature Article—Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis," Operations Research, INFORMS, vol. 31(4), pages 603-631, August.
    2. Reza Ahmadi & Robert H. Wang, 1999. "Managing Development Risk in Product Design Processes," Operations Research, INFORMS, vol. 47(2), pages 235-246, April.
    3. McCarl, Bruce A., 1984. "Model Validation: An Overview with some Emphasis on Risk Models," Review of Marketing and Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 52(03), pages 1-21, December.
    4. Albert Y. Ha & Evan L. Porteus, 1995. "Optimal Timing of Reviews in Concurrent Design for Manufacturability," Management Science, INFORMS, vol. 41(9), pages 1431-1447, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joglekar, Nitindra R., 2003. "Performance of coupled product development activities with a deadline," Working papers WP 4122-00., Massachusetts Institute of Technology (MIT), Sloan School of Management.
    2. Mario Holzner, 2004. "GSIM Measurement of the Costs of Protection in Southeast Europe," wiiw Balkan Observatory Working Papers 55, The Vienna Institute for International Economic Studies, wiiw.
    3. Nitindra R. Joglekar & Ali A. Yassine & Steven D. Eppinger & Daniel E. Whitney, 2001. "Performance of Coupled Product Development Activities with a Deadline," Management Science, INFORMS, vol. 47(12), pages 1605-1620, December.
    4. Thomas A. Roemer & Reza Ahmadi, 2004. "Concurrent Crashing and Overlapping in Product Development," Operations Research, INFORMS, vol. 52(4), pages 606-622, August.
    5. Qian, Yanjun & Xie, Min & Goh, Thong Ngee & Lin, Jun, 2010. "Optimal testing strategies in overlapped design process," European Journal of Operational Research, Elsevier, vol. 206(1), pages 131-143, October.
    6. Thomas A. Roemer & Reza Ahmadi & Robert H. Wang, 2000. "Time-Cost Trade-Offs in Overlapped Product Development," Operations Research, INFORMS, vol. 48(6), pages 858-865, December.
    7. Eike Nohdurft & Elisa Long & Stefan Spinler, 2017. "Was Angelina Jolie Right? Optimizing Cancer Prevention Strategies Among BRCA Mutation Carriers," Decision Analysis, INFORMS, vol. 14(3), pages 139-169, September.
    8. Rau, Philipp & Spinler, Stefan, 2017. "Alliance formation in a cooperative container shipping game: Performance of a real options investment approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 101(C), pages 155-175.
    9. Christian Terwiesch & Christoph H. Loch, 1999. "Measuring the Effectiveness of Overlapping Development Activities," Management Science, INFORMS, vol. 45(4), pages 455-465, April.
    10. Christian Terwiesch & Yi Xu, 2008. "Innovation Contests, Open Innovation, and Multiagent Problem Solving," Management Science, INFORMS, vol. 54(9), pages 1529-1543, September.
    11. Musser, Wesley N. & Tew, Bernard V., 1984. "Use Of Biophysical Simulation In Production Economics," Southern Journal of Agricultural Economics, Southern Agricultural Economics Association, vol. 16(1), pages 1-10, July.
    12. Haehl, Christian & Spinler, Stefan, 2018. "Capacity expansion under regulatory uncertainty:A real options-based study in international container shipping," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 113(C), pages 75-93.
    13. Boggess, William G. & Anaman, Kwabena A. & Hanson, Gregory D., 1985. "Importance, Causes, And Management Responses To Farm Risks: Evidence From Florida And Alabama," Southern Journal of Agricultural Economics, Southern Agricultural Economics Association, vol. 17(2), pages 1-12, December.
    14. Dillon, Carl R. & Mjelde, James W. & McCarl, Bruce A., 1989. "Comments On Development And Use Of Biophysical Simulation Models," 1989 Annual Meeting, July 30-August 2, Baton Rouge, Louisiana 270723, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    15. Quagrainie, Kwamena K. & Unterschultz, James R. & Jeffrey, Scott R., 2000. "The Impact Of Post-Farmgate Value-Adding On Western Canadian Agriculture," 2000 Annual Meeting, June 29-July 1, 2000, Vancouver, British Columbia 36379, Western Agricultural Economics Association.
    16. Pachepsky, L. B. & Haskett, J. D. & Acock, B., 1996. "An adequate model of photosynthesis--I Parameterization, validation and comparison of models," Agricultural Systems, Elsevier, vol. 50(2), pages 209-225.
    17. Daniel Hach & Stefan Spinler, 2018. "Robustness of capacity markets: a stochastic dynamic capacity investment model," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 40(2), pages 517-540, March.
    18. Ernest H. Forman & Saul I. Gass, 2001. "The Analytic Hierarchy Process---An Exposition," Operations Research, INFORMS, vol. 49(4), pages 469-486, August.
    19. Stefan Thomke & David E. Bell, 2001. "Sequential Testing in Product Development," Management Science, INFORMS, vol. 47(2), pages 308-323, February.
    20. McCarl, Bruce A., 1986. "Innovations In Programming Techniques For Risk Analysis," Regional Research Projects > 1986: S-180 Annual Meeting, March 23-26, 1986, Tampa, Florida 271825, Regional Research Projects > S-180: An Economic Analysis of Risk Management Strategies for Agricultural Production Firms.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:syseng:v:24:y:2021:i:1:p:17-33. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)1520-6858 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.