IDEAS home Printed from https://ideas.repec.org/a/wly/syseng/v17y2014i2p166-192.html
   My bibliography  Save this article

Balancing Time‐to‐Market and Quality in Embedded Systems

Author

Listed:
  • Pieter van der Spek
  • Chris Verhoef

Abstract

Finding a balance between the time‐to‐market and quality of a delivered product is a daunting task. The optimal release moment is not easily found. We propose to use historical project data to monitor the progress of running projects. From the data we inferred a formula providing a rough indication of the number of defects given the effort spent thus far (effort‐to‐defect formula). Furthermore, we provide a worst case bound to the allowed number of residual defects at the end of a project in order to achieve the required level of quality. For this purpose we slightly modified a well‐known reliability growth model by Bishop and Bloomfield. It turned out that the software in Philips’ MRI scanners has a defect rate of 1 per 1175 device‐years of observation. This coincides with the second highest safety integrity level (SIL3) as defined in the IEC 61508 standard. The highest level (SIL4) is only attainable by applying redundancy. Finally, we combine the effort‐to‐defect formula with the reliability growth model to monitor the progress of a project and to determine when the required level of quality will be reached. We show that a common fault distribution, the Rayleigh model, is not necessarily the best model for predicting the number of residual defects in the system. Using a well‐known data analysis approach called exploratory data analysis (EDA) we obtained an alternative model based on the Normal curve. We have evaluated the Rayleigh model and our model based on the Normal curve at Philips Healthcare MRI. The Normal curve predicts defects over time better than the Rayleigh model in the case of Philips Healthcare MRI. Furthermore, time series models (ARIMA) are also useful for accurately describing the defect trend, but are not suitable for long‐term predictions. Finally, cost estimation models (COCOMO) lack the predictive capabilities of models fitted on the data using EDA. Their capabilities are limited compared to a model derived from data which reflects the constitutional knowledge of the actual realization of systems within a specific company. However, they can still be used to advantage when there is limited or no data available to use as a basis for lifting from gut feel to order of magnitude. © 2013 Wiley Periodicals, Inc. Syst Eng 17

Suggested Citation

  • Pieter van der Spek & Chris Verhoef, 2014. "Balancing Time‐to‐Market and Quality in Embedded Systems," Systems Engineering, John Wiley & Sons, vol. 17(2), pages 166-192, June.
  • Handle: RePEc:wly:syseng:v:17:y:2014:i:2:p:166-192
    DOI: 10.1002/sys.21261
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sys.21261
    Download Restriction: no

    File URL: https://libkey.io/10.1002/sys.21261?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Barry Boehm, 2006. "Some future trends and implications for systems and software engineering processes," Systems Engineering, John Wiley & Sons, vol. 9(1), pages 1-19, March.
    2. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    3. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    4. René Krikhaar & Wim Mosterman & Niels Veerman & Chris Verhoef, 2009. "Enabling system evolution through configuration management on the hardware/software boundary," Systems Engineering, John Wiley & Sons, vol. 12(3), pages 233-264, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kyungsub Lee, 2022. "Application of Hawkes volatility in the observation of filtered high-frequency price process in tick structures," Papers 2207.05939, arXiv.org.
    2. Shafiqah Azman & Dharini Pathmanathan & Aerambamoorthy Thavaneswaran, 2022. "Forecasting the Volatility of Cryptocurrencies in the Presence of COVID-19 with the State Space Model and Kalman Filter," Mathematics, MDPI, vol. 10(17), pages 1-15, September.
    3. Ajay Singh & Dinghai Xu, 2016. "Random matrix application to correlations amongst the volatility of assets," Quantitative Finance, Taylor & Francis Journals, vol. 16(1), pages 69-83, January.
    4. Hassani, Hossein & Webster, Allan & Silva, Emmanuel Sirimal & Heravi, Saeed, 2015. "Forecasting U.S. Tourist arrivals using optimal Singular Spectrum Analysis," Tourism Management, Elsevier, vol. 46(C), pages 322-335.
    5. Christos Katris & Manolis G. Kavussanos, 2021. "Time series forecasting methods for the Baltic dry index," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(8), pages 1540-1565, December.
    6. Ziaul Haque Munim & Hans-Joachim Schramm, 0. "Forecasting container freight rates for major trade routes: a comparison of artificial neural networks and conventional models," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 0, pages 1-18.
    7. Apostolos Ampountolas, 2021. "Modeling and Forecasting Daily Hotel Demand: A Comparison Based on SARIMAX, Neural Networks, and GARCH Models," Forecasting, MDPI, vol. 3(3), pages 1-16, August.
    8. Yuyun Hidayat & Titi Purwandari & Sukono & Igif Gimin Prihanto & Rizki Apriva Hidayana & Riza Andrian Ibrahim, 2023. "Mean-Value-at-Risk Portfolio Optimization Based on Risk Tolerance Preferences and Asymmetric Volatility," Mathematics, MDPI, vol. 11(23), pages 1-26, November.
    9. Chen, Haojun & Maher, Daniela, 2013. "On the predictive role of large futures trades for S&P500 index returns: An analysis of COT data as an informative trading signal," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 27(C), pages 177-201.
    10. Ziaul Haque Munim & Hans-Joachim Schramm, 2021. "Forecasting container freight rates for major trade routes: a comparison of artificial neural networks and conventional models," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 23(2), pages 310-327, June.
    11. Ioannis Papageorgiou & Ioannis Kontoyiannis, 2023. "The Bayesian Context Trees State Space Model for time series modelling and forecasting," Papers 2308.00913, arXiv.org, revised Oct 2023.
    12. Beran, Jan & Feng, Yuanhua, 1999. "Local Polynomial Estimation with a FARIMA-GARCH Error Process," CoFE Discussion Papers 99/08, University of Konstanz, Center of Finance and Econometrics (CoFE).
    13. Corbet, Shaen & Larkin, Charles & McMullan, Caroline, 2020. "The impact of industrial incidents on stock market volatility," Research in International Business and Finance, Elsevier, vol. 52(C).
    14. Cho, Guedae & Kim, MinKyoung & Koo, Won W., 2003. "Relative Agricultural Price Changes In Different Time Horizons," 2003 Annual meeting, July 27-30, Montreal, Canada 22249, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    15. Minot, Nicholas, 2014. "Food price volatility in sub-Saharan Africa: Has it really increased?," Food Policy, Elsevier, vol. 45(C), pages 45-56.
    16. Umar, Muhammad & Mirza, Nawazish & Rizvi, Syed Kumail Abbas & Furqan, Mehreen, 2023. "Asymmetric volatility structure of equity returns: Evidence from an emerging market," The Quarterly Review of Economics and Finance, Elsevier, vol. 87(C), pages 330-336.
    17. Shively, Gerald E., 2001. "Price thresholds, price volatility, and the private costs of investment in a developing country grain market," Economic Modelling, Elsevier, vol. 18(3), pages 399-414, August.
    18. Lahmiri, Salim & Bekiros, Stelios, 2017. "Disturbances and complexity in volatility time series," Chaos, Solitons & Fractals, Elsevier, vol. 105(C), pages 38-42.
    19. Hao Chen & Qiulan Wan & Yurong Wang, 2014. "Refined Diebold-Mariano Test Methods for the Evaluation of Wind Power Forecasting Models," Energies, MDPI, vol. 7(7), pages 1-14, July.
    20. Tomanova, Lucie, 2013. "Exchange Rate Volatility and the Foreign Trade in CEEC," EY International Congress on Economics I (EYC2013), October 24-25, 2013, Ankara, Turkey 267, Ekonomik Yaklasim Association.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:syseng:v:17:y:2014:i:2:p:166-192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)1520-6858 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.