IDEAS home Printed from https://ideas.repec.org/a/inm/orinte/v53y2023i3p192-206.html
   My bibliography  Save this article

Improving Software Development Effort Estimation with a Novel Design Pattern Model

Author

Listed:
  • Chidambaram Subbiah

    (Edward Jones, St. Louis, Missouri 63131)

  • Andrea C. Hupman

    (Supply Chain and Analytics Department, University of Missouri-St. Louis, St. Louis, Missouri 63121)

  • Haitao Li

    (Supply Chain and Analytics Department, University of Missouri-St. Louis, St. Louis, Missouri 63121)

  • Joseph Simonis

    (Edward Jones, St. Louis, Missouri 63131)

Abstract

A U.S. Midwestern Fortune 500 financial services firm develops software capabilities in-house and requires predictions of project needs for efficient resource allocation decisions across the many projects operating simultaneously. The company develops a novel prediction tool based on the projects’ required software development tasks as described by firm-specific design patterns. The firm provides these predictions within a set of estimates based on industry standard function count methods as well as firm-specific predictive models based on function points and on initial labor assignments. Company management is thus equipped with predictions from multiple methodologies and multiple information sources, enhancing the firm’s ability to predict project needs. Managers aggregate the forecasts, with prediction performance estimated to improve by 35%–49%, measured relative to estimates of the absolute percentage error of the prior method. The improved predictions provide a significant advantage to planning decisions and efficient internal operations. Insights to how managers aggregate the set of forecasts and insights to how the models contribute to the scaled value of information are discussed and further illustrate the benefits of the approach.

Suggested Citation

  • Chidambaram Subbiah & Andrea C. Hupman & Haitao Li & Joseph Simonis, 2023. "Improving Software Development Effort Estimation with a Novel Design Pattern Model," Interfaces, INFORMS, vol. 53(3), pages 192-206, May.
    • Handle: RePEc:inm:orinte:v:53:y:2023:i:3:p:192-206
    DOI: 10.1287/inte.2022.1138
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/inte.2022.1138
    Download Restriction: no
    File URL: https://libkey.io/10.1287/inte.2022.1138?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Debarun Bhattacharjya & Jo Eidsvik & Tapan Mukerji, 2013. "The Value of Information in Portfolio Problems with Dependent Projects," Decision Analysis, INFORMS, vol. 10(4), pages 341-351, December.
    2. Thomas Eppel & Detlof von Winterfeldt, 2008. "Value-of-Information Analysis for Nuclear Waste Storage Tanks," Decision Analysis, INFORMS, vol. 5(3), pages 157-167, September.
    3. Saurabh Bansal & Genaro J. Gutierrez, 2020. "Estimating Uncertainties Using Judgmental Forecasts with Expert Heterogeneity," Operations Research, INFORMS, vol. 68(2), pages 363-380, March.
    4. Saurabh Bansal & Genaro J. Gutierrez & John R. Keiser, 2017. "Using Experts’ Noisy Quantile Judgments to Quantify Risks: Theory and Application to Agribusiness," Operations Research, INFORMS, vol. 65(5), pages 1115-1130, October.
    5. Gould, John P., 1974. "Risk, stochastic preference, and the value of information," Journal of Economic Theory, Elsevier, vol. 8(1), pages 64-84, May.
    6. Eva Regnier, 2018. "Probability Forecasts Made at Multiple Lead Times," Management Science, INFORMS, vol. 64(5), pages 2407-2426, May.
    7. Srinivas Bollapragada & Salil Gupta & Brett Hurwitz & Paul Miles & Rajesh Tyagi, 2008. "NBC-Universal Uses a Novel Qualitative Forecasting Technique to Predict Advertising Demand," Interfaces, INFORMS, vol. 38(2), pages 103-111, April.
    8. Cipriano Santos & Tere Gonzalez & Haitao Li & Kay-Yut Chen & Dirk Beyer & Sundaresh Biligi & Qi Feng & Ravindra Kumar & Shelen Jain & Ranga Ramanujam & Alex Zhang, 2013. "HP Enterprise Services Uses Optimization for Resource Planning," Interfaces, INFORMS, vol. 43(2), pages 152-169, April.
    9. Sun, Zhengwei & Hupman, Andrea C. & Abbas, Ali E., 2021. "The value of information for price dependent demand," European Journal of Operational Research, Elsevier, vol. 288(2), pages 511-522.
    10. Robert T. Clemen & Robert L. Winkler, 1985. "Limits for the Precision and Value of Information from Dependent Sources," Operations Research, INFORMS, vol. 33(2), pages 427-442, April.
    11. Jeffrey Keisler, 2004. "Value of Information in Portfolio Decision Analysis," Decision Analysis, INFORMS, vol. 1(3), pages 177-189, September.
    12. Ali E. Abbas & N. Onur Bakır & Georgia-Ann Klutke & Zhengwei Sun, 2013. "Effects of Risk Aversion on the Value of Information in Two-Action Decision Problems," Decision Analysis, INFORMS, vol. 10(3), pages 257-275, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rakesh K. Sarin, 2013. "From the Editor —Optimal Betting, Reducing Unnecessary Mammography in Breast Cancer Diagnosis, Product Line Design, and Value of Information," Decision Analysis, INFORMS, vol. 10(3), pages 187-188, September.
    2. Vilkkumaa, Eeva & Liesiö, Juuso & Salo, Ahti, 2014. "Optimal strategies for selecting project portfolios using uncertain value estimates," European Journal of Operational Research, Elsevier, vol. 233(3), pages 772-783.
    3. L. Robin Keller & Ali Abbas & Manel Baucells & Vicki M. Bier & David Budescu & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Ahti Salo & George Wu, 2010. "From the Editors..," Decision Analysis, INFORMS, vol. 7(4), pages 327-330, December.
      • L. Robin Keller & Manel Baucells & Kevin F. McCardle & Gregory S. Parnell & Ahti Salo, 2007. "From the Editors..," Decision Analysis, INFORMS, vol. 4(4), pages 173-175, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2008. "From the Editors..," Decision Analysis, INFORMS, vol. 5(4), pages 173-176, December.
      • L. Robin Keller & Manel Baucells & John C. Butler & Philippe Delquié & Jason R. W. Merrick & Gregory S. Parnell & Ahti Salo, 2009. "From the Editors ..," Decision Analysis, INFORMS, vol. 6(4), pages 199-201, December.
    4. Sulian Wang & Chen Wang, 2021. "Quantile Judgments of Lognormal Losses: An Experimental Investigation," Decision Analysis, INFORMS, vol. 18(1), pages 78-99, March.
    5. Gary J. Summers, 2021. "Friction and Decision Rules in Portfolio Decision Analysis," Decision Analysis, INFORMS, vol. 18(2), pages 101-120, June.
    6. Sun, Zhengwei & Hupman, Andrea C. & Abbas, Ali E., 2021. "The value of information for price dependent demand," European Journal of Operational Research, Elsevier, vol. 288(2), pages 511-522.
    7. Anil Gaba & Dana G. Popescu & Zhi Chen, 2019. "Assessing Uncertainty from Point Forecasts," Management Science, INFORMS, vol. 65(1), pages 90-106, January.
    8. Haag, Fridolin & Chennu, Arjun, 2023. "Assessing whether decisions are more sensitive to preference or prediction uncertainty with a value of information approach," Omega, Elsevier, vol. 121(C).
    9. Robert L. Winkler & Yael Grushka-Cockayne & Kenneth C. Lichtendahl Jr. & Victor Richmond R. Jose, 2019. "Probability Forecasts and Their Combination: A Research Perspective," Decision Analysis, INFORMS, vol. 16(4), pages 239-260, December.
    10. L. Robin Keller, 2008. "From the Editor..," Decision Analysis, INFORMS, vol. 5(3), pages 113-115, September.
    11. James K. Hammitt & Alexander I. Shlyakhter, 1999. "The Expected Value of Information and the Probability of Surprise," Risk Analysis, John Wiley & Sons, vol. 19(1), pages 135-152, February.
    12. Anthony Michael Barrett, 2017. "Value of Global Catastrophic Risk (GCR) Information: Cost-Effectiveness-Based Approach for GCR Reduction," Decision Analysis, INFORMS, vol. 14(3), pages 187-203, September.
    13. Debarun Bhattacharjya & Léa A. Deleris, 2014. "The Value of Information in Some Variations of the Stopping Problem," Decision Analysis, INFORMS, vol. 11(3), pages 189-203, September.
    14. Lance W. Saunders & J. Paul Brooks & Jason R. W. Merrick & Chad W. Autry, 2020. "Addressing Economic/Environmental Sustainability Trade‐offs in Procurement Episodes with Industrial Suppliers," Production and Operations Management, Production and Operations Management Society, vol. 29(5), pages 1256-1269, May.
    15. Niyazi Onur Bakir, 2015. "Monotonicity of the Selling Price of Information with Risk Aversion in Two Action Decision Problems," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 7(2), pages 71-90, June.
    16. James K. Hammitt & Yifan Zhang, 2013. "Combining Experts’ Judgments: Comparison of Algorithmic Methods Using Synthetic Data," Risk Analysis, John Wiley & Sons, vol. 33(1), pages 109-120, January.
    17. Xiaoyi Liu & Jonghyun Lee & Peter Kitanidis & Jack Parker & Ungtae Kim, 2012. "Value of Information as a Context-Specific Measure of Uncertainty in Groundwater Remediation," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 26(6), pages 1513-1535, April.
    18. A. E. Ades & Karl Claxton & Mark Sculpher, 2006. "Evidence synthesis, parameter correlation and probabilistic sensitivity analysis," Health Economics, John Wiley & Sons, Ltd., vol. 15(4), pages 373-381, April.
    19. Alan Brennan & Samer Kharroubi & Anthony O'Hagan & Jim Chilcott, 2007. "Calculating Partial Expected Value of Perfect Information via Monte Carlo Sampling Algorithms," Medical Decision Making, , vol. 27(4), pages 448-470, July.
    20. Eva D. Regnier, 2020. "What Is Six Hours Worth? The Impact of Lead Time on Tropical-Storm Preparation Decisions," Decision Analysis, INFORMS, vol. 17(1), pages 9-23, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orinte:v:53:y:2023:i:3:p:192-206. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.