IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2210.01573.html
   My bibliography  Save this paper

The Empirical Reality of IT Project Cost Overruns: Discovering A Power-Law Distribution

Author

Listed:
  • Bent Flyvbjerg
  • Alexander Budzier
  • Jong Seok Lee
  • Mark Keil
  • Daniel Lunn
  • Dirk W. Bester

Abstract

If managers assume a normal or near-normal distribution of Information Technology (IT) project cost overruns, as is common, and cost overruns can be shown to follow a power-law distribution, managers may be unwittingly exposing their organizations to extreme risk by severely underestimating the probability of large cost overruns. In this research, we collect and analyze a large sample comprised of 5,392 IT projects to empirically examine the probability distribution of IT project cost overruns. Further, we propose and examine a mechanism that can explain such a distribution. Our results reveal that IT projects are far riskier in terms of cost than normally assumed by decision makers and scholars. Specifically, we found that IT project cost overruns follow a power-law distribution in which there are a large number of projects with relatively small overruns and a fat tail that includes a smaller number of projects with extreme overruns. A possible generative mechanism for the identified power-law distribution is found in interdependencies among technological components in IT systems. We propose and demonstrate, through computer simulation, that a problem in a single technological component can lead to chain reactions in which other interdependent components are affected, causing substantial overruns. What the power law tells us is that extreme IT project cost overruns will occur and that the prevalence of these will be grossly underestimated if managers assume that overruns follow a normal or near-normal distribution. This underscores the importance of realistically assessing and mitigating the cost risk of new IT projects up front.

Suggested Citation

  • Bent Flyvbjerg & Alexander Budzier & Jong Seok Lee & Mark Keil & Daniel Lunn & Dirk W. Bester, 2022. "The Empirical Reality of IT Project Cost Overruns: Discovering A Power-Law Distribution," Papers 2210.01573, arXiv.org.
    • Handle: RePEc:arx:papers:2210.01573
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2210.01573
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nishtha Langer & Sandra A. Slaughter & Tridas Mukhopadhyay, 2014. "Project Managers' Practical Intelligence and Project Performance in Software Offshore Outsourcing: A Field Study," Information Systems Research, INFORMS, vol. 25(2), pages 364-384, June.
    2. Victoria L. Mitchell & Robert W. Zmud, 1999. "The Effects of Coupling IT and Work Process Strategies in Redesign Projects," Organization Science, INFORMS, vol. 10(4), pages 424-438, August.
    3. Daniel Kahneman & Dan Lovallo, 1993. "Timid Choices and Bold Forecasts: A Cognitive Perspective on Risk Taking," Management Science, INFORMS, vol. 39(1), pages 17-31, January.
    4. Lee, In & Lee, Kyoochun, 2015. "The Internet of Things (IoT): Applications, investments, and challenges for enterprises," Business Horizons, Elsevier, vol. 58(4), pages 431-440.
    5. Sendil K. Ethiraj & Daniel Levinthal, 2004. "Modularity and Innovation in Complex Systems," Management Science, INFORMS, vol. 50(2), pages 159-173, February.
    6. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    7. Lyra J. Colfer & Carliss Y. Baldwin, 2016. "The mirroring hypothesis: theory, evidence, and exceptions," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 25(5), pages 709-738.
    8. Pierpaolo Andriani & Bill McKelvey, 2009. "Perspective ---From Gaussian to Paretian Thinking: Causes and Implications of Power Laws in Organizations," Organization Science, INFORMS, vol. 20(6), pages 1053-1071, December.
    9. Benoit Mandelbrot, 1963. "New Methods in Statistical Economics," Journal of Political Economy, University of Chicago Press, vol. 71(5), pages 421-421.
    10. Jong Seok Lee & Mark Keil & Eliezer Shalev, 2019. "Seeing the Trees or the Forest? The Effect of IT Project Managers’ Mental Construal on IT Project Risk Management Activities," Information Systems Research, INFORMS, vol. 30(3), pages 1051-1072, September.
    11. Carliss Y. Baldwin & Kim B. Clark, 2000. "Design Rules, Volume 1: The Power of Modularity," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262024667, December.
    12. Sarma Nidumolu, 1995. "The Effect of Coordination and Uncertainty on Software Project Performance: Residual Performance Risk as an Intervening Variable," Information Systems Research, INFORMS, vol. 6(3), pages 191-219, September.
    13. Amrit Tiwana, 2009. "Governance-Knowledge Fit in Systems Development Projects," Information Systems Research, INFORMS, vol. 20(2), pages 180-197, June.
    14. Jerker Denrell & James G. March, 2001. "Adaptation as Information Restriction: The Hot Stove Effect," Organization Science, INFORMS, vol. 12(5), pages 523-538, October.
    15. Amrit Tiwana, 2015. "Evolutionary Competition in Platform Ecosystems," Information Systems Research, INFORMS, vol. 26(2), pages 266-281, June.
    16. Anandasivam Gopal & Sanjay Gosain, 2010. "Research Note ---The Role of Organizational Controls and Boundary Spanning in Software Development Outsourcing: Implications for Project Performance," Information Systems Research, INFORMS, vol. 21(4), pages 960-982, December.
    17. Ulrich, Karl, 1995. "The role of product architecture in the manufacturing firm," Research Policy, Elsevier, vol. 24(3), pages 419-440, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yuyu Chen & Paul Embrechts & Ruodu Wang, 2024. "Risk exchange under infinite-mean Pareto models," Papers 2403.20171, arXiv.org.
    2. Andrea Migone & Alexander Howlett & Michael Howlett, 2023. "The politics of military megaprojects: discursive struggles in Canadian and Australian naval shipbuilding strategies," Policy and Society, Darryl S. Jarvis and M. Ramesh, vol. 42(2), pages 226-244.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Amrit Tiwana, 2018. "Platform Synergy: Architectural Origins and Competitive Consequences," Information Systems Research, INFORMS, vol. 29(4), pages 829-848, December.
    2. Panos Constantinides & Ola Henfridsson & Geoffrey G. Parker, 2018. "Introduction—Platforms and Infrastructures in the Digital Age," Information Systems Research, INFORMS, vol. 29(2), pages 381-400, June.
    3. Fabrizio Salvador & Juan Pablo Madiedo, 2021. "Enabling Globally Distributed Projects: Effects of Project Interface Match and Related Technical Experience," Production and Operations Management, Production and Operations Management Society, vol. 30(4), pages 1052-1081, April.
    4. Tian Heong Chan & Shi-Ying Lim, 2023. "The Emergence of Novel Product Uses: An Investigation of Exaptations in IKEA Hacks," Management Science, INFORMS, vol. 69(5), pages 2870-2892, May.
    5. Battke, Benedikt & Schmidt, Tobias S. & Stollenwerk, Stephan & Hoffmann, Volker H., 2016. "Internal or external spillovers—Which kind of knowledge is more likely to flow within or across technologies," Research Policy, Elsevier, vol. 45(1), pages 27-41.
    6. Félicia Saïah & Diego Vega & Harwin de Vries & Joakim Kembro, 2023. "Process modularity, supply chain responsiveness, and moderators: The Médecins Sans Frontières response to the Covid‐19 pandemic," Production and Operations Management, Production and Operations Management Society, vol. 32(5), pages 1490-1511, May.
    7. Glenn Hoetker & Anand Swaminathan & Will Mitchell, 2007. "Modularity and the Impact of Buyer-Supplier Relationships on the Survival of Suppliers," Management Science, INFORMS, vol. 53(2), pages 178-191, February.
    8. Murmann, Johann Peter & Frenken, Koen, 2006. "Toward a systematic framework for research on dominant designs, technological innovations, and industrial change," Research Policy, Elsevier, vol. 35(7), pages 925-952, September.
    9. Daniela D. Viana & Iris D. Tommelein & Carlos T. Formoso, 2017. "Using Modularity to Reduce Complexity of Industrialized Building Systems for Mass Customization," Energies, MDPI, vol. 10(10), pages 1-17, October.
    10. Sungyong Um & Bin Zhang & Sunil Wattal & Youngjin Yoo, 2023. "Software Components and Product Variety in a Platform Ecosystem: A Dynamic Network Analysis of WordPress," Information Systems Research, INFORMS, vol. 34(4), pages 1339-1374, December.
    11. Simge Tuna & Stefano Brusoni & Anja Schulze, 2019. "Architectural knowledge generation: evidence from a field study," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 28(5), pages 977-1009.
    12. Mohsen Jafari Songhori & Madjid Tavana & Takao Terano, 2020. "Product development team formation: effects of organizational- and product-related factors," Computational and Mathematical Organization Theory, Springer, vol. 26(1), pages 88-122, March.
    13. Sungyong Chang, 2023. "Two faces of decomposability in organizational search: Evidence from singles versus albums in the music industry 1995–2015," Strategic Management Journal, Wiley Blackwell, vol. 44(7), pages 1616-1652, July.
    14. Nicholas Burton & Peter Galvin, 2020. "Component complementarity and transaction costs: the evolution of product design," Review of Managerial Science, Springer, vol. 14(4), pages 845-867, August.
    15. Erik Hartigh & Claire C.M. Stolwijk & J. Roland Ortt & L. Matthijs Punter, 2023. "Configurations of digital platforms for manufacturing: An analysis of seven cases according to platform functions and types," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-17, December.
    16. Alessandro Marino & Paolo Aversa & Luiz Mesquita & Jaideep Anand, 2015. "Driving Performance via Exploration in Changing Environments: Evidence from Formula One Racing," Organization Science, INFORMS, vol. 26(4), pages 1079-1100, August.
    17. Babak Heydari & Mohsen Mosleh & Kia Dalili, 2016. "From Modular to Distributed Open Architectures: A Unified Decision Framework," Systems Engineering, John Wiley & Sons, vol. 19(3), pages 252-266, May.
    18. Mario Benassi, 2009. "Investigating modular organizations," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 13(3), pages 163-192, August.
    19. Tian Heong Chan & Haibo Liu & Steffen Keck & Wenjie Tang, 2023. "When do teams generate valuable inventions? The moderating role of invention integrality on the effects of expertise similarity, network cohesion, and gender diversity," Production and Operations Management, Production and Operations Management Society, vol. 32(6), pages 1760-1777, June.
    20. Ashish Arora & Michelle Gittelman & Sarah Kaplan & John Lynch & Will Mitchell & Nicolaj Siggelkow & Chi-Hyon Lee & Manuela N. Hoehn-Weiss & Samina Karim, 2016. "Grouping interdependent tasks: Using spectral graph partitioning to study complex systems," Strategic Management Journal, Wiley Blackwell, vol. 37(1), pages 177-191, January.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2210.01573. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.