IDEAS home Printed from https://ideas.repec.org/a/cup/jbcoan/v12y2021i3p395-419_1.html
   My bibliography  Save this article

The Cost-Benefit Fallacy: Why Cost-Benefit Analysis Is Broken and How to Fix It

Author

Listed:
  • Flyvbjerg, Bent
  • Bester, Dirk W.

Abstract

Most cost-benefit analyses assume that the estimates of costs and benefits are more or less accurate and unbiased. But what if, in reality, estimates are highly inaccurate and biased? Then the assumption that cost-benefit analysis is a rational way to improve resource allocation would be a fallacy. Based on the largest dataset of its kind, we test the assumption that cost and benefit estimates of public investments are accurate and unbiased. We find this is not the case with overwhelming statistical significance. We document the extent of cost overruns, benefit shortfalls, and forecasting bias in public investments. We further assess whether such inaccuracies seriously distort effective resource allocation, which is found to be the case. We explain our findings in behavioral terms and explore their policy implications. Finally, we conclude that cost-benefit analysis of public investments stands in need of reform and we outline four steps to such reform.

Suggested Citation

  • Flyvbjerg, Bent & Bester, Dirk W., 2021. "The Cost-Benefit Fallacy: Why Cost-Benefit Analysis Is Broken and How to Fix It," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 12(3), pages 395-419, October.
  • Handle: RePEc:cup:jbcoan:v:12:y:2021:i:3:p:395-419_1
    as

    Download full text from publisher

    File URL: https://www.cambridge.org/core/product/identifier/S2194588821000099/type/journal_article
    File Function: link to article abstract page
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bent Flyvbjerg (ed.), 2014. "Megaproject Planning and Management: Essential Readings," Books, Edward Elgar Publishing, volume 0, number 14769.
    2. Winston Harrington & Richard D. Morgenstern & Peter Nelson, 2000. "On the accuracy of regulatory cost estimates," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(2), pages 297-322.
    3. repec:cup:judgdm:v:11:y:2016:i:5:p:509-526 is not listed on IDEAS
    4. Flyvbjerg, Bent & Ansar, Atif & Budzier, Alexander & Buhl, Søren & Cantarelli, Chantal & Garbuio, Massimo & Glenting, Carsten & Holm, Mette Skamris & Lovallo, Dan & Molin, Eric & Rønnest, Arne & Stewa, 2019. "On de-bunking “Fake News” in the post-truth era: How to reduce statistical error in research," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 409-411.
    5. Li Liu & Zigrid Napier, 2010. "The accuracy of risk-based cost estimation for water infrastructure projects: preliminary evidence from Australian projects," Construction Management and Economics, Taylor & Francis Journals, vol. 28(1), pages 89-100.
    6. Robert F. Bordley, 2014. "Reference Class Forecasting: Resolving Its Challenge to Statistical Modeling," The American Statistician, Taylor & Francis Journals, vol. 68(4), pages 221-229, November.
    7. George A. Akerlof, 2009. "How Human Psychology Drives the Economy and Why It Matters," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 91(5), pages 1175-1175.
    8. Flyvbjerg, Bent, 2016. "The Fallacy of Beneficial Ignorance: A Test of Hirschman’s Hiding Hand," World Development, Elsevier, vol. 84(C), pages 176-189.
    9. Bent Flyvbjerg, 2013. "Quality Control and Due Diligence in Project Management: Getting Decisions Right by Taking the Outside View," Papers 1302.2544, arXiv.org.
    10. Awojobi, Omotola & Jenkins, Glenn P., 2016. "Managing the cost overrun risks of hydroelectric dams: An application of reference class forecasting techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 63(C), pages 19-32.
    11. Leavitt, Dan & Ennis, Sean & McGovern, Pat, 1993. "The Cost Escalation of Rail Projects: Using Previous Experience to Re-Evaluate the CalSpeed Estimates," University of California Transportation Center, Working Papers qt2rt1w7xj, University of California Transportation Center.
    12. Flyvbjerg, Bent, 2005. "Measuring inaccuracy in travel demand forecasting: methodological considerations regarding ramp up and sampling," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(6), pages 522-530, July.
    13. Harrington, Winston, 2006. "Grading Estimates of the Benefits and Costs of Federal Regulation," RFF Working Paper Series dp-06-39, Resources for the Future.
    14. Bent Flyvbjerg, 2014. "What You Should Know About Megaprojects, and Why: An Overview," Papers 1409.0003, arXiv.org.
    15. Ansar, Atif & Flyvbjerg, Bent & Budzier, Alexander & Lunn, Daniel, 2014. "Should we build more large dams? The actual costs of hydropower megaproject development," Energy Policy, Elsevier, vol. 69(C), pages 43-56.
    16. Cantarelli, C.C. & Flyvbjerg, B. & Buhl, S.L., 2012. "Geographical variation in project cost performance: the Netherlands versus worldwide," Journal of Transport Geography, Elsevier, vol. 24(C), pages 324-331.
    17. Flyvbjerg, Bent & Ansar, Atif & Budzier, Alexander & Buhl, Søren & Cantarelli, Chantal & Garbuio, Massimo & Glenting, Carsten & Holm, Mette Skamris & Lovallo, Dan & Lunn, Daniel & Molin, Eric & Rønnes, 2018. "Five things you should know about cost overrun," Transportation Research Part A: Policy and Practice, Elsevier, vol. 118(C), pages 174-190.
    18. Ward, William A., 2019. "Cost-Benefit Analysis Theory versus Practice at the World Bank 1960 to 2015," Journal of Benefit-Cost Analysis, Cambridge University Press, vol. 10(1), pages 124-144, April.
    19. World Bank, 2010. "Cost-Benefit Analysis in World Bank Projects," World Bank Publications - Reports 10481, The World Bank Group.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Thomas H. Douthat & Fahmida Akhter & Rachelle Sanderson & Jerrod Penn, 2023. "Stakeholder Perceptions about Incorporating Externalities and Vulnerability into Benefit–Cost Analysis Tools for Watershed Flood Risk Mitigation," Sustainability, MDPI, vol. 15(9), pages 1-23, May.
    2. Ryan, Jean & Martens, Karel, 2023. "Defining and implementing a sufficient level of accessibility: What’s stopping us?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 175(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Flyvbjerg, Bent & Ansar, Atif & Budzier, Alexander & Buhl, Søren & Cantarelli, Chantal & Garbuio, Massimo & Glenting, Carsten & Holm, Mette Skamris & Lovallo, Dan & Lunn, Daniel & Molin, Eric & Rønnes, 2018. "Five things you should know about cost overrun," Transportation Research Part A: Policy and Practice, Elsevier, vol. 118(C), pages 174-190.
    2. Love, Peter E.D. & Ika, Lavagnon A. & Ahiaga-Dagbui, Dominic D., 2019. "On de-bunking ‘fake news’ in a post truth era: Why does the Planning Fallacy explanation for cost overruns fall short?," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 397-408.
    3. Bent Flyvbjerg & Cass R. Sunstein, 2015. "The Principle of the Malevolent Hiding Hand; or, the Planning Fallacy Writ Large," Papers 1509.01526, arXiv.org.
    4. Bent Flyvbjerg & Alexander Budzier, 2019. "Report for the Commission of Inquiry Respecting the Muskrat Falls Project," Papers 1901.03698, arXiv.org.
    5. Alexander Budzier & Bent Flyvbjerg & Andi Garavaglia & Andreas Leed, 2019. "Quantitative Cost and Schedule Risk Analysis of Nuclear Waste Storage," Papers 1901.11123, arXiv.org.
    6. Bent Flyvbjerg & Alexander Budzier & Daniel Lunn, 2021. "Regression to the tail: Why the Olympics blow up," Environment and Planning A, , vol. 53(2), pages 233-260, March.
    7. Flyvbjerg, Bent, 2018. "Planning Fallacy or Hiding Hand: Which is the Better Explanation?," World Development, Elsevier, vol. 103(C), pages 383-386.
    8. Jenkins, G. & Olasehinde-Williams, G. & Baurzhan, S., 2022. "Is there a net economic loss from employing reference class forecasting in the appraisal of hydropower projects?," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    9. Ika, Lavagnon A., 2018. "Beneficial or Detrimental Ignorance: The Straw Man Fallacy of Flyvbjerg’s Test of Hirschman’s Hiding Hand," World Development, Elsevier, vol. 103(C), pages 369-382.
    10. Love, Peter E.D. & Ahiaga-Dagbui, Dominic D., 2018. "Debunking fake news in a post-truth era: The plausible untruths of cost underestimation in transport infrastructure projects," Transportation Research Part A: Policy and Practice, Elsevier, vol. 113(C), pages 357-368.
    11. Love, Peter E.D. & Sing, Michael C.P. & Ika, Lavagnon A. & Newton, Sidney, 2019. "The cost performance of transportation projects: The fallacy of the Planning Fallacy account," Transportation Research Part A: Policy and Practice, Elsevier, vol. 122(C), pages 1-20.
    12. Bent Flyvbjerg, 2021. "Four Ways to Scale Up: Smart, Dumb, Forced, and Fumbled," Papers 2101.11104, arXiv.org.
    13. Callegari, C. & Szklo, A. & Schaeffer, R., 2018. "Cost overruns and delays in energy megaprojects: How big is big enough?," Energy Policy, Elsevier, vol. 114(C), pages 211-220.
    14. Schreiner, Lena & Madlener, Reinhard, 2022. "Investing in power grid infrastructure as a flexibility option: A DSGE assessment for Germany," Energy Economics, Elsevier, vol. 107(C).
    15. Flyvbjerg, Bent & Ansar, Atif & Budzier, Alexander & Buhl, Søren & Cantarelli, Chantal & Garbuio, Massimo & Glenting, Carsten & Holm, Mette Skamris & Lovallo, Dan & Molin, Eric & Rønnest, Arne & Stewa, 2019. "On de-bunking “Fake News” in the post-truth era: How to reduce statistical error in research," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 409-411.
    16. Bent Flyvbjerg & Alexander Budzier, 2018. "Report for the Edinburgh Tram Inquiry," Papers 1805.12106, arXiv.org.
    17. Ginés de Rus & Javier Campos & Daniel Graham & M. Pilar Socorro & Jorge Valido, 2020. "Evaluación Económica de Proyectos y Políticas de Transporte: Metodología y Aplicaciones. Parte 1: Metodología para el análisis coste-beneficio de proyectos y políticas de transporte," Working Papers 2020-11, FEDEA.
    18. Atif Ansar & Bent Flyvbjerg & Alexander Budzier & Daniel Lunn, 2016. "Does infrastructure investment lead to economic growth or economic fragility? Evidence from China," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 32(3), pages 360-390.
    19. Rothengatter, Werner, 2019. "Megaprojects in transportation networks," Transport Policy, Elsevier, vol. 75(C), pages 1-15.
    20. Anuja Shaktawat & Shelly Vadhera, 2021. "Risk management of hydropower projects for sustainable development: a review," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(1), pages 45-76, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cup:jbcoan:v:12:y:2021:i:3:p:395-419_1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Kirk Stebbing (email available below). General contact details of provider: https://www.cambridge.org/bca .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.