IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.26034.html

Falling Behind Drives Unsafe Development in an Idealised AI Race Experiment

Author

Listed:
  • Elias Fern'andez Domingos
  • The Anh Han

Abstract

Technological races create tension between speed and safety: actors may gain by moving faster than competitors, even when risky development is harmful. This is prominent in debates about artificial intelligence (AI), where competitive pressure is often argued to incentivise riskier, less safety-conscious development. We study this using a framed behavioural experiment based on an idealised AI race, in which paired participants repeatedly chose between Safe and Unsafe development under an uncertain time horizon. Unsafe development gave faster progress and higher immediate payoffs but accumulated private risk up to a treatment-specific maximum of 10\%, 60\%, or 90\%; the race's competitive structure was held constant, and only this maximum risk varied. Neither the pre-registered comparison between risk levels nor the role of elicited risk preferences was supported by the data. Instead, exploratory analyses motivated by the task's repeated structure show that Unsafe behaviour is shaped less by risk preferences than by the evolving strategic state of the race: participants are more likely to choose Unsafe after their opponent does so, being ahead reduces Unsafe play while falling behind increases it, and first-round choices predict later behaviour. To interpret these effects we introduce a reduced evolutionary model with four strategies -- Always Safe, Always Unsafe, Conditionally Safe, and Conditionally Antisocial Safe -- which reproduces the treatment effect and shows how conditional Unsafe behaviour can be favoured by competitive race dynamics. Together, the experiment and model show that unsafe development can emerge from early behavioural momentum, opponent behaviour, and fear of falling behind, rather than from risk preferences alone, suggesting policy should focus on reducing competitive pressure and promoting cooperation in AI development rather than only individual risk.

Suggested Citation

  • Elias Fern'andez Domingos & The Anh Han, 2026. "Falling Behind Drives Unsafe Development in an Idealised AI Race Experiment," Papers 2607.26034, arXiv.org.
  • Handle: RePEc:arx:papers:2607.26034
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.26034
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philippe Aghion & Nick Bloom & Richard Blundell & Rachel Griffith & Peter Howitt, 2005. "Competition and Innovation: an Inverted-U Relationship," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 120(2), pages 701-728.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicholas Bloom & Raffaella Sadun & John Van Reenen, 2015. "Do Private Equity Owned Firms Have Better Management Practices?," American Economic Review, American Economic Association, vol. 105(5), pages 442-446, May.
    2. Herrmann, Roland & Schröck, Rebecca, 2011. "Determinanten des Innovationserfolgs: eine Analyse mit Scannerdaten für den deutschen Joghurtmarkt," German Journal of Agricultural Economics, Humboldt-Universitaet zu Berlin, Department for Agricultural Economics, vol. 60(03), pages 1-16, August.
    3. Liliana Meza-González & Jaime Marie Sepulveda, 2019. "The impact of competition with China in the US market on innovation in Mexican manufacturing firms," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 28(1), pages 1-21, December.
    4. Patrick Legros & Andrew F. Newman & Eugenio Proto, 2014. "Smithian Growth through Creative Organization," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 796-811, December.
    5. Kumar, Sanjesh & Singh, Baljeet, 2019. "Barriers to the international diffusion of technological innovations," Economic Modelling, Elsevier, vol. 82(C), pages 74-86.
    6. Tomaso Duso & Martin Peitz, 2026. "Aligning Competition Policy and Industrial Policy in the EU ±," Journal of Industry, Competition and Trade, Springer, vol. 26(1), pages 1-35, December.
    7. Benjamin Montmartin & Nadine Massard, 2015. "Is Financial Support For Private R&D Always Justified? A Discussion Based On The Literature On Growth," Journal of Economic Surveys, Wiley Blackwell, vol. 29(3), pages 479-505, July.
    8. Aurelien Portuese, 2020. "Beyond antitrust populism: Towards robust antitrust," Economic Affairs, Wiley Blackwell, vol. 40(2), pages 237-258, June.
    9. Yi-Ling Cheng & Juin-Jen Chang, 2017. "The Quality of Intermediate Goods: Growth and Welfare Implications," The Economic Record, The Economic Society of Australia, vol. 93(302), pages 434-447, September.
    10. Christos A Makridis & Andrew A Borkowski & Gil Alterovitz, 2024. "Perspectives on advancing innovation and human flourishing through a network of AI institutes," Science and Public Policy, Oxford University Press, vol. 51(3), pages 557-562.
    11. Kiatipong Ariyapruchya & Cheerapan O-lanthanasate & Chatsurang Karnchanasai, 2006. "Strengthening the Competitiveness of Thai Firms: What Needs to be Done?," Working Papers 2006-03, Monetary Policy Group, Bank of Thailand.
    12. Qing Li & Long Hai Vo, 2021. "Intangible Capital and Innovation: An Empirical Analysis of Vietnamese Enterprises," Economics Discussion / Working Papers 21-02, The University of Western Australia, Department of Economics.
    13. Rania Missaoui & Aymen Ajina, 2026. "Firm dynamics in corrupt environments: the case of the BRICS countries," SN Business & Economics, Springer, vol. 6(2), pages 1-38, February.
    14. Steven Bond‐Smith, 2022. "Discretely innovating: The effect of limited market contestability on innovation and growth," Scottish Journal of Political Economy, Scottish Economic Society, vol. 69(3), pages 301-327, July.
    15. Saka Jimoh Olakunle, 2023. "Digital Technology and Trade Performance in Sub-Saharan Africa," Journal of Applied Economic Research, Graduate School of Economics and Management, Ural Federal University, vol. 22(3), pages 480-496.
    16. Ufuk Akcigit & Sina T. Ates, 2023. "What Happened to US Business Dynamism?," Journal of Political Economy, University of Chicago Press, vol. 131(8), pages 2059-2124.
    17. Sourafel Girma & Yundan Gong & Holger Görg, 2016. "Foreign Direct Investment, Access to Finance, and Innovation Activity in Chinese Enterprises," World Scientific Book Chapters, in: MULTINATIONAL ENTERPRISES AND HOST COUNTRY DEVELOPMENT Volume 53: World Scientific Studies in International Economics, chapter 5, pages 79-94, World Scientific Publishing Co. Pte. Ltd..
    18. Alberto BUCCI, 2004. "Economic growth in an enlarged Europe: the human capital and R&D dimensions," Departmental Working Papers 2004-22, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    19. repec:use:tkiwps:1818 is not listed on IDEAS
    20. de Rassenfosse, Gaétan & Schoen, Anja & Wastyn, Annelies, 2014. "Selection bias in innovation studies: A simple test," Technological Forecasting and Social Change, Elsevier, vol. 81(C), pages 287-299.
    21. Blomkvist, Katarina & Engzell, Jeanette & Kappen, Philip & Zander, Ivo, 2024. "How organizational conditions affect employees’ intentions to engage in intrapreneurial new venturing," Technovation, Elsevier, vol. 135(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.26034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.