IDEAS home Printed from https://ideas.repec.org/a/spr/joiaen/v14y2025i1d10.1186_s13731-025-00527-3.html
   My bibliography  Save this article

Comparative analysis of leading artificial intelligence chatbots in the context of entrepreneurship

Author

Listed:
  • Firuz Kamalov

    (Canadian University Dubai)

  • David Santandreu Calonge

    (Mohamed Bin Zayed University of Artificial Intelligence)

  • Patrik T. Hultberg

    (Kalamazoo College)

  • Linda Smail

    (Zayed University)

  • Dima Jamali

    (Canadian University Dubai)

Abstract

Artificial intelligence (AI) chatbots show remarkable abilities across applications. Despite a growing literature, their capability in the field of entrepreneurship is not fully understood. The aim of this study is to empirically evaluate and compare capabilities of five major AI chatbots—GPT-3.5, GPT-4, Gemini 1.0, Llama 2, and Claude—in the context of entrepreneurship theory, using a benchmark entrepreneurship test. In particular, the performance of the chatbots on a set of multiple-choice questions, short-answer questions, and essay questions related to entrepreneurship is assessed. The results indicate that GPT-4 delivers the strongest overall performance. Meanwhile, Llama 2 offers precise responses with a significantly lower word count compared to the GPT models. Although chatbots do not always provide correct or precise answers to questions or complex prompts, they still prove to be valuable analytical tools for entrepreneurs. While the study offers compelling insights into chatbots’ grasp of entrepreneurship concepts, the findings are somewhat limited by the scarce availability of data.

Suggested Citation

  • Firuz Kamalov & David Santandreu Calonge & Patrik T. Hultberg & Linda Smail & Dima Jamali, 2025. "Comparative analysis of leading artificial intelligence chatbots in the context of entrepreneurship," Journal of Innovation and Entrepreneurship, Springer, vol. 14(1), pages 1-27, December.
    • Handle: RePEc:spr:joiaen:v:14:y:2025:i:1:d:10.1186_s13731-025-00527-3
    DOI: 10.1186/s13731-025-00527-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1186/s13731-025-00527-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1186/s13731-025-00527-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Linda Smail & Mouawiya Alawad & Wasseem Abaza & Firuz Kamalov & Hamdah Alawadhi, 2022. "Learning A Bayesian Structure to Model Entrepreneurial Intentions and Attitudes Toward Business Creation among Emirati Students," Working Papers 1583, Economic Research Forum, revised 20 Sep 2022.
    2. Shepherd, Dean A. & Majchrzak, Ann, 2022. "Machines augmenting entrepreneurs: Opportunities (and threats) at the Nexus of artificial intelligence and entrepreneurship," Journal of Business Venturing, Elsevier, vol. 37(4).
    3. Michael Gofman & Zhao Jin, 2024. "Artificial Intelligence, Education, and Entrepreneurship," Journal of Finance, American Finance Association, vol. 79(1), pages 631-667, February.
    4. Firuz Kamalov & David Santandreu Calonge & Ikhlaas Gurrib, 2023. "New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution," Sustainability, MDPI, vol. 15(16), pages 1-27, August.
    5. Wayne Geerling & G. Dirk Mateer & Jadrian Wooten & Nikhil Damodaran, 2023. "ChatGPT has Aced the Test of Understanding in College Economics: Now What?," The American Economist, Sage Publications, vol. 68(2), pages 233-245, October.
    6. Linda Smail & Mouawiya Alawad & Aleciane da Silva Moreira Ferreira & Jorge López Puga & Ana María Ruiz-Ruano García, 2022. "Determinants of Entrepreneurial Risk among Young Emiratis," Sustainability, MDPI, vol. 14(22), pages 1-21, November.
    7. Neil A. Thompson & Karen Verduijn & William B. Gartner, 2020. "Entrepreneurship-as-practice: grounding contemporary theories of practice into entrepreneurship studies," Entrepreneurship & Regional Development, Taylor & Francis Journals, vol. 32(3-4), pages 247-256, March.
    8. David Urbano & Sebastian Aparicio & David Audretsch, 2019. "Twenty-five years of research on institutions, entrepreneurship, and economic growth: what has been learned?," Small Business Economics, Springer, vol. 53(1), pages 21-49, June.
    9. Rizomyliotis, Ioannis & Kastanakis, Minas N. & Giovanis, Apostolos & Konstantoulaki, Kleopatra & Kostopoulos, Ioannis, 2022. "“How mAy I help you today?” The use of AI chatbots in small family businesses and the moderating role of customer affective commitment," Journal of Business Research, Elsevier, vol. 153(C), pages 329-340.
    10. Alexander Fichter & Kiril Anguelov, 2024. "Information communication promoting insurance sales: use of chatbot technologies," Entrepreneurship and Sustainability Issues, VsI Entrepreneurship and Sustainability Center, vol. 11(4), pages 10-30, June.
    11. Dominic Chalmers & Niall G. MacKenzie & Sara Carter, 2021. "Artificial Intelligence and Entrepreneurship: Implications for Venture Creation in the Fourth Industrial Revolution," Entrepreneurship Theory and Practice, , vol. 45(5), pages 1028-1053, September.
    12. Wood, David A. & Achhpilia, Muskan P. & Adams, Mollie T. & Aghazadeh, Sanaz & Akinyele, Kazeem & Akpan, Mfon & Allee, Kristian D. & Allen, Abigail M. & Almer, Elizabeth D. & Ames, Daniel & Arity, Vikt, 2023. "The ChatGPT artificial intelligence chatbot: How well does it answer accounting assessment questions?," Other publications TiSEM b4a29b3e-18a1-4259-a70c-d, Tilburg University, School of Economics and Management.
    13. Navaneetha Krishnan Rajagopal & Naila Iqbal Qureshi & S. Durga & Edwin Hernan Ramirez Asis & Rosario Mercedes Huerta Soto & Shashi Kant Gupta & S. Deepak & Muhammad Ahmad, 2022. "Future of Business Culture: An Artificial Intelligence-Driven Digital Framework for Organization Decision-Making Process," Complexity, Hindawi, vol. 2022, pages 1-14, July.
    14. Short, Cole E. & Short, Jeremy C., 2023. "The artificially intelligent entrepreneur: ChatGPT, prompt engineering, and entrepreneurial rhetoric creation," Journal of Business Venturing Insights, Elsevier, vol. 19(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frank M. Fossen & Trevor McLemore & Alina Sorgner, 2024. "Artificial Intelligence and Entrepreneurship," Foundations and Trends(R) in Entrepreneurship, now publishers, vol. 20(8), pages 781-904, December.
    2. Davidsson, Per & Sufyan, Muhammad, 2023. "What does AI think of AI as an external enabler (EE) of entrepreneurship? An assessment through and of the EE framework," Journal of Business Venturing Insights, Elsevier, vol. 20(C).
    3. Martin Obschonka & Moren Levesque, 2024. "A Market for Lemons? Strategic Directions for a Vigilant Application of Artificial Intelligence in Entrepreneurship Research," Papers 2409.08890, arXiv.org.
    4. D'Al, Francesco & Santarelli, Enrico & Vivarelli, Marco, 2024. "The KSTE+I approach and the advent of AI technologies: evidence from the European regions," GLO Discussion Paper Series 1473, Global Labor Organization (GLO).
    5. Thorsten Lammers & Dilek Cetindamar & Maren Borkert, 2021. "A Digital Tale of Two Cities—Observing the Dynamics of the Artificial Intelligence Ecosystems in Berlin and Sydney," Sustainability, MDPI, vol. 13(19), pages 1-19, September.
    6. Cyrine Ben-Hafaïedh & Mirela Xheneti & Pekka Stenholm & Robert Blackburn & Friederike Welter & David Urbano, 2024. "The interplay of context and entrepreneurship: the new frontier for contextualisation research," Small Business Economics, Springer, vol. 62(2), pages 571-582, February.
    7. Shore, Adam & Tiwari, Manisha & Tandon, Priyanka & Foropon, Cyril, 2024. "Building entrepreneurial resilience during crisis using generative AI: An empirical study on SMEs," Technovation, Elsevier, vol. 135(C).
    8. Ari Hyytinen & Petri Rouvinen & Mika Pajarinen & Joosua Virtanen, 2023. "Ex Ante Predictability of Rapid Growth: A Design Science Approach," Entrepreneurship Theory and Practice, , vol. 47(6), pages 2465-2493, November.
    9. Francesco D'Alessandro & Enrico Santarelli & Marco Vivarelli, 2024. "The KSTE+I approach and the AI technologies," DISCE - Working Papers del Dipartimento di Politica Economica dipe0039, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    10. Natalie Brose & Christian Spielmann & Christian Tode, 2025. "ChatGPT as Economics Tutor: Capabilities and Limitations," Bristol Economics Discussion Papers 25/786, School of Economics, University of Bristol, UK.
    11. D’Alessandro, Francesco & Santarelli, Enrico & Vivarelli, Marco, 2024. "The Knowledge Spillover Theory of Entrepreneurship and Innovation (KSTE+I) Approach and the Advent of AI Technologies: Evidence from the European Regions," IZA Discussion Papers 17206, Institute of Labor Economics (IZA).
    12. Patrik T Hultberg & David Santandreu Calonge & Firuz Kamalov & Linda Smail, 2024. "Comparing and assessing four AI chatbots’ competence in economics," PLOS ONE, Public Library of Science, vol. 19(5), pages 1-20, May.
    13. Lupp, Daniel, 2023. "Effectuation, causation, and machine learning in co-creating entrepreneurial opportunities," Journal of Business Venturing Insights, Elsevier, vol. 19(C).
    14. Robertson, Jeandri & Ferreira, Caitlin & Botha, Elsamari & Oosthuizen, Kim, 2024. "Game changers: A generative AI prompt protocol to enhance human-AI knowledge co-construction," Business Horizons, Elsevier, vol. 67(5), pages 499-510.
    15. Wei Wang & Kehui Wei & Oleksandr Kubatko & Vladyslav Piven & Yulija Chortok & Oleksandr Derykolenko, 2023. "Economic Growth and Sustainable Transition: Investigating Classical and Novel Factors in Developed Countries," Sustainability, MDPI, vol. 15(16), pages 1-15, August.
    16. Francisco Olmo-García & Fernando Javier Crecente-Romero & María Teresa Val-Núñez & María Sarabia-Alegría, 2023. "Entrepreneurial activity in an environment of digital transformation: an analysis of relevant factors in the euro area," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-10, December.
    17. Gaygysyz Ashyrov & Denis Ivanov, 2024. "Mega‐events and human rights violations: Empirical evidence from the long‐term perspective," Scottish Journal of Political Economy, Scottish Economic Society, vol. 71(2), pages 175-196, May.
    18. Naima SAHLI & Khaldia BOUGHENA & Amina ABDELHADI, 2024. "A Systematic Review Of Empirical Studies On The Impact Of Artificial Intelligence On University Students’ Writing Skills," Annals of the University of Craiova, Series Psychology, Pedagogy, Teacher Training Department, University of Craiova, vol. 46(2), pages 285-297, December.
    19. Alterskye, Alex & Fuller, Ted & Caputo, Andrea, 2023. "Field dynamics as context – A multi-perspective combined analysis of the effects of context on entrepreneurship," Journal of Business Venturing Insights, Elsevier, vol. 20(C).
    20. Li, Sen & Chen, Yan, 2024. "Governing decentralized autonomous organizations as digital commons," Journal of Business Venturing Insights, Elsevier, vol. 21(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:joiaen:v:14:y:2025:i:1:d:10.1186_s13731-025-00527-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.