IDEAS home Printed from https://ideas.repec.org/a/bla/sysdyn/v40y2024i3ne1772.html
   My bibliography  Save this article

Integrating AI language models in qualitative research: Replicating interview data analysis with ChatGPT

Author

Listed:
  • Mohammad S. Jalali
  • Ali Akhavan

Abstract

The recent advent of artificial intelligence (AI) language tools like ChatGPT has opened up new opportunities in qualitative research. We revisited a previous project on obesity prevention interventions, where we developed a causal loop diagram through in‐depth interview data analysis. Utilizing ChatGPT in our replication process, we compared its results against our original approach. We discuss that ChatGPT contributes to improved efficiency and unbiased data processing; however, it also reveals limitations in context understanding. Our findings suggest that AI language tools currently have great potential to serve as an augmentative tool rather than a replacement for the intricate analytical tasks performed by humans. With ongoing advancements, AI technologies may soon offer more substantial support in enhancing qualitative research capabilities, an area that deserves more investigation. © 2024 The Authors. System Dynamics Review published by John Wiley & Sons Ltd on behalf of System Dynamics Society.

Suggested Citation

  • Mohammad S. Jalali & Ali Akhavan, 2024. "Integrating AI language models in qualitative research: Replicating interview data analysis with ChatGPT," System Dynamics Review, System Dynamics Society, vol. 40(3), July.
    • Handle: RePEc:bla:sysdyn:v:40:y:2024:i:3:n:e1772
    DOI: 10.1002/sdr.1772
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sdr.1772
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sdr.1772?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ashwin,Julian & Chhabra,Aditya & Rao,Vijayendra, 2023. "Using Large Language Models for Qualitative Analysis can Introduce Serious Bias," Policy Research Working Paper Series 10597, The World Bank.
    2. Mohammad S. Jalali & Hazhir Rahmandad & Sally Lawrence Bullock & Alice Ammerman, 2017. "Dynamics of Implementation and Maintenance of Organizational Health Interventions," IJERPH, MDPI, vol. 14(8), pages 1-24, August.
    3. Jalali, Mohammad S. & Rahmandad, Hazhir & Bullock, Sally Lawrence & Lee-Kwan, Seung Hee & Gittelsohn, Joel & Ammerman, Alice, 2019. "Dynamics of intervention adoption, implementation, and maintenance inside organizations: The case of an obesity prevention initiative," Social Science & Medicine, Elsevier, vol. 224(C), pages 67-76.
    4. Dowling, Michael & Lucey, Brian, 2023. "ChatGPT for (Finance) research: The Bananarama Conjecture," Finance Research Letters, Elsevier, vol. 53(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McGill, Elizabeth & Er, Vanessa & Penney, Tarra & Egan, Matt & White, Martin & Meier, Petra & Whitehead, Margaret & Lock, Karen & Anderson de Cuevas, Rachel & Smith, Richard & Savona, Natalie & Rutter, 2021. "Evaluation of public health interventions from a complex systems perspective: A research methods review," Social Science & Medicine, Elsevier, vol. 272(C).
    2. Sebastian del Busto & Inés Galindo & Juan Jesús Hernandez & Francisco Camarelles & Esther Nieto & Águeda Caballero & María Sandín Vázquez, 2019. "Creating a Collaborative Platform for the Development of Community Interventions to Prevent Non-Communicable Diseases," IJERPH, MDPI, vol. 16(5), pages 1-14, February.
    3. Fu, Chao & Luo, Dianying & Zhang, Jiaoshu & Li, Wenxia, 2025. "Tax incentives, marketization level, and corporate digital transformation," International Review of Economics & Finance, Elsevier, vol. 97(C).
    4. Smales, Lee A., 2023. "Classification of RBA monetary policy announcements using ChatGPT," Finance Research Letters, Elsevier, vol. 58(PC).
    5. Ali Trabelsi Karoui & Sonia Sayari & Wael Dammak & Ahmed Jeribi, 2024. "Unveiling Outperformance: A Portfolio Analysis of Top AI-Related Stocks against IT Indices and Robotics ETFs," Risks, MDPI, vol. 12(3), pages 1-21, March.
    6. Wei, Tian & Wu, Han & Chu, Gang, 2023. "Is ChatGPT competent? Heterogeneity in the cognitive schemas of financial auditors and robots," International Review of Economics & Finance, Elsevier, vol. 88(C), pages 1389-1396.
    7. Hassnian Ali & Ahmet Faruk Aysan, 2023. "What will ChatGPT revolutionize in the financial industry?," Modern Finance, Modern Finance Institute, vol. 1(1), pages 116-129.
    8. Darko B. Vuković & Senanu Dekpo-Adza & Stefana Matović, 2025. "AI integration in financial services: a systematic review of trends and regulatory challenges," Palgrave Communications, Palgrave Macmillan, vol. 12(1), pages 1-29, December.
    9. Feng, Ruonan & Ma, Lu & Wu, Dan, 2025. "ESG performance and corporate innovation under the moderating effect of firm size," International Review of Economics & Finance, Elsevier, vol. 97(C).
    10. Raghu Raman & Hiran H Lathabai & Santanu Mandal & Payel Das & Tavleen Kaur & Prema Nedungadi, 2024. "ChatGPT: Literate or intelligent about UN sustainable development goals?," PLOS ONE, Public Library of Science, vol. 19(4), pages 1-27, April.
    11. Alonso-Robisco, Andres & Carbó, José Manuel, 2023. "Analysis of CBDC narrative by central banks using large language models," Finance Research Letters, Elsevier, vol. 58(PC).
    12. Christian Fieberg & Lars Hornuf & David J. Streich, 2023. "Using GPT-4 for Financial Advice," CESifo Working Paper Series 10529, CESifo.
    13. Li-Yuan Huang & Xun Zhang & Qiang Wang & Zhen-Song Chen & Yang Liu, 2024. "Evaluating Media Knowledge Capabilities of Intelligent Search Dialogue Systems: A Case Study of ChatGPT and New Bing," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(4), pages 17284-17307, December.
    14. Jeong, Woojin & Park, Seongwan & Lee, Seungyun & Son, Bumho & Lee, Jaewook & Ko, Hyungjin, 2024. "Influence and predictive power of sentiment: Evidence from the lithium market," Finance Research Letters, Elsevier, vol. 68(C).
    15. Boelsen-Robinson, Tara & Blake, Miranda R. & Brown, Andrew D. & Huse, Oliver & Palermo, Claire & George, Neetu A. & Peeters, Anna, 2021. "Mapping factors associated with a successful shift towards healthier food retail in community-based organisations: A systems approach," Food Policy, Elsevier, vol. 101(C).
    16. Negar Darabi & Niyousha Hosseinichimeh, 2020. "System dynamics modeling in health and medicine: a systematic literature review," System Dynamics Review, System Dynamics Society, vol. 36(1), pages 29-73, January.
    17. repec:osf:socarx:ub92z_v1 is not listed on IDEAS
    18. Wu, Qinqin & Zhuang, Qinqin & Liu, Yitong & Han, Longyan, 2024. "Technology shock of ChatGPT, social attention and firm value: Evidence from China," Technology in Society, Elsevier, vol. 79(C).
    19. Li Xian Liu & Zhiyue Sun & Kunpeng Xu & Chao Chen, 2024. "AI-Driven Financial Analysis: Exploring ChatGPT’s Capabilities and Challenges," IJFS, MDPI, vol. 12(3), pages 1-35, June.
    20. Dong, Mengming Michael & Stratopoulos, Theophanis C. & Wang, Victor Xiaoqi, 2024. "A scoping review of ChatGPT research in accounting and finance," International Journal of Accounting Information Systems, Elsevier, vol. 55(C).
    21. Minh Tam Tammy Schlosky & Serkan Karadas & Sterling Raskie, 2024. "ChatGPT, Help! I Am in Financial Trouble," JRFM, MDPI, vol. 17(6), pages 1-39, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:sysdyn:v:40:y:2024:i:3:n:e1772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/0883-7066 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.