IDEAS home Printed from https://ideas.repec.org/a/bla/sysdyn/v40y2024i3ne1772.html
   My bibliography  Save this article

Integrating AI language models in qualitative research: Replicating interview data analysis with ChatGPT

Author

Listed:
  • Mohammad S. Jalali
  • Ali Akhavan

Abstract

The recent advent of artificial intelligence (AI) language tools like ChatGPT has opened up new opportunities in qualitative research. We revisited a previous project on obesity prevention interventions, where we developed a causal loop diagram through in‐depth interview data analysis. Utilizing ChatGPT in our replication process, we compared its results against our original approach. We discuss that ChatGPT contributes to improved efficiency and unbiased data processing; however, it also reveals limitations in context understanding. Our findings suggest that AI language tools currently have great potential to serve as an augmentative tool rather than a replacement for the intricate analytical tasks performed by humans. With ongoing advancements, AI technologies may soon offer more substantial support in enhancing qualitative research capabilities, an area that deserves more investigation. © 2024 The Authors. System Dynamics Review published by John Wiley & Sons Ltd on behalf of System Dynamics Society.

Suggested Citation

  • Mohammad S. Jalali & Ali Akhavan, 2024. "Integrating AI language models in qualitative research: Replicating interview data analysis with ChatGPT," System Dynamics Review, System Dynamics Society, vol. 40(3), July.
    • Handle: RePEc:bla:sysdyn:v:40:y:2024:i:3:n:e1772
    DOI: 10.1002/sdr.1772
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/sdr.1772
    Download Restriction: no
    File URL: https://libkey.io/10.1002/sdr.1772?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ashwin,Julian & Chhabra,Aditya & Rao,Vijayendra, 2023. "Using Large Language Models for Qualitative Analysis can Introduce Serious Bias," Policy Research Working Paper Series 10597, The World Bank.
    2. Mohammad S. Jalali & Hazhir Rahmandad & Sally Lawrence Bullock & Alice Ammerman, 2017. "Dynamics of Implementation and Maintenance of Organizational Health Interventions," IJERPH, MDPI, vol. 14(8), pages 1-24, August.
    3. Dowling, Michael & Lucey, Brian, 2023. "ChatGPT for (Finance) research: The Bananarama Conjecture," Finance Research Letters, Elsevier, vol. 53(C).
    4. Jalali, Mohammad S. & Rahmandad, Hazhir & Bullock, Sally Lawrence & Lee-Kwan, Seung Hee & Gittelsohn, Joel & Ammerman, Alice, 2019. "Dynamics of intervention adoption, implementation, and maintenance inside organizations: The case of an obesity prevention initiative," Social Science & Medicine, Elsevier, vol. 224(C), pages 67-76.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McGill, Elizabeth & Er, Vanessa & Penney, Tarra & Egan, Matt & White, Martin & Meier, Petra & Whitehead, Margaret & Lock, Karen & Anderson de Cuevas, Rachel & Smith, Richard & Savona, Natalie & Rutter, 2021. "Evaluation of public health interventions from a complex systems perspective: A research methods review," Social Science & Medicine, Elsevier, vol. 272(C).
    2. Rice, Stephen & Crouse, Sean R. & Winter, Scott R. & Rice, Connor, 2024. "The advantages and limitations of using ChatGPT to enhance technological research," Technology in Society, Elsevier, vol. 76(C).
    3. Sebastian del Busto & Inés Galindo & Juan Jesús Hernandez & Francisco Camarelles & Esther Nieto & Águeda Caballero & María Sandín Vázquez, 2019. "Creating a Collaborative Platform for the Development of Community Interventions to Prevent Non-Communicable Diseases," IJERPH, MDPI, vol. 16(5), pages 1-14, February.
    4. Rochelle Tobin & Gemma Crawford & Jonathan Hallett & Bruce Richard Maycock & Roanna Lobo, 2022. "Critical factors that affect the functioning of a research and evaluation capacity building partnership: A causal loop diagram," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-22, January.
    5. Smales, Lee A., 2023. "Classification of RBA monetary policy announcements using ChatGPT," Finance Research Letters, Elsevier, vol. 58(PC).
    6. Hoffmann, Stefan & Lasarov, Wassili & Dwivedi, Yogesh K., 2024. "AI-empowered scale development: Testing the potential of ChatGPT," Technological Forecasting and Social Change, Elsevier, vol. 205(C).
    7. Muhammad Tahir & Sufyan Ali & Ayesha Sohail & Ying Zhang & Xiaohua Jin, 2024. "Unlocking Online Insights: LSTM Exploration and Transfer Learning Prospects," Annals of Data Science, Springer, vol. 11(4), pages 1421-1434, August.
    8. Hassnian Ali & Ahmet Faruk Aysan, 2023. "What will ChatGPT revolutionize in the financial industry?," Modern Finance, Modern Finance Institute, vol. 1(1), pages 116-129.
    9. Amina Badreddine & Hadjira Larbi Cherif, 2023. "ChatGPT in Academic Research: Demonstrating Limitations through Real Practical Examples," Post-Print hal-04379581, HAL.
    10. Alonso-Robisco, Andres & Carbó, José Manuel, 2023. "Analysis of CBDC narrative by central banks using large language models," Finance Research Letters, Elsevier, vol. 58(PC).
    11. Christian Fieberg & Lars Hornuf & David J. Streich, 2023. "Using GPT-4 for Financial Advice," CESifo Working Paper Series 10529, CESifo.
    12. Boelsen-Robinson, Tara & Blake, Miranda R. & Brown, Andrew D. & Huse, Oliver & Palermo, Claire & George, Neetu A. & Peeters, Anna, 2021. "Mapping factors associated with a successful shift towards healthier food retail in community-based organisations: A systems approach," Food Policy, Elsevier, vol. 101(C).
    13. Pablo Newberry & Neil Carhart, 2024. "Constructing causal loop diagrams from large interview data sets," System Dynamics Review, System Dynamics Society, vol. 40(1), January.
    14. Negar Darabi & Niyousha Hosseinichimeh, 2020. "System dynamics modeling in health and medicine: a systematic literature review," System Dynamics Review, System Dynamics Society, vol. 36(1), pages 29-73, January.
    15. Talaei-Khoei, Amir & Yang, Alan T. & Masialeti, Masialeti, 2024. "How does incorporating ChatGPT within a firm reinforce agility-mediated performance? The moderating role of innovation infusion and firms’ ethical identity," Technovation, Elsevier, vol. 132(C).
    16. Konstantinos I. Roumeliotis & Nikolaos D. Tselikas, 2023. "ChatGPT and Open-AI Models: A Preliminary Review," Future Internet, MDPI, vol. 15(6), pages 1-24, May.
    17. Li Xian Liu & Zhiyue Sun & Kunpeng Xu & Chao Chen, 2024. "AI-Driven Financial Analysis: Exploring ChatGPT’s Capabilities and Challenges," IJFS, MDPI, vol. 12(3), pages 1-35, June.
    18. Wang, Haibo, 2024. "Decoding herding dynamics in the generative AI investment amid key technological advancements: A timeline perspective," Finance Research Letters, Elsevier, vol. 64(C).
    19. Shuochen Bi & Tingting Deng & Jue Xiao, 2024. "The Role of AI in Financial Forecasting: ChatGPT's Potential and Challenges," Papers 2411.13562, arXiv.org.
    20. Minh Tam Tammy Schlosky & Serkan Karadas & Sterling Raskie, 2024. "ChatGPT, Help! I Am in Financial Trouble," JRFM, MDPI, vol. 17(6), pages 1-39, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:sysdyn:v:40:y:2024:i:3:n:e1772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/0883-7066 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.