IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/7bsgy_v1.html

Qualitative Research in an Era of AI: A Pragmatic Approach to Data Analysis, Workflow, and Computation

Author

Listed:
  • Abramson, Corey
  • Li, Zhuofan
  • Prendergast, Tara
  • Dohan, Daniel

Abstract

Rapid computational developments—particularly the proliferation of artificial intelligence (AI)—increasingly shape social scientific research while raising new questions about in-depth qualitative methods such as ethnography and interviewing. Building on classic debates about using computers to analyze qualitative data, we revisit longstanding concerns and assess possibilities and dangers in an era of automation, AI chatbots, and "big data." We first historicize developments by revisiting classical and emergent concerns about qualitative analysis with computers. We then introduce a typology of contemporary modes of engagement—streamlining workflows, scaling up projects, hybrid analytical approaches, and the sociology of computation—alongside rejection of computational analyses. We illustrate these approaches with detailed workflow examples from a large-scale ethnographic study and guidance for solo researchers. We argue for a pragmatic sociological approach that moves beyond dualisms of technological optimism versus rejection to show how computational tools—simultaneously dangerous and generative—can be adapted to support longstanding qualitative aims when used carefully in ways aligned with core methodological commitments.

Suggested Citation

  • Abramson, Corey & Li, Zhuofan & Prendergast, Tara & Dohan, Daniel, 2025. "Qualitative Research in an Era of AI: A Pragmatic Approach to Data Analysis, Workflow, and Computation," SocArXiv 7bsgy_v1, Center for Open Science.
  • Handle: RePEc:osf:socarx:7bsgy_v1
    DOI: 10.31219/osf.io/7bsgy_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/68c898646e1f3849123b80fa/
    Download Restriction: no

    File URL: https://libkey.io/10.31219/osf.io/7bsgy_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Laura K. Nelson, 2020. "Computational Grounded Theory: A Methodological Framework," Sociological Methods & Research, , vol. 49(1), pages 3-42, February.
    2. Juan Pablo Pardo-Guerra & Prithviraj Pahwa, 2022. "The Extended Computational Case Method: A Framework for Research Design," Sociological Methods & Research, , vol. 51(4), pages 1826-1867, November.
    3. Tina Law & Elizabeth Roberto, 2025. "Generative Multimodal Models for Social Science: An Application with Satellite and Streetscape Imagery," Sociological Methods & Research, , vol. 54(3), pages 889-932, August.
    4. Amanda Coffey & Holbrook Beverley & Atkinson Paul, 1996. "Qualitative Data Analysis: Technologies and Representations," Sociological Research Online, , vol. 1(1), pages 80-91, March.
    5. Felix Chopra & Ingar Haaland, 2023. "Conducting qualitative interviews with AI," CEBI working paper series 23-06, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    6. Aliya Amirova & Theodora Fteropoulli & Nafiso Ahmed & Martin R Cowie & Joel Z Leibo, 2024. "Framework-based qualitative analysis of free responses of Large Language Models: Algorithmic fidelity," PLOS ONE, Public Library of Science, vol. 19(3), pages 1-33, March.
    7. Sebastian Farquhar & Jannik Kossen & Lorenz Kuhn & Yarin Gal, 2024. "Detecting hallucinations in large language models using semantic entropy," Nature, Nature, vol. 630(8017), pages 625-630, June.
    8. Austin C. Kozlowski & James Evans, 2025. "Simulating Subjects: The Promise and Peril of Artificial Intelligence Stand-Ins for Social Agents and Interactions," Sociological Methods & Research, , vol. 54(3), pages 1017-1073, August.
    9. Matty Lichtenstein & Zawadi Rucks-Ahidiana, 2023. "Contextual Text Coding: A Mixed-methods Approach for Large-scale Textual Data," Sociological Methods & Research, , vol. 52(2), pages 606-641, May.
    10. Oscar Stuhler & Cat Dang Ton & Etienne Ollion, 2025. "From Codebooks to Promptbooks: Extracting Information from Text with Generative Large Language Models," Sociological Methods & Research, , vol. 54(3), pages 794-848, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:osf:osfxxx:jvpbw_v1 is not listed on IDEAS
    2. Abramson, Corey & Li, Zhuofan, 2024. "Ethnography and Machine Learning: Synergies and New Directions," OSF Preprints jvpbw, Center for Open Science.
    3. Igor Halperin, 2025. "Prompt-Response Semantic Divergence Metrics for Faithfulness Hallucination and Misalignment Detection in Large Language Models," Papers 2508.10192, arXiv.org.
    4. Luca Macedoni & Ariel Weinberger, 2026. "Lobbying for Regulations: When Big Business Says Yes," CESifo Working Paper Series 12536, CESifo.
    5. Felix Chopra & Ingar Haaland & Fabian Roeben & Christopher Roth & Vanessa Sticher, 2025. "News Customization with AI," ECONtribute Discussion Papers Series 372, University of Bonn and University of Cologne, Germany.
    6. repec:bcp:journl:v:9:y:2025:i:12:p:571-582 is not listed on IDEAS
    7. Zhou, Zhen & Gu, Ziyuan & Qu, Xiaobo & Liu, Pan & Liu, Zhiyuan & Yu, Wenwu, 2024. "Urban mobility foundation model: A literature review and hierarchical perspective," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 192(C).
    8. Leonardo Bursztyn & Ingar Haaland & Nicolas Röver & Christopher Roth & Ingar K. Haaland, 2025. "The Social Desirability Atlas," CESifo Working Paper Series 11911, CESifo.
    9. Brian Heseung Kim & Julie J. Park & Pearl Lo & Dominique Baker & Nancy Wong & Stephanie Breen & Huong Truong & Jia Zheng & Kelly Rosinger & OiYan A. Poon, 2025. "Letters of Recommendation by High School Counselors in Selective College Admissions: Differences by Race and Socioeconomic Status in Letter Length and Topics Discussed," Research in Higher Education, Springer;Association for Institutional Research, vol. 66(5), pages 1-35, August.
    10. Schauerte, Nico & Becker, Maren & Imschloss, Monika & Wichmann, Julian R.K. & Reinartz, Werner J., 2023. "The managerial relevance of marketing science: Properties and genesis," International Journal of Research in Marketing, Elsevier, vol. 40(4), pages 801-822.
    11. Xiaohan Lin & Yijie Xia & Yanheng Li & Yu-Peng Huang & Shuo Liu & Jun Zhang & Yi Qin Gao, 2025. "In-silico 3D molecular editing through physics-informed and preference-aligned generative foundation models," Nature Communications, Nature, vol. 16(1), pages 1-15, December.
    12. Duraj, Kamila & Grunow, Daniela & Chaliasos, Michael & Laudenbach, Christine & Siegel, Stephan, 2024. "Rethinking the stock market participation puzzle: A qualitative approach," SAFE Working Paper Series 441, Leibniz Institute for Financial Research SAFE.
    13. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2024. "Measuring What Is Top of Mind," CEBI working paper series 24-10, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    14. D'Errico, Michele & Yasseri, Taha, 2025. "Conspiracy Theories as Culturally Evolved Epistemologies: A Perspective for the Age of AI," SocArXiv 4wsjv_v1, Center for Open Science.
    15. Stef M Shuster & Celeste Campos-Castillo & Navid Madani & Kenneth Joseph, 2024. "Who supports Bernie? Analyzing identity and ideological variation on Twitter during the 2020 democratic primaries," PLOS ONE, Public Library of Science, vol. 19(4), pages 1-23, April.
    16. Xiaoyi Luo & Aiwen Wang & Xinling Zhang & Kunda Huang & Songyu Wang & Lixin Chen & Yejia Cui, 2025. "Toward Intelligent AIoT: A Comprehensive Survey on Digital Twin and Multimodal Generative AI Integration," Mathematics, MDPI, vol. 13(21), pages 1-44, October.
    17. von der Heyde, Leah & Haensch, Anna-Carolina & Wenz, Alexander, 2023. "Vox Populi, Vox AI? Using Language Models to Estimate German Public Opinion," SocArXiv 8je9g, Center for Open Science.
    18. Das, Swagatam, 2025. "A free probabilistic framework for analyzing the transformer-based language models," Statistics & Probability Letters, Elsevier, vol. 226(C).
    19. Fontan, Clément & Goutsmedt, Aurélien, 2023. "The ECB and the inflation monsters: strategic framing and the responsibility imperative (1998-2023)," SocArXiv 92r54, Center for Open Science.
    20. Jana Lasser & Segun T. Aroyehun & Fabio Carrella & Almog Simchon & David Garcia & Stephan Lewandowsky, 2023. "From alternative conceptions of honesty to alternative facts in communications by US politicians," Nature Human Behaviour, Nature, vol. 7(12), pages 2140-2151, December.
    21. Yusong Ke & Hongru Lin & Yuting Ruan & Junya Tang & Li Li, 2025. "Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework," Mathematics, MDPI, vol. 13(9), pages 1-17, May.
    22. Sheng Wang & Fangyuan Zhao & Dechao Bu & Yunwei Lu & Ming Gong & Hongjie Liu & Zhaohui Yang & Xiaoxi Zeng & Zhiyuan Yuan & Baoping Wan & Jingbo Sun & Yang Wu & Lianhe Zhao & Xirun Wan & Wei Huang & Ta, 2025. "LINS: A general medical Q&A framework for enhancing the quality and credibility of LLM-generated responses," Nature Communications, Nature, vol. 16(1), pages 1-20, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:7bsgy_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.