IDEAS home Printed from https://ideas.repec.org/a/dem/demres/v37y2017i42.html
   My bibliography  Save this article

A mixed-methods framework for analyzing text data: Integrating computational techniques with qualitative methods in demography

Author

Listed:
  • Parijat Chakrabarti

    (Princeton University)

  • Margaret Frye

    (Princeton University)

Abstract

Background: Automated text analysis is widely used across the social sciences, yet the application of these methods has largely proceeded independently of qualitative analysis. Objective: This paper explores the advantages of applying automated text analysis to augment traditional qualitative methods in demography. Computational text analysis does not replace close reading or subjective theorizing, but it can provide a complementary set of tools that we believe will be appealing for qualitative demographers. Methods: We apply topic modeling to text data from the Malawi Journals Project as a case study. Results: We examine three common issues that demographers face in analyzing qualitative data: large samples, the challenge of comparing qualitative data across external categories, and making data analysis transparent and readily accessible to other scholars. We discuss ways that new tools from machine learning and computer science might help qualitative scholars to address these issues. Conclusions: We believe that there is great promise in mixed-method approaches to analyzing text. New methods that allow better access to data and new ways to approach qualitative data are likely to be fertile ground for research. Contribution: No research, to our knowledge, has used automated text analysis to take an explicitly mixed-method approach to the analysis of textual data. We develop a framework that allows qualitative researchers to do so.

Suggested Citation

  • Parijat Chakrabarti & Margaret Frye, 2017. "A mixed-methods framework for analyzing text data: Integrating computational techniques with qualitative methods in demography," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 37(42), pages 1351-1382.
  • Handle: RePEc:dem:demres:v:37:y:2017:i:42
    DOI: 10.4054/DemRes.2017.37.42
    as

    Download full text from publisher

    File URL: https://www.demographic-research.org/volumes/vol37/42/37-42.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Grimmer, Justin & Stewart, Brandon M., 2013. "Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts," Political Analysis, Cambridge University Press, vol. 21(3), pages 267-297, July.
    2. Amy Kaler & Susan Watkins, 2010. "Asking God about the date you will die: HIV testing as a zone of uncertainty in rural Malawi," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 23(32), pages 905-932.
    3. Kirsten P. Smith & Susan Cotts Watkins, 2005. "Perceptions of Risk and Strategies for Prevention: Responses to HIV/AIDS in Rural Malawi," PGDA Working Papers 0305, Program on the Global Demography of Aging.
    4. Kolbe, Richard H & Burnett, Melissa S, 1991. "Content-Analysis Research: An Examination of Applications with Directives for Improving Research Reliability and Objectivity," Journal of Consumer Research, Oxford University Press, vol. 18(2), pages 243-250, September.
    5. Smith, Kirsten P. & Watkins, Susan Cotts, 2005. "Perceptions of risk and strategies for prevention: responses to HIV/AIDS in rural Malawi," Social Science & Medicine, Elsevier, vol. 60(3), pages 649-660, February.
    6. Chimbiri, Agnes M., 2007. "The condom is an 'intruder' in marriage: Evidence from rural Malawi," Social Science & Medicine, Elsevier, vol. 64(5), pages 1102-1115, March.
    7. Margaret E. Roberts & Brandon M. Stewart & Dustin Tingley & Christopher Lucas & Jetson Leder‐Luis & Shana Kushner Gadarian & Bethany Albertson & David G. Rand, 2014. "Structural Topic Models for Open‐Ended Survey Responses," American Journal of Political Science, John Wiley & Sons, vol. 58(4), pages 1064-1082, October.
    8. Ernestina Coast & Sara Randall & Kate Hampshire, 2007. "Disciplining anthropological demography," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 16(16), pages 493-518.
    9. Susan Cotts Watkins, 2004. "Navigating the AIDS Epidemic in Rural Malawi," Population and Development Review, The Population Council, Inc., vol. 30(4), pages 673-705, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anglewicz, Philip & Clark, Shelley, 2013. "The effect of marriage and HIV risks on condom use acceptability in rural Malawi," Social Science & Medicine, Elsevier, vol. 97(C), pages 29-40.
    2. Kim, Jinho, 2016. "The effect of peers on HIV infection expectations among Malawian adolescents: Using an instrumental variables/school fixed effect approach," Social Science & Medicine, Elsevier, vol. 152(C), pages 61-69.
    3. Gerritzen, Berit C., 2014. "Intra-Household Bargaining Power and HIV Prevention: Empirical Evidence from Married Couples in Rural Malawi," Economics Working Paper Series 1408, University of St. Gallen, School of Economics and Political Science.
    4. Rebecca L. Thornton & Hans-Peter Kohler, 2017. "Making marriages last: trust is good, but credible information is better," WIDER Working Paper Series 173, World Institute for Development Economic Research (UNU-WIDER).
    5. Laura Packel & Ann Keller & William H Dow & Damien de Walque & Rose Nathan & Sally Mtenga, 2012. "Evolving Strategies, Opportunistic Implementation: HIV Risk Reduction in Tanzania in the Context of an Incentive-Based HIV Prevention Intervention," PLOS ONE, Public Library of Science, vol. 7(8), pages 1-10, August.
    6. Packel, Laura & Dow, William H. & de Walque, Damien & Isdahl, Zachary & Majura, Albert, 2012. "Sexual behavior change intentions and actions in the context of a randomized trial of a conditional cash transfer for HIV prevention in Tanzania," Policy Research Working Paper Series 5997, The World Bank.
    7. Pauline Peters & Peter A. Walker & Daimon Kambewa, 2008. "Striving for Normality in a Time of AIDS in Malawi," CID Working Papers 167, Center for International Development at Harvard University.
    8. Julia Cordero Coma, 2013. "When the group encourages extramarital sex," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 28(30), pages 849-880.
    9. Yamauchi, Futoshi & Ueyama, Mika, 2008. "Social learning, selection, and HIV infection: Evidence from Malawi," IFPRI discussion papers 817, International Food Policy Research Institute (IFPRI).
    10. Alexander A. Weinreb & Guy Stecklov, 2009. "Social inequality and HIV-testing," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 21(21), pages 627-646.
    11. Georges Reniers & Benjamin Armbruster, 2012. "HIV Status Awareness, Partnership Dissolution and HIV Transmission in Generalized Epidemics," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-7, December.
    12. Sikstrom, Laura, 2018. "“There was no love there”: Intergenerational HIV disclosure, and late presentation for antiretroviral therapy in Northern Malawi," Social Science & Medicine, Elsevier, vol. 211(C), pages 175-182.
    13. Coast, Ernestina, 2006. "Local understandings of, and responses to, HIV: Rural-urban migrants in Tanzania," Social Science & Medicine, Elsevier, vol. 63(4), pages 1000-1010, August.
    14. Tawfik, Linda & Watkins, Susan Cotts, 2007. "Sex in Geneva, sex in Lilongwe, and sex in Balaka," Social Science & Medicine, Elsevier, vol. 64(5), pages 1090-1101, March.
    15. Poulin, Michelle, 2007. "Sex, money, and premarital partnerships in southern Malawi," Social Science & Medicine, Elsevier, vol. 65(11), pages 2383-2393, December.
    16. Ulrich Fritsche & Johannes Puckelwald, 2018. "Deciphering Professional Forecasters’ Stories - Analyzing a Corpus of Textual Predictions for the German Economy," Macroeconomics and Finance Series 201804, University of Hamburg, Department of Socioeconomics.
    17. Dehler-Holland, Joris & Okoh, Marvin & Keles, Dogan, 2021. "The legitimacy of wind power in Germany," Working Paper Series in Production and Energy 54, Karlsruhe Institute of Technology (KIT), Institute for Industrial Production (IIP).
    18. Bongsug (Kevin) Chae & Eunhye (Olivia) Park, 2018. "Corporate Social Responsibility (CSR): A Survey of Topics and Trends Using Twitter Data and Topic Modeling," Sustainability, MDPI, Open Access Journal, vol. 10(7), pages 1-20, June.
    19. Dukalskis, Alexander & Gerschewski, Johannes, 2020. "Adapting or Freezing? Ideological Reactions of Communist Regimes to a Post-Communist World," EconStor Open Access Articles, ZBW - Leibniz Information Centre for Economics, pages 511-532.
    20. Peter Grajzl & Peter Murrell, 2021. "Characterizing a legal–intellectual culture: Bacon, Coke, and seventeenth-century England," Cliometrica, Springer;Cliometric Society (Association Francaise de Cliométrie), vol. 15(1), pages 43-88, January.

    More about this item

    Keywords

    qualitative data; qualitative methods; mixed methods; Malawi; automated text analysis;
    All these keywords.

    JEL classification:

    • J1 - Labor and Demographic Economics - - Demographic Economics
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dem:demres:v:37:y:2017:i:42. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Editorial Office). General contact details of provider: https://www.demogr.mpg.de/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.