IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v58y2024i3d10.1007_s11135-023-01753-1.html
   My bibliography  Save this article

Comparing qualitative and quantitative text analysis methods in combination with document-based social network analysis to understand policy networks

Author

Listed:
  • Anna Malandrino

    (University of Bologna)

Abstract

The literature that reflects on the application of Social Network Analysis (SNA) in combination with other methods is flourishing. However, there is a dearth of studies that compare qualitative and quantitative methods to complement structural SNA. This article addresses this gap by systematically discussing the advantages and disadvantages relating to the use of qualitative text analysis and interviewing as well as quantitative text mining and Natural Language Processing (NLP) techniques such as word frequency analysis, cluster analysis, topic modeling, and topic classification to understand policy networks. This method-oriented comparative study features two empirical studies that respectively examine the Employment Thematic Network, established under the aegis of the European Commission, and the intergovernmental cooperation network set up within the Bologna Process. The article compares and discusses the underlying research processes in terms of time, human resources, research resources, unobtrusiveness, and effectiveness toward the goal of telling meaningful stories about the examined networks in light of specific guiding hypotheses. In doing so, the paper nurtures the debate on mixed-methods research on social networks amidst the well-known paradigm war between qualitative and quantitative methods in network analysis.

Suggested Citation

  • Anna Malandrino, 2024. "Comparing qualitative and quantitative text analysis methods in combination with document-based social network analysis to understand policy networks," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(3), pages 2543-2570, June.
  • Handle: RePEc:spr:qualqt:v:58:y:2024:i:3:d:10.1007_s11135-023-01753-1
    DOI: 10.1007/s11135-023-01753-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-023-01753-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-023-01753-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jan A. Fuhse, 2023. "Analyzing networks in communication: a mixed methods study of a political debate," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(2), pages 1207-1230, April.
    2. Claire Bidart & Patrice Cacciuttolo, 2013. "Combining qualitative, quantitative and structural dimensions in a longitudinal perspective. The case of network influence," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(5), pages 2495-2515, August.
    3. Schuelke-Leech, Beth-Anne, 2013. "Resources and research: An empirical study of the influence of departmental research resources on individual STEM researchers involvement with industry," Research Policy, Elsevier, vol. 42(9), pages 1667-1678.
    4. Loet Leydesdorff, 2008. "On the normalization and visualization of author co‐citation data: Salton's Cosine versus the Jaccard index," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(1), pages 77-85, January.
    5. Elisa Bellotti, 2016. "Qualitative Methods and Visualizations in the Study of Friendship Networks," Sociological Research Online, , vol. 21(2), pages 198-216, May.
    6. Jan Fuhse & Sophie Mützel, 2011. "Tackling connections, structure, and meaning in networks: quantitative and qualitative methods in sociological network research," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(5), pages 1067-1089, August.
    7. Yannis Papadopoulos, 2018. "How does knowledge circulate in a regulatory network? Observing a European Platform of Regulatory Authorities meeting," Regulation & Governance, John Wiley & Sons, vol. 12(4), pages 431-450, December.
    8. Hermans, Leon M. & Thissen, Wil A.H., 2009. "Actor analysis methods and their use for public policy analysts," European Journal of Operational Research, Elsevier, vol. 196(2), pages 808-818, July.
    9. Osnabrügge, Moritz & Ash, Elliott & Morelli, Massimo, 2023. "Cross-Domain Topic Classification for Political Texts," Political Analysis, Cambridge University Press, vol. 31(1), pages 59-80, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Teresa Antonio-García & Irene López-Navarro & Jesús Rey-Rocha, 2014. "Determinants of success for biomedical researchers: a perception-based study in a health science research environment," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1747-1779, December.
    2. Teixeira, Aurora A.C. & Tavares-Lehmann, Ana Teresa, 2014. "Human capital intensity in technology-based firms located in Portugal: Does foreign ownership matter?," Research Policy, Elsevier, vol. 43(4), pages 737-748.
    3. Trutnevyte, Evelina & Stauffacher, Michael & Scholz, Roland W., 2012. "Linking stakeholder visions with resource allocation scenarios and multi-criteria assessment," European Journal of Operational Research, Elsevier, vol. 219(3), pages 762-772.
    4. Wenshuai Wu & Gang Kou, 2016. "A group consensus model for evaluating real estate investment alternatives," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 2(1), pages 1-10, December.
    5. Gomes, Sharlene L. & Hermans, Leon M. & Thissen, Wil A.H., 2018. "Extending community operational research to address institutional aspects of societal problems: Experiences from peri-urban Bangladesh," European Journal of Operational Research, Elsevier, vol. 268(3), pages 904-917.
    6. Feng Wang & Jing Ren & Juan Liu & Mingru Dong & Bin Yan & Hui Zhao, 2021. "Spatial correlation network and population mobility effect of regional haze pollution: empirical evidence from Pearl River Delta urban agglomeration in China," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(11), pages 15881-15896, November.
    7. Mercedes Campi & Marco Duenas & Giorgio Fagiolo, 2019. "How do countries specialize in food production? A complex-network analysis of the global agricultural product space," LEM Papers Series 2019/37, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    8. Kirschbaum, Charles, 2013. "A 'Nested Narratives' Project: theoretical grounding and methodological implications," Insper Working Papers wpe_308, Insper Working Paper, Insper Instituto de Ensino e Pesquisa.
    9. Ratinen, Mari, 2019. "Social embeddedness of policy actors. The failure of consumer-owned wind energy in Finland," Energy Policy, Elsevier, vol. 128(C), pages 735-743.
    10. Campi, Mercedes & Dueñas, Marco, 2022. "Clusters and Resilience during the COVID–19 Crisis: Evidence from Colombian Exporting Firms," IDB Publications (Working Papers) 12527, Inter-American Development Bank.
    11. Chaoqun Ni & Cassidy R. Sugimoto & Jiepu Jiang, 2013. "Venue-author-coupling: A measure for identifying disciplines through author communities," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 265-279, February.
    12. Gergő Tóth & Sándor Juhász & Zoltán Elekes & Balázs Lengyel, 2021. "Repeated collaboration of inventors across European regions," European Planning Studies, Taylor & Francis Journals, vol. 29(12), pages 2252-2272, December.
    13. Stefano Scarazzati & Lili Wang, 2019. "The effect of collaborations on scientific research output: the case of nanoscience in Chinese regions," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 839-868, November.
    14. Nasirov, Shukhrat & Joshi, Amol M., 2023. "Minding the communications gap: How can universities signal the availability and value of their scientific knowledge to commercial organizations?," Research Policy, Elsevier, vol. 52(9).
    15. Yuanrong Zhang & Wei Guo & Jian Ma & Zhonglin Fu & Zhixing Chang & Lei Wang, 2023. "Evolution analysis of cross-domain collaborative research topic: a case study of cognitive-based product conceptual design," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(12), pages 6695-6718, December.
    16. Huang, Kuang-Chiu & Hsu, Jung-Fang, 2017. "Balance between Privacy Protecting and Selling User Data of Wearable Devices," 14th ITS Asia-Pacific Regional Conference, Kyoto 2017: Mapping ICT into Transformation for the Next Information Society 168490, International Telecommunications Society (ITS).
    17. Jan Lampe & Priscilla Sarai Kraft & Andreas Bausch, 2020. "Mapping the Field of Research on Entrepreneurial Organizations (1937–2016): A Bibliometric Analysis and Research Agenda," Entrepreneurship Theory and Practice, , vol. 44(4), pages 784-816, July.
    18. Konstantina Sdravopoulou & Juan Manuel Muñoz González & María Dolores Hidalgo-Ariza, 2021. "Educating Adults with a Location-Based Augmented Reality Game: A Content Analysis Approach," Mathematics, MDPI, vol. 9(17), pages 1-16, August.
    19. Guadalupe Palacios-Núñez & Gabriel Vélez-Cuartas & Juan D. Botero, 2018. "Developmental tendencies in the academic field of intellectual property through the identification of invisible colleges," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1561-1574, June.
    20. Müller, Matthias Otto & Groesser, Stefan N. & Ulli-Beer, Silvia, 2012. "How do we know who to include in collaborative research? Toward a method for the identification of experts," European Journal of Operational Research, Elsevier, vol. 216(2), pages 495-502.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:58:y:2024:i:3:d:10.1007_s11135-023-01753-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.