IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v58y2024i3d10.1007_s11135-023-01753-1.html
   My bibliography  Save this article

Comparing qualitative and quantitative text analysis methods in combination with document-based social network analysis to understand policy networks

Author

Listed:
  • Anna Malandrino

    (University of Bologna)

Abstract

The literature that reflects on the application of Social Network Analysis (SNA) in combination with other methods is flourishing. However, there is a dearth of studies that compare qualitative and quantitative methods to complement structural SNA. This article addresses this gap by systematically discussing the advantages and disadvantages relating to the use of qualitative text analysis and interviewing as well as quantitative text mining and Natural Language Processing (NLP) techniques such as word frequency analysis, cluster analysis, topic modeling, and topic classification to understand policy networks. This method-oriented comparative study features two empirical studies that respectively examine the Employment Thematic Network, established under the aegis of the European Commission, and the intergovernmental cooperation network set up within the Bologna Process. The article compares and discusses the underlying research processes in terms of time, human resources, research resources, unobtrusiveness, and effectiveness toward the goal of telling meaningful stories about the examined networks in light of specific guiding hypotheses. In doing so, the paper nurtures the debate on mixed-methods research on social networks amidst the well-known paradigm war between qualitative and quantitative methods in network analysis.

Suggested Citation

  • Anna Malandrino, 2024. "Comparing qualitative and quantitative text analysis methods in combination with document-based social network analysis to understand policy networks," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(3), pages 2543-2570, June.
  • Handle: RePEc:spr:qualqt:v:58:y:2024:i:3:d:10.1007_s11135-023-01753-1
    DOI: 10.1007/s11135-023-01753-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-023-01753-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11135-023-01753-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elisa Bellotti, 2016. "Qualitative Methods and Visualizations in the Study of Friendship Networks," Sociological Research Online, , vol. 21(2), pages 198-216, May.
    2. Jan Fuhse & Sophie Mützel, 2011. "Tackling connections, structure, and meaning in networks: quantitative and qualitative methods in sociological network research," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(5), pages 1067-1089, August.
    3. Jan A. Fuhse, 2023. "Analyzing networks in communication: a mixed methods study of a political debate," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(2), pages 1207-1230, April.
    4. Claire Bidart & Patrice Cacciuttolo, 2013. "Combining qualitative, quantitative and structural dimensions in a longitudinal perspective. The case of network influence," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(5), pages 2495-2515, August.
    5. Schuelke-Leech, Beth-Anne, 2013. "Resources and research: An empirical study of the influence of departmental research resources on individual STEM researchers involvement with industry," Research Policy, Elsevier, vol. 42(9), pages 1667-1678.
    6. Hermans, Leon M. & Thissen, Wil A.H., 2009. "Actor analysis methods and their use for public policy analysts," European Journal of Operational Research, Elsevier, vol. 196(2), pages 808-818, July.
    7. Osnabrügge, Moritz & Ash, Elliott & Morelli, Massimo, 2023. "Cross-Domain Topic Classification for Political Texts," Political Analysis, Cambridge University Press, vol. 31(1), pages 59-80, January.
    8. Loet Leydesdorff, 2008. "On the normalization and visualization of author co‐citation data: Salton's Cosine versus the Jaccard index," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(1), pages 77-85, January.
    9. Yannis Papadopoulos, 2018. "How does knowledge circulate in a regulatory network? Observing a European Platform of Regulatory Authorities meeting," Regulation & Governance, John Wiley & Sons, vol. 12(4), pages 431-450, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. M. Teresa Antonio-García & Irene López-Navarro & Jesús Rey-Rocha, 2014. "Determinants of success for biomedical researchers: a perception-based study in a health science research environment," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1747-1779, December.
    2. Teixeira, Aurora A.C. & Tavares-Lehmann, Ana Teresa, 2014. "Human capital intensity in technology-based firms located in Portugal: Does foreign ownership matter?," Research Policy, Elsevier, vol. 43(4), pages 737-748.
    3. Maria Franca Norese & Diana Rolando & Rocco Curto, 2023. "DIKEDOC: a multicriteria methodology to organise and communicate knowledge," Annals of Operations Research, Springer, vol. 325(2), pages 1049-1082, June.
    4. Trutnevyte, Evelina & Stauffacher, Michael & Scholz, Roland W., 2012. "Linking stakeholder visions with resource allocation scenarios and multi-criteria assessment," European Journal of Operational Research, Elsevier, vol. 219(3), pages 762-772.
    5. Wenshuai Wu & Gang Kou, 2016. "A group consensus model for evaluating real estate investment alternatives," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 2(1), pages 1-10, December.
    6. Ronaldo Tavares Souza, 2020. "Box-scheme as alternative food network—the economic integration between consumers and producers," Agricultural and Food Economics, Springer;Italian Society of Agricultural Economics (SIDEA), vol. 8(1), pages 1-25, December.
    7. Quentin Plantec & Benjamin Cabanes & Pascal Le Masson & Benoit Weil, 2021. "Market-Pull Or Research Push? Effects Of Research Orientations On University-Industry Collaborative Ph.D. Projects' Performances," Post-Print halshs-03190142, HAL.
    8. Glückler Johannes & Panitz Robert & Hammer Ingmar, 2020. "SONA: A relational methodology to identify structure in networks," ZFW – Advances in Economic Geography, De Gruyter, vol. 64(3), pages 121-133, November.
    9. Gomes, Sharlene L. & Hermans, Leon M. & Thissen, Wil A.H., 2018. "Extending community operational research to address institutional aspects of societal problems: Experiences from peri-urban Bangladesh," European Journal of Operational Research, Elsevier, vol. 268(3), pages 904-917.
    10. Yang Li & Frank Neffke, 2022. "Relatedness in regional development: in search of the right specification," Papers in Evolutionary Economic Geography (PEEG) 2208, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Apr 2022.
    11. Feng Wang & Jing Ren & Juan Liu & Mingru Dong & Bin Yan & Hui Zhao, 2021. "Spatial correlation network and population mobility effect of regional haze pollution: empirical evidence from Pearl River Delta urban agglomeration in China," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(11), pages 15881-15896, November.
    12. Mercedes Campi & Marco Duenas & Giorgio Fagiolo, 2019. "How do countries specialize in food production? A complex-network analysis of the global agricultural product space," LEM Papers Series 2019/37, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    13. Lu Huang & Yijie Cai & Erdong Zhao & Shengting Zhang & Yue Shu & Jiao Fan, 2022. "Measuring the interdisciplinarity of Information and Library Science interactions using citation analysis and semantic analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6733-6761, November.
    14. Schusser, Carsten & Krott, Max & Yufanyi Movuh, Mbolo C. & Logmani, Jacqueline & Devkota, Rosan R. & Maryudi, Ahamad & Salla, Manjola & Bach, Ngo Duy, 2015. "Powerful stakeholders as drivers of community forestry — Results of an international study," Forest Policy and Economics, Elsevier, vol. 58(C), pages 92-101.
    15. Esther Versluis & Niklas Michel & Aneta Spendzharova, 2024. "Trust Matters in the Single Market, but How? Analysing Trust Amongst European Financial Supervisors," Journal of Common Market Studies, Wiley Blackwell, vol. 62(6), pages 1500-1518, November.
    16. Kirschbaum, Charles, 2013. "A 'Nested Narratives' Project: theoretical grounding and methodological implications," Insper Working Papers wpe_308, Insper Working Paper, Insper Instituto de Ensino e Pesquisa.
    17. Raamesh Deshpande & Benjamin VanderSluis & Chad L Myers, 2013. "Comparison of Profile Similarity Measures for Genetic Interaction Networks," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-11, July.
    18. Rakas, Marija & Hain, Daniel S., 2019. "The state of innovation system research: What happens beneath the surface?," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    19. Ratinen, Mari, 2019. "Social embeddedness of policy actors. The failure of consumer-owned wind energy in Finland," Energy Policy, Elsevier, vol. 128(C), pages 735-743.
    20. Campi, Mercedes & Dueñas, Marco, 2022. "Clusters and Resilience during the COVID–19 Crisis: Evidence from Colombian Exporting Firms," IDB Publications (Working Papers) 12527, Inter-American Development Bank.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:58:y:2024:i:3:d:10.1007_s11135-023-01753-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.