IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718922001628.html

Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti

Author

Listed:
  • Schuster, Roseanne C.
  • Brewis, Alexandra
  • Wutich, Amber
  • Safi, Christelle
  • Vanrespaille, Teresa Elegido
  • Bowen, Gina
  • SturtzSreetharan, Cindi
  • McDaniel, Anne
  • Ochandarena, Peggy

Abstract

Focus group discussions (FGDs) and individual interviews (IIs) with community members are common methods used in evaluations of all kinds of projects, including those in international development. As resources are often limited, evaluators must carefully choose methods that yield the best information for their particular program. A concern with FGDs and IIs is how well they elicit information on potentially sensitive topics; very little is known about differences in disclosure by methodology in the domain of justice. Using FGDs (n = 16) and IIs (n = 46) from a USAID project in Haiti, we systematically coded responses based on a shared elicitation guide around access to and engagement with the formal and informal justice systems and performed thematic and statistical comparisons across the two methods. We introduce the continuous thought as the novel standard unit for statistical comparison. Participants in IIs were statistically more likely to provide themes relevant to genderbased violence. Importantly, sensitive themes extracted in IIs (e.g., related to sexual violence, economic dimensions, and restorative justice) did not emerge in FGDs. Given these results and other limitations to the FGD, prioritizing interviews over focus group modalities may be appropriate to guide targeted, effective programming on justice or other socially sensitive topics.

Suggested Citation

  • Schuster, Roseanne C. & Brewis, Alexandra & Wutich, Amber & Safi, Christelle & Vanrespaille, Teresa Elegido & Bowen, Gina & SturtzSreetharan, Cindi & McDaniel, Anne & Ochandarena, Peggy, 2023. "Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti," Evaluation and Program Planning, Elsevier, vol. 97(C).
  • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628
    DOI: 10.1016/j.evalprogplan.2022.102208
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718922001628
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2022.102208?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    2. Susan Johnson & Saltanat Rasulova, 2017. "Qualitative research and the evaluation of development impact: incorporating authenticity into the assessment of rigour," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 9(2), pages 263-276, April.
    3. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    4. Lehoux, Pascale & Poland, Blake & Daudelin, Genevieve, 2006. "Focus group research and "the patient's view"," Social Science & Medicine, Elsevier, vol. 63(8), pages 2091-2104, October.
    5. Bamberger, Michael & Tarsilla, Michele & Hesse-Biber, Sharlene, 2016. "Why so many “rigorous” evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 155-162.
    6. Michael Bamberger & Vijayendra Rao & Michael Woolcock, 2009. "Using Mixed Methods in Monitoring and Evaluation: Experiences from International Development’," Global Development Institute Working Paper Series 10709, GDI, The University of Manchester.
    7. de Alteriis, Martin, 2020. "What can we learn about unintended consequences from a textual analysis of monitoring reports and evaluations for U.S. foreign assistance programs?," Evaluation and Program Planning, Elsevier, vol. 79(C).
    8. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Magnusson, Thomas & Onufrey, Ksenia & Werner, Viktor & Gillström, Henrik, 2025. "Inter-system linkage formation in multi-system transitions: Incumbents, asymmetries and learning cycles," Research Policy, Elsevier, vol. 54(8).
    2. Terenzi, Marco & Ogheri, Chiara & Locatelli, Giorgio, 2025. "Understanding homeowners' behavioural determinants: A study on house retrofitting and PV adoption," Applied Energy, Elsevier, vol. 397(C).
    3. Centobelli, Piera & Cerchione, Roberto & Maglietta, Amedeo & Oropallo, Eugenio, 2023. "Sailing through a digital and resilient shipbuilding supply chain: An empirical investigation," Journal of Business Research, Elsevier, vol. 158(C).
    4. Won, Jongho & Lee, Daeho & Lee, Junmin, 2023. "Understanding experiences of food-delivery-platform workers under algorithmic management using topic modeling," Technological Forecasting and Social Change, Elsevier, vol. 190(C).
    5. Rani Ann Balaraman & Lawrence Arokiasamy & Nurdayana Mohamad Noor & Ng See Kee, 2025. "Navigating Lifelong Learning: Universiti Sains Malaysia Students’ Perceptions, Challenges, and Employability Readiness," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(3), pages 3121-3132, March.
    6. Roelofse, Emmalinde, 2017. "M3 Strategic Decision-Making Under Uncertainty: Modes, Models, & Momentum," SocArXiv uafvr_v1, Center for Open Science.
    7. Nordin, Fredrik & Ravald, Annika, 2023. "The making of marketing decisions in modern marketing environments," Journal of Business Research, Elsevier, vol. 162(C).
    8. Roelofse, Emmalinde, 2017. "M3 Strategic Decision-Making Under Uncertainty: Modes, Models, and Momentum," Thesis Commons dwt3a_v1, Center for Open Science.
    9. Gill, Chelsea & Mehrotra, Vishal & Moses, Olayinka & Bui, Binh, 2023. "The impact of the pitching research framework on AFAANZ grant applications," Pacific-Basin Finance Journal, Elsevier, vol. 77(C).
    10. Rebecca Reynolds & Julie Aromi & Catherine McGowan & Britt Paris, 2022. "Digital divide, critical‐, and crisis‐informatics perspectives on K‐12 emergency remote teaching during the pandemic," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(12), pages 1665-1680, December.
    11. Dako-Gyeke, Mavis & Kodom, Richard Baffo & Dankyi, Ernestina K. & Sulemana, Alhassan, 2020. "Drivers of independent migration among adolescents from selected West African countries," Children and Youth Services Review, Elsevier, vol. 117(C).
    12. Yoo, Sihyun & Beumer, Ruben & van Wee, Bert & Mouter, Niek & Molin, Eric, 2025. "Perceived accessibility by air transportation: A focus group study of potential air travelers in The Netherlands," Transportation Research Part A: Policy and Practice, Elsevier, vol. 193(C).
    13. Nawaz, Muhammad Zahid & Nawaz, Shahid & Guzmán, Francisco & Plotkina, Daria, 2023. "The aftermath of Covid-19: The rise of pandemic animosity among consumers and its scale development," Journal of Business Research, Elsevier, vol. 157(C).
    14. Máté Pusker & Blanka Berényi & Judit T. Kárász & Szabolcs Takács, 2025. "Detecting emotions during interview simulations," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(2), pages 1507-1551, April.
    15. Muhamad Firdaus Jamal & Nur Siri Roland Xavier, 2025. "The Future of Accounting in Malaysia: Navigating Digital Disruptions and Innovations for Professional Growth," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(4), pages 3904-3916, April.
    16. Stoyanov, Stoyan & Stoyanova, Veselina, 2025. "Mitigating liabilities of foreignness in migrant entrepreneurship: The role of AI in building virtual embeddedness," Technological Forecasting and Social Change, Elsevier, vol. 220(C).
    17. Xiaoxiao Xu & Oskar Casasayas & Wenke Huang, 2024. "A hybrid dynamic model for building energy performance gap analysis: a perspective of energy-related stakeholder collaboration," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(6), pages 13943-13977, June.
    18. Godwin Kwemarira & Mahadih Kyambade & Luke Sewante & Micheal Kiwanuka, 2025. "Ethical Orientations and Value for Money in Primary Schools," Public Organization Review, Springer, vol. 25(2), pages 633-650, June.
    19. Alessia D. Andrea & Stefano Marasca & Eva Cerioni, 2024. "CSR Motivations in Voluntary Non-Financial Disclosures: The Preparers’ Voice," Journal of Management and Sustainability, Canadian Center of Science and Education, vol. 14(1), pages 1-94, June.
    20. Juan Francisco Velasco-Muñoz & José Ángel Aznar-Sánchez & Belén López-Felices & Gabriella Balacco, 2022. "Adopting sustainable water management practices in agriculture based on stakeholder preferences," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 68(9), pages 317-326.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.