IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718922001628.html
   My bibliography  Save this article

Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti

Author

Listed:
  • Schuster, Roseanne C.
  • Brewis, Alexandra
  • Wutich, Amber
  • Safi, Christelle
  • Vanrespaille, Teresa Elegido
  • Bowen, Gina
  • SturtzSreetharan, Cindi
  • McDaniel, Anne
  • Ochandarena, Peggy

Abstract

Focus group discussions (FGDs) and individual interviews (IIs) with community members are common methods used in evaluations of all kinds of projects, including those in international development. As resources are often limited, evaluators must carefully choose methods that yield the best information for their particular program. A concern with FGDs and IIs is how well they elicit information on potentially sensitive topics; very little is known about differences in disclosure by methodology in the domain of justice. Using FGDs (n = 16) and IIs (n = 46) from a USAID project in Haiti, we systematically coded responses based on a shared elicitation guide around access to and engagement with the formal and informal justice systems and performed thematic and statistical comparisons across the two methods. We introduce the continuous thought as the novel standard unit for statistical comparison. Participants in IIs were statistically more likely to provide themes relevant to genderbased violence. Importantly, sensitive themes extracted in IIs (e.g., related to sexual violence, economic dimensions, and restorative justice) did not emerge in FGDs. Given these results and other limitations to the FGD, prioritizing interviews over focus group modalities may be appropriate to guide targeted, effective programming on justice or other socially sensitive topics.

Suggested Citation

  • Schuster, Roseanne C. & Brewis, Alexandra & Wutich, Amber & Safi, Christelle & Vanrespaille, Teresa Elegido & Bowen, Gina & SturtzSreetharan, Cindi & McDaniel, Anne & Ochandarena, Peggy, 2023. "Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti," Evaluation and Program Planning, Elsevier, vol. 97(C).
  • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628
    DOI: 10.1016/j.evalprogplan.2022.102208
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718922001628
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2022.102208?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    2. Susan Johnson & Saltanat Rasulova, 2017. "Qualitative research and the evaluation of development impact: incorporating authenticity into the assessment of rigour," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 9(2), pages 263-276, April.
    3. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    4. Michael Bamberger & Vijayendra Rao & Michael Woolcock, 2009. "Using Mixed Methods in Monitoring and Evaluation: Experiences from International Development’," Global Development Institute Working Paper Series 10709, GDI, The University of Manchester.
    5. Lehoux, Pascale & Poland, Blake & Daudelin, Genevieve, 2006. "Focus group research and "the patient's view"," Social Science & Medicine, Elsevier, vol. 63(8), pages 2091-2104, October.
    6. Bamberger, Michael & Tarsilla, Michele & Hesse-Biber, Sharlene, 2016. "Why so many “rigorous” evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 155-162.
    7. de Alteriis, Martin, 2020. "What can we learn about unintended consequences from a textual analysis of monitoring reports and evaluations for U.S. foreign assistance programs?," Evaluation and Program Planning, Elsevier, vol. 79(C).
    8. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nordin, Fredrik & Ravald, Annika, 2023. "The making of marketing decisions in modern marketing environments," Journal of Business Research, Elsevier, vol. 162(C).
    2. Yoo, Sihyun & Beumer, Ruben & van Wee, Bert & Mouter, Niek & Molin, Eric, 2025. "Perceived accessibility by air transportation: A focus group study of potential air travelers in The Netherlands," Transportation Research Part A: Policy and Practice, Elsevier, vol. 193(C).
    3. Nawaz, Muhammad Zahid & Nawaz, Shahid & Guzmán, Francisco & Plotkina, Daria, 2023. "The aftermath of Covid-19: The rise of pandemic animosity among consumers and its scale development," Journal of Business Research, Elsevier, vol. 157(C).
    4. Máté Pusker & Blanka Berényi & Judit T. Kárász & Szabolcs Takács, 2025. "Detecting emotions during interview simulations," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(2), pages 1507-1551, April.
    5. Juan Francisco Velasco-Muñoz & José Ángel Aznar-Sánchez & Belén López-Felices & Gabriella Balacco, 2022. "Adopting sustainable water management practices in agriculture based on stakeholder preferences," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 68(9), pages 317-326.
    6. Nur Asyrani binti Che Ismail & Nur Rasyidah Mohd Nordin, 2025. "Exploring the Subtle Art of Saying ‘No’ from the Perspectives of Malay Culture," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(3), pages 4313-4321, March.
    7. Emmanouil Papagiannidis & Ida Merete Enholm & Chirstian Dremel & Patrick Mikalef & John Krogstie, 2023. "Toward AI Governance: Identifying Best Practices and Potential Barriers and Outcomes," Information Systems Frontiers, Springer, vol. 25(1), pages 123-141, February.
    8. Davidson, Angus Alexander & Young, Michael Denis & Leake, John Espie & O’Connor, Patrick, 2022. "Aid and forgetting the enemy: A systematic review of the unintended consequences of international development in fragile and conflict-affected situations," Evaluation and Program Planning, Elsevier, vol. 92(C).
    9. Abu Sa’a, Ehab & Asplund, Fredrik, 2025. "Unpacking social capital in University–Industry Collaborations: Pathways to cross-industry knowledge sharing," Technovation, Elsevier, vol. 140(C).
    10. Raaymann, Sophia & Spinler, Stefan, 2024. "Measuring supply chain resilience along the automotive value chain — A comparative research on literature and industry," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 192(C).
    11. Zahra Adardour & Slimane Ed-Dafali & Muhammad Mohiuddin & Omar El Mortagi & Hicham Sbai & Brahim Bouzahir, 2025. "Exploring the drivers of environmental, social, and governance (ESG) disclosure in an emerging market context using a mixed methods approach," Future Business Journal, Springer, vol. 11(1), pages 1-23, December.
    12. T. M. Brunner-Kirchmair & M. R. W. Hiebl & J. Thaller & T. Wolf & B. Feldbauer-Durstmüller & H. Pernsteiner & M. Dick & S. Mayr & E. Wagner, 2025. "Religion logic and family firms’ ethical behavior towards employees," Review of Managerial Science, Springer, vol. 19(6), pages 1819-1857, June.
    13. Centobelli, Piera & Cerchione, Roberto & Maglietta, Amedeo & Oropallo, Eugenio, 2023. "Sailing through a digital and resilient shipbuilding supply chain: An empirical investigation," Journal of Business Research, Elsevier, vol. 158(C).
    14. Won, Jongho & Lee, Daeho & Lee, Junmin, 2023. "Understanding experiences of food-delivery-platform workers under algorithmic management using topic modeling," Technological Forecasting and Social Change, Elsevier, vol. 190(C).
    15. Rani Ann Balaraman & Lawrence Arokiasamy & Nurdayana Mohamad Noor & Ng See Kee, 2025. "Navigating Lifelong Learning: Universiti Sains Malaysia Students’ Perceptions, Challenges, and Employability Readiness," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(3), pages 3121-3132, March.
    16. Gill, Chelsea & Mehrotra, Vishal & Moses, Olayinka & Bui, Binh, 2023. "The impact of the pitching research framework on AFAANZ grant applications," Pacific-Basin Finance Journal, Elsevier, vol. 77(C).
    17. Rebecca Reynolds & Julie Aromi & Catherine McGowan & Britt Paris, 2022. "Digital divide, critical‐, and crisis‐informatics perspectives on K‐12 emergency remote teaching during the pandemic," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(12), pages 1665-1680, December.
    18. Dako-Gyeke, Mavis & Kodom, Richard Baffo & Dankyi, Ernestina K. & Sulemana, Alhassan, 2020. "Drivers of independent migration among adolescents from selected West African countries," Children and Youth Services Review, Elsevier, vol. 117(C).
    19. Xiaoxiao Xu & Oskar Casasayas & Wenke Huang, 2024. "A hybrid dynamic model for building energy performance gap analysis: a perspective of energy-related stakeholder collaboration," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(6), pages 13943-13977, June.
    20. Peterson, Christina & Skolits, Gary, 2019. "Evaluating unintended program outcomes through Ripple Effects Mapping (REM): Application of REM using grounded theory," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.