IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718922001628.html
   My bibliography  Save this article

Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti

Author

Listed:
  • Schuster, Roseanne C.
  • Brewis, Alexandra
  • Wutich, Amber
  • Safi, Christelle
  • Vanrespaille, Teresa Elegido
  • Bowen, Gina
  • SturtzSreetharan, Cindi
  • McDaniel, Anne
  • Ochandarena, Peggy

Abstract

Focus group discussions (FGDs) and individual interviews (IIs) with community members are common methods used in evaluations of all kinds of projects, including those in international development. As resources are often limited, evaluators must carefully choose methods that yield the best information for their particular program. A concern with FGDs and IIs is how well they elicit information on potentially sensitive topics; very little is known about differences in disclosure by methodology in the domain of justice. Using FGDs (n = 16) and IIs (n = 46) from a USAID project in Haiti, we systematically coded responses based on a shared elicitation guide around access to and engagement with the formal and informal justice systems and performed thematic and statistical comparisons across the two methods. We introduce the continuous thought as the novel standard unit for statistical comparison. Participants in IIs were statistically more likely to provide themes relevant to genderbased violence. Importantly, sensitive themes extracted in IIs (e.g., related to sexual violence, economic dimensions, and restorative justice) did not emerge in FGDs. Given these results and other limitations to the FGD, prioritizing interviews over focus group modalities may be appropriate to guide targeted, effective programming on justice or other socially sensitive topics.

Suggested Citation

  • Schuster, Roseanne C. & Brewis, Alexandra & Wutich, Amber & Safi, Christelle & Vanrespaille, Teresa Elegido & Bowen, Gina & SturtzSreetharan, Cindi & McDaniel, Anne & Ochandarena, Peggy, 2023. "Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti," Evaluation and Program Planning, Elsevier, vol. 97(C).
  • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628
    DOI: 10.1016/j.evalprogplan.2022.102208
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718922001628
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2022.102208?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    2. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    3. Michael Bamberger & Vijayendra Rao & Michael Woolcock, 2009. "Using Mixed Methods in Monitoring and Evaluation: Experiences from International Development’," Global Development Institute Working Paper Series 10709, GDI, The University of Manchester.
    4. Bamberger, Michael & Tarsilla, Michele & Hesse-Biber, Sharlene, 2016. "Why so many “rigorous” evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 155-162.
    5. de Alteriis, Martin, 2020. "What can we learn about unintended consequences from a textual analysis of monitoring reports and evaluations for U.S. foreign assistance programs?," Evaluation and Program Planning, Elsevier, vol. 79(C).
    6. Susan Johnson & Saltanat Rasulova, 2017. "Qualitative research and the evaluation of development impact: incorporating authenticity into the assessment of rigour," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 9(2), pages 263-276, April.
    7. Lehoux, Pascale & Poland, Blake & Daudelin, Genevieve, 2006. "Focus group research and "the patient's view"," Social Science & Medicine, Elsevier, vol. 63(8), pages 2091-2104, October.
    8. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yoo, Sihyun & Beumer, Ruben & van Wee, Bert & Mouter, Niek & Molin, Eric, 2025. "Perceived accessibility by air transportation: A focus group study of potential air travelers in The Netherlands," Transportation Research Part A: Policy and Practice, Elsevier, vol. 193(C).
    2. Máté Pusker & Blanka Berényi & Judit T. Kárász & Szabolcs Takács, 2025. "Detecting emotions during interview simulations," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(2), pages 1507-1551, April.
    3. Muhamad Firdaus Jamal & Nur Siri Roland Xavier, 2025. "The Future of Accounting in Malaysia: Navigating Digital Disruptions and Innovations for Professional Growth," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(4), pages 3904-3916, April.
    4. Emmanouil Papagiannidis & Ida Merete Enholm & Chirstian Dremel & Patrick Mikalef & John Krogstie, 2023. "Toward AI Governance: Identifying Best Practices and Potential Barriers and Outcomes," Information Systems Frontiers, Springer, vol. 25(1), pages 123-141, February.
    5. Davidson, Angus Alexander & Young, Michael Denis & Leake, John Espie & O’Connor, Patrick, 2022. "Aid and forgetting the enemy: A systematic review of the unintended consequences of international development in fragile and conflict-affected situations," Evaluation and Program Planning, Elsevier, vol. 92(C).
    6. Zahra Adardour & Slimane Ed-Dafali & Muhammad Mohiuddin & Omar El Mortagi & Hicham Sbai & Brahim Bouzahir, 2025. "Exploring the drivers of environmental, social, and governance (ESG) disclosure in an emerging market context using a mixed methods approach," Future Business Journal, Springer, vol. 11(1), pages 1-23, December.
    7. T. M. Brunner-Kirchmair & M. R. W. Hiebl & J. Thaller & T. Wolf & B. Feldbauer-Durstmüller & H. Pernsteiner & M. Dick & S. Mayr & E. Wagner, 2025. "Religion logic and family firms’ ethical behavior towards employees," Review of Managerial Science, Springer, vol. 19(6), pages 1819-1857, June.
    8. Won, Jongho & Lee, Daeho & Lee, Junmin, 2023. "Understanding experiences of food-delivery-platform workers under algorithmic management using topic modeling," Technological Forecasting and Social Change, Elsevier, vol. 190(C).
    9. Xiaoxiao Xu & Oskar Casasayas & Wenke Huang, 2024. "A hybrid dynamic model for building energy performance gap analysis: a perspective of energy-related stakeholder collaboration," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(6), pages 13943-13977, June.
    10. Alessia D. Andrea & Stefano Marasca & Eva Cerioni, 2024. "CSR Motivations in Voluntary Non-Financial Disclosures: The Preparers’ Voice," Journal of Management and Sustainability, Canadian Center of Science and Education, vol. 14(1), pages 1-94, June.
    11. Peterson, Christina & Skolits, Gary, 2019. "Evaluating unintended program outcomes through Ripple Effects Mapping (REM): Application of REM using grounded theory," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    12. Cristina-Elena UNGUREANU & Alina-Elena ANCU & Andreea-Maria-Gabriela MILITARU & Bogdan FLEACÄ‚, 2024. "Perceptions On The Integration Of Agile Principles In It Service Management Processes. Study From Romania," Business Excellence and Management, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 14(3), pages 92-108, September.
    13. Venturelli, Andrea & Ligorio, Lorenzo & de Nuccio, Elbano, 2023. "Biodiversity accountability in water utilities: A case study," Utilities Policy, Elsevier, vol. 81(C).
    14. Nordin, Fredrik & Ravald, Annika, 2023. "The making of marketing decisions in modern marketing environments," Journal of Business Research, Elsevier, vol. 162(C).
    15. Nawaz, Muhammad Zahid & Nawaz, Shahid & Guzmán, Francisco & Plotkina, Daria, 2023. "The aftermath of Covid-19: The rise of pandemic animosity among consumers and its scale development," Journal of Business Research, Elsevier, vol. 157(C).
    16. Juan Francisco Velasco-Muñoz & José Ángel Aznar-Sánchez & Belén López-Felices & Gabriella Balacco, 2022. "Adopting sustainable water management practices in agriculture based on stakeholder preferences," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 68(9), pages 317-326.
    17. Nur Asyrani binti Che Ismail & Nur Rasyidah Mohd Nordin, 2025. "Exploring the Subtle Art of Saying ‘No’ from the Perspectives of Malay Culture," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(3), pages 4313-4321, March.
    18. Abu Sa’a, Ehab & Asplund, Fredrik, 2025. "Unpacking social capital in University–Industry Collaborations: Pathways to cross-industry knowledge sharing," Technovation, Elsevier, vol. 140(C).
    19. Raaymann, Sophia & Spinler, Stefan, 2024. "Measuring supply chain resilience along the automotive value chain — A comparative research on literature and industry," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 192(C).
    20. Centobelli, Piera & Cerchione, Roberto & Maglietta, Amedeo & Oropallo, Eugenio, 2023. "Sailing through a digital and resilient shipbuilding supply chain: An empirical investigation," Journal of Business Research, Elsevier, vol. 158(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.