IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718922001628.html
   My bibliography  Save this article

Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti

Author

Listed:
  • Schuster, Roseanne C.
  • Brewis, Alexandra
  • Wutich, Amber
  • Safi, Christelle
  • Vanrespaille, Teresa Elegido
  • Bowen, Gina
  • SturtzSreetharan, Cindi
  • McDaniel, Anne
  • Ochandarena, Peggy

Abstract

Focus group discussions (FGDs) and individual interviews (IIs) with community members are common methods used in evaluations of all kinds of projects, including those in international development. As resources are often limited, evaluators must carefully choose methods that yield the best information for their particular program. A concern with FGDs and IIs is how well they elicit information on potentially sensitive topics; very little is known about differences in disclosure by methodology in the domain of justice. Using FGDs (n = 16) and IIs (n = 46) from a USAID project in Haiti, we systematically coded responses based on a shared elicitation guide around access to and engagement with the formal and informal justice systems and performed thematic and statistical comparisons across the two methods. We introduce the continuous thought as the novel standard unit for statistical comparison. Participants in IIs were statistically more likely to provide themes relevant to genderbased violence. Importantly, sensitive themes extracted in IIs (e.g., related to sexual violence, economic dimensions, and restorative justice) did not emerge in FGDs. Given these results and other limitations to the FGD, prioritizing interviews over focus group modalities may be appropriate to guide targeted, effective programming on justice or other socially sensitive topics.

Suggested Citation

  • Schuster, Roseanne C. & Brewis, Alexandra & Wutich, Amber & Safi, Christelle & Vanrespaille, Teresa Elegido & Bowen, Gina & SturtzSreetharan, Cindi & McDaniel, Anne & Ochandarena, Peggy, 2023. "Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti," Evaluation and Program Planning, Elsevier, vol. 97(C).
  • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628
    DOI: 10.1016/j.evalprogplan.2022.102208
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718922001628
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2022.102208?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    2. Sandy Q. Qu & John Dumay, 2011. "The qualitative research interview," Qualitative Research in Accounting & Management, Emerald Group Publishing Limited, vol. 8(3), pages 238-264, August.
    3. Bamberger, Michael & Tarsilla, Michele & Hesse-Biber, Sharlene, 2016. "Why so many “rigorous” evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 155-162.
    4. de Alteriis, Martin, 2020. "What can we learn about unintended consequences from a textual analysis of monitoring reports and evaluations for U.S. foreign assistance programs?," Evaluation and Program Planning, Elsevier, vol. 79(C).
    5. Susan Johnson & Saltanat Rasulova, 2017. "Qualitative research and the evaluation of development impact: incorporating authenticity into the assessment of rigour," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 9(2), pages 263-276, April.
    6. Lehoux, Pascale & Poland, Blake & Daudelin, Genevieve, 2006. "Focus group research and "the patient's view"," Social Science & Medicine, Elsevier, vol. 63(8), pages 2091-2104, October.
    7. Michael Bamberger & Vijayendra Rao & Michael Woolcock, 2009. "Using Mixed Methods in Monitoring and Evaluation: Experiences from International Development’," Global Development Institute Working Paper Series 10709, GDI, The University of Manchester.
    8. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nordin, Fredrik & Ravald, Annika, 2023. "The making of marketing decisions in modern marketing environments," Journal of Business Research, Elsevier, vol. 162(C).
    2. Nawaz, Muhammad Zahid & Nawaz, Shahid & Guzmán, Francisco & Plotkina, Daria, 2023. "The aftermath of Covid-19: The rise of pandemic animosity among consumers and its scale development," Journal of Business Research, Elsevier, vol. 157(C).
    3. Juan Francisco Velasco-Muñoz & José Ángel Aznar-Sánchez & Belén López-Felices & Gabriella Balacco, 2022. "Adopting sustainable water management practices in agriculture based on stakeholder preferences," Agricultural Economics, Czech Academy of Agricultural Sciences, vol. 68(9), pages 317-326.
    4. Emmanouil Papagiannidis & Ida Merete Enholm & Chirstian Dremel & Patrick Mikalef & John Krogstie, 2023. "Toward AI Governance: Identifying Best Practices and Potential Barriers and Outcomes," Information Systems Frontiers, Springer, vol. 25(1), pages 123-141, February.
    5. Davidson, Angus Alexander & Young, Michael Denis & Leake, John Espie & O’Connor, Patrick, 2022. "Aid and forgetting the enemy: A systematic review of the unintended consequences of international development in fragile and conflict-affected situations," Evaluation and Program Planning, Elsevier, vol. 92(C).
    6. Centobelli, Piera & Cerchione, Roberto & Maglietta, Amedeo & Oropallo, Eugenio, 2023. "Sailing through a digital and resilient shipbuilding supply chain: An empirical investigation," Journal of Business Research, Elsevier, vol. 158(C).
    7. Won, Jongho & Lee, Daeho & Lee, Junmin, 2023. "Understanding experiences of food-delivery-platform workers under algorithmic management using topic modeling," Technological Forecasting and Social Change, Elsevier, vol. 190(C).
    8. Gill, Chelsea & Mehrotra, Vishal & Moses, Olayinka & Bui, Binh, 2023. "The impact of the pitching research framework on AFAANZ grant applications," Pacific-Basin Finance Journal, Elsevier, vol. 77(C).
    9. Rebecca Reynolds & Julie Aromi & Catherine McGowan & Britt Paris, 2022. "Digital divide, critical‐, and crisis‐informatics perspectives on K‐12 emergency remote teaching during the pandemic," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(12), pages 1665-1680, December.
    10. Dako-Gyeke, Mavis & Kodom, Richard Baffo & Dankyi, Ernestina K. & Sulemana, Alhassan, 2020. "Drivers of independent migration among adolescents from selected West African countries," Children and Youth Services Review, Elsevier, vol. 117(C).
    11. Peterson, Christina & Skolits, Gary, 2019. "Evaluating unintended program outcomes through Ripple Effects Mapping (REM): Application of REM using grounded theory," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    12. Venturelli, Andrea & Ligorio, Lorenzo & de Nuccio, Elbano, 2023. "Biodiversity accountability in water utilities: A case study," Utilities Policy, Elsevier, vol. 81(C).
    13. Francesco Badia & Grazia Dicuonzo & Saverio Petruzzelli & Vittorio Dell’Atti, 2019. "Integrated reporting in action: mobilizing intellectual capital to improve management and governance practices," Journal of Management & Governance, Springer;Accademia Italiana di Economia Aziendale (AIDEA), vol. 23(2), pages 299-320, June.
    14. Pina Puntillo & Carmela Gulluscio & Donald Huisingh & Stefania Veltri, 2021. "Reevaluating waste as a resource under a circular economy approach from a system perspective: Findings from a case study," Business Strategy and the Environment, Wiley Blackwell, vol. 30(2), pages 968-984, February.
    15. Lifshitz, Chen Chana, 2017. "Fostering employability among youth at-risk in a multi-cultural context: Insights from a pilot intervention program," Children and Youth Services Review, Elsevier, vol. 76(C), pages 20-34.
    16. Katharina Löhr & Christian Hochmuth & Frieder Graef & Jane Wambura & Stefan Sieber, 2017. "Conflict management programs in trans-disciplinary research projects: the case of a food security project in Tanzania," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 9(6), pages 1189-1201, December.
    17. Jana Kozáková & Mária Urbánová & Radovan Savov, 2021. "Factors Influencing the Extent of the Ethical Codes: Evidence from Slovakia," JRFM, MDPI, vol. 14(1), pages 1-18, January.
    18. Tom Sander & Phoey Lee Teh & Biruta Sloka, 2014. "The use of Social Network Sites for the Employment Seeking Process," Proceedings of International Academic Conferences 0702459, International Institute of Social and Economic Sciences.
    19. LaVelle, John M. & Davies, Randall, 2021. "Seeking consensus: Defining foundational concepts for a graduate level introductory program evaluation course," Evaluation and Program Planning, Elsevier, vol. 88(C).
    20. Francesco Badia & Graziana Galeone & Simona Ranaldo, 2021. "La crisi COVID-19 come "crash-test" per i sistemi di controllo aziendali: il caso di un?azienda di trasporto pubblico locale," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2021(1), pages 57-80.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718922001628. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.