IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0157474.html
   My bibliography  Save this article

Monitoring and Evaluating Psychosocial Intervention Outcomes in Humanitarian Aid

Author

Listed:
  • Kaz de Jong
  • Cono Ariti
  • Saskia van der Kam
  • Trudy Mooren
  • Leslie Shanks
  • Giovanni Pintaldi
  • Rolf Kleber

Abstract

Existing tools for evaluating psychosocial interventions (un-validated self-reporting questionnaires) are not ideal for use in non-Western conflict settings. We implement a generic method of treatment evaluation, using client and counsellor feedback, in 18 projects in non-Western humanitarian settings. We discuss our findings from the perspective of validity and suggestions for future research. A retrospective analysis is executed using data gathered from psychosocial projects. Clients (n = 7,058) complete two (complaints and functioning) rating scales each session and counsellors rate the client’s status at exit. The client-completed pre- and post-intervention rating scales show substantial changes. Counsellor evaluation of the clients’ status shows a similar trend in improvement. All three multivariable models for each separate scale have similar associations between the scales and the investigated variables despite different cultural settings. The validity is good. Limitations are: ratings give only a general impression and clinical risk factors are not measured. Potential ceiling effects may influence change of scales. The intra and inter-rater reliability of the counsellors’ rating is not assessed. The focus on client and counsellor perspectives to evaluate treatment outcome seems a strong alternative for evaluation instruments frequently used in psychosocial programming. The session client rated scales helps client and counsellor to set mutual treatment objectives and reduce drop-out risk. Further research should test the scales against a cross-cultural valid gold standard to obtain insight into their clinical relevance.

Suggested Citation

  • Kaz de Jong & Cono Ariti & Saskia van der Kam & Trudy Mooren & Leslie Shanks & Giovanni Pintaldi & Rolf Kleber, 2016. "Monitoring and Evaluating Psychosocial Intervention Outcomes in Humanitarian Aid," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-16, June.
    • Handle: RePEc:plo:pone00:0157474
    DOI: 10.1371/journal.pone.0157474
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0157474
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0157474&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0157474?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Veerman, Jan W. & van Yperen, Tom A., 2007. "Degrees of freedom and degrees of certainty: A developmental model for the establishment of evidence-based youth care," Evaluation and Program Planning, Elsevier, vol. 30(2), pages 212-221, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vica Marie Jelena Tomberge & Janine Stefanie Bischof & Regula Meierhofer & Akina Shrestha & Jennifer Inauen, 2021. "The Physical Burden of Water Carrying and Women’s Psychosocial Well-Being: Evidence from Rural Nepal," IJERPH, MDPI, vol. 18(15), pages 1-11, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Veerman, Jan W. & De Meyer, Ronald E., 2015. "Consistency of outcomes of home-based family treatment in The Netherlands as an indicator of effectiveness," Children and Youth Services Review, Elsevier, vol. 59(C), pages 113-119.
    2. Brady, Bernadine & Canavan, John & Redmond, Susan, 2016. "Bridging the gap: Using Veerman and Van Yperen’s (2007) framework to conceptualise and develop evidence informed practice in an Irish youth work organisation," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 128-133.
    3. Agans, Jennifer P. & Maley, Mary & Rainone, Nicolette & Cope, Marie & Turner, Andrew & Eckenrode, John & Pillemer, Karl, 2020. "Evaluating the evidence for youth outcomes in 4-H: A scoping review," Children and Youth Services Review, Elsevier, vol. 108(C).
    4. van Assen, Arjen & Knot-Dickscheit, Jana & Grietens, Hans & Post, Wendy, 2021. "Fidelity and flexibility of care activities in child-centered youth care for children growing up in families experiencing complex and multiple problems," Children and Youth Services Review, Elsevier, vol. 123(C).
    5. Schalock, Robert L. & Verdugo, Miguel Angel & Gomez, Laura E., 2011. "Evidence-based practices in the field of intellectual and developmental disabilities: An international consensus approach," Evaluation and Program Planning, Elsevier, vol. 34(3), pages 273-282, August.
    6. Nijhof, Karin S. & Veerman, Jan W. & Engels, Rutger C.M.E. & Scholte, Ron H.J., 2011. "Compulsory residential care: An examination of treatment improvement of individual and family functioning," Children and Youth Services Review, Elsevier, vol. 33(10), pages 1779-1785, October.
    7. Schalock, Robert L. & Lee, Tim & Verdugo, Miguel & Swart, Kees & Claes, Claudia & van Loon, Jos & Lee, Chun-Shin, 2014. "An evidence-based approach to organization evaluation and change in human service organizations evaluation and program planning," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 110-118.
    8. Schalock, Robert L. & Bonham, Gordon S. & Verdugo, Miguel A., 2008. "The conceptualization and measurement of quality of life: Implications for program planning and evaluation in the field of intellectual disabilities," Evaluation and Program Planning, Elsevier, vol. 31(2), pages 181-190, May.
    9. Leonieke Boendermaker & Erwin Landman, 2022. "Video Feedback to Enhance Fidelity in Practice-Based Interventions for Young People, a Small-n Study," SAGE Open, , vol. 12(1), pages 21582440211, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0157474. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.