IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v67y2018icp122-128.html

Evaluator competencies in the context of diversity training: The practitioners’ point of view

Author

Listed:
  • Froncek, Benjamin
  • Mazziotta, Agostino
  • Piper, Verena
  • Rohmann, Anette

Abstract

Evaluator competencies have been discussed since the beginnings of program evaluation literature. More recently, the Essential Competencies for Program Evaluators (Ghere et al., 2006; Stevahn, King, Ghere & Minnema, 2005a) have proven to be a useful taxonomy for learning and improving evaluation practice. Evaluation is critical to diversity training activities, and diversity training providers face the challenge of conducting evaluations of their training programs. We explored what competencies are viewed as instrumental to conducting useful evaluations in this specific field of evaluation practice. In an online survey, N = 172 diversity training providers were interviewed via an open answer format about their perceptions of evaluator competencies, with n = 95 diversity training providers contributing statements. The Essential Competencies for Program Evaluators were used to conduct a deductive qualitative content analysis of the statements. While systematic inquiry, reflective practice, and interpersonal competence were well represented, situational analysis and project management were not. Implications are discussed for evaluation capacity building among diversity training providers and for negotiating evaluation projects with evaluation professionals.

Suggested Citation

  • Froncek, Benjamin & Mazziotta, Agostino & Piper, Verena & Rohmann, Anette, 2018. "Evaluator competencies in the context of diversity training: The practitioners’ point of view," Evaluation and Program Planning, Elsevier, vol. 67(C), pages 122-128.
  • Handle: RePEc:eee:epplan:v:67:y:2018:i:c:p:122-128
    DOI: 10.1016/j.evalprogplan.2018.01.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718917302409
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2018.01.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Bates, Reid, 2004. "A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence," Evaluation and Program Planning, Elsevier, vol. 27(3), pages 341-347, August.
    2. Appannah, Arti & Meyer, Claudia & Ogrin, Rajna & McMillan, Sally & Barrett, Elizabeth & Browning, Colette, 2017. "Diversity training for the community aged care workers: A conceptual framework for evaluation," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 74-81.
    3. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ignacio, Lucia Amycel & Meigh, Neil & Dixon, Sara & Bateup, Sarah & Mickan, Sharon, 2025. "Core competencies of health program evaluators: A scoping review," Evaluation and Program Planning, Elsevier, vol. 111(C).
    2. Diaz, John & Chaudhary, Anil Kumar & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Expanding evaluator competency research: Exploring competencies for program evaluation using the context of non-formal education," Evaluation and Program Planning, Elsevier, vol. 79(C).
    3. Connors, Susan C. & Komaie, Goldie & Proctor, Jeff, 2023. "Exploring the value of pro bono evaluation work as a method to build evaluator competencies and strengthen organizational capacity," Evaluation and Program Planning, Elsevier, vol. 100(C).
    4. King, Jean A. & Ayoo, Sandra, 2020. "What do we know about evaluator education? A review of peer-reviewed publications (1978–2018)," Evaluation and Program Planning, Elsevier, vol. 79(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Esposito, Giovanna & Freda, Maria Francesca, 2015. "Evaluating training context competence of use: Productive and unproductive models of use," Evaluation and Program Planning, Elsevier, vol. 50(C), pages 77-87.
    2. Futris, Ted G. & Schramm, David G. & Richardson, Evin W. & Lee, Tae Kyoung, 2015. "The impact of organizational support on the transfer of learning to practice," Children and Youth Services Review, Elsevier, vol. 51(C), pages 36-43.
    3. Abdul-Manan, Amir F.N. & Baharuddin, Azizan & Chang, Lee Wei, 2015. "Application of theory-based evaluation for the critical analysis of national biofuel policy: A case study in Malaysia," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 39-49.
    4. Romero-Gutierrez, Miguel & Jimenez-Liso, M. Rut & Martinez-Chico, Maria, 2016. "SWOT analysis to evaluate the programme of a joint online/onsite master's degree in environmental education through the students’ perceptions," Evaluation and Program Planning, Elsevier, vol. 54(C), pages 41-49.
    5. Juliarti Jayani & Yoshitaka Yamazaki, 2012. "A Return on Investment Approach to Training Evaluation in Public Sectors," Working Papers EMS_2012_13, Research Institute, International University of Japan.
    6. Ofek, Yuval, 2017. "Evaluating social exclusion interventions in university-community partnerships," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 46-55.
    7. Jose Antonio Diego-Mas & Jorge Alcaide-Marzal & Rocio Poveda-Bautista, 2020. "Effects of Using Immersive Media on the Effectiveness of Training to Prevent Ergonomics Risks," IJERPH, MDPI, vol. 17(7), pages 1-18, April.
    8. Martens, Krystin S.R., 2018. "How program evaluators use and learn to use rubrics to make evaluative reasoning explicit," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 25-32.
    9. Telch, Fabian, 2025. "Understanding how national development planning (NDP) shapes public institutions and procedures for development: the case of Colombia," World Development Perspectives, Elsevier, vol. 39(C).
    10. Md Zohurul Islam & Munshi Muhammad Abdul Kader Jilani & Mohammad Rezaul Karim, 2024. "Enhancing post-training evaluation of annual performance agreement training: A fusion of fsQCA and artificial neural network approach," PLOS ONE, Public Library of Science, vol. 19(6), pages 1-29, June.
    11. Bourgeois, Isabelle & Whynot, Jane, 2018. "The influence of evaluation recommendations on instrumental and conceptual uses: A preliminary analysis," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 13-18.
    12. Lifshitz, Chen Chana, 2017. "Fostering employability among youth at-risk in a multi-cultural context: Insights from a pilot intervention program," Children and Youth Services Review, Elsevier, vol. 76(C), pages 20-34.
    13. Alireza Ahadi & Matt Bower & Abhay Singh & Michael Garrett, 2021. "Online Professional Learning in Response to COVID-19—Towards Robust Evaluation," Future Internet, MDPI, vol. 13(3), pages 1-22, February.
    14. LaVelle, John M. & Davies, Randall, 2021. "Seeking consensus: Defining foundational concepts for a graduate level introductory program evaluation course," Evaluation and Program Planning, Elsevier, vol. 88(C).
    15. Zuhri Arafah Zulkifli & Anis Afiqah Sharip & Siti Maisatah Md Zain & Nurul Najwa Abdul Rahid Abdul Rashid & Raihana Md Saidi & Nur Aimuni Md Rashid & Alya Geigiana, 2022. "Integration of Instructional Models and Learning Styles for Open and Distance Learning Environment," World Journal of English Language, Sciedu Press, vol. 12(2), pages 226-226, December.
    16. Melz, Heidi & Fromknecht, Anne E. & Masters, Loren D. & Richards, Tammy & Sun, Jing, 2023. "Incorporating multiple data sources to assess changes in organizational capacity in child welfare systems," Evaluation and Program Planning, Elsevier, vol. 97(C).
    17. Alison Bullock & Zoё Slote Morris & Christine Atwell, 2013. "Exchanging knowledge through healthcare manager placements in research teams," The Service Industries Journal, Taylor & Francis Journals, vol. 33(13-14), pages 1363-1380, October.
    18. Muhammad Zaheer Asghar & Muhammad Naeem Afzaal & Javed Iqbal & Yasira Waqar & Pirita Seitamaa-Hakkarainen, 2022. "Evaluation of In-Service Vocational Teacher Training Program: A Blend of Face-to-Face, Online and Offline Learning Approaches," Sustainability, MDPI, vol. 14(21), pages 1-28, October.
    19. Healy, John & Hughes, Jeffrey & Donnelly-Cox, Gemma & Shantz, Amanda, 2024. "A long and winding road: The hard graft of scaling social change in complex systems," Journal of Business Venturing Insights, Elsevier, vol. 21(C).
    20. Wingate, Lori A. & Smith, Nick L. & Perk, Emma, 2018. "The project vita: A dynamic knowledge management tool," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 22-27.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:67:y:2018:i:c:p:122-128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.