IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718923000034.html

Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program Planning

Author

Listed:
  • Teasdale, Rebecca M.
  • Strasser, Mikayla
  • Moore, Ceily
  • Graham, Kara E.

Abstract

Evaluative criteria represent values about characteristics that define a successful evaluand. Criteria direct evaluators’ lines of inquiry, including how aims are framed, which questions are asked, and what conclusions are reached. Yet, criteria often remain unstated, and little is known about criteria employed in practice.

Suggested Citation

  • Teasdale, Rebecca M. & Strasser, Mikayla & Moore, Ceily & Graham, Kara E., 2023. "Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program Planning," Evaluation and Program Planning, Elsevier, vol. 97(C).
    • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000034
    DOI: 10.1016/j.evalprogplan.2023.102226
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718923000034
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2023.102226?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Lucas, Rochelle Irene & Promentilla, Michael Angelo & Ubando, Aristotle & Tan, Raymond Girard & Aviso, Kathleen & Yu, Krista Danielle, 2017. "An AHP-based evaluation method for teacher training workshop on information and communication technology," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 93-100.
    2. Cuenca-García, Eduardo & Sánchez, Angeles & Navarro-Pabsdorf, Margarita, 2019. "Assessing the performance of the least developed countries in terms of the Millennium Development Goals," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 54-66.
    3. Sharpe, Patricia A. & Wilcox, Sara & Schoffman, Danielle E. & Baruth, Meghan, 2017. "“Participation, satisfaction, perceived benefits, and maintenance of behavioral self-management strategies in a self-directed exercise program for adults with arthritis”," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 143-150.
    4. Schumacker, Randall & Hua, Cheng, 2016. "Synthesis of articles in Evaluation and Program Planning: 2010–2016," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 194-198.
    5. Jaradat, Ghaith M., 2017. "Internship training in computer science: Exploring student satisfaction levels," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 109-115.
    6. Gates, Emily F. & Madres, Joseph & Hall, Jori N. & Alvarez, Kayla Benitez, 2022. "It takes an ecosystem: Socioecological factors influencing equity-oriented evaluation in New England, U.S., 2021," Evaluation and Program Planning, Elsevier, vol. 92(C).
    7. Merrill, Katherine G. & Merrill, Jamison C. & Hershow, Rebecca B. & Barkley, Chris & Rakosa, Boitumelo & DeCelles, Jeff & Harrison, Abigail, 2018. "Linking at-risk South African girls to sexual violence and reproductive health services: A mixed-methods assessment of a soccer-based HIV prevention program and pilot SMS campaign," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 12-24.
    8. Lim, E.A & Manohar, M. & Aziz, Azlizam & Zakaria, M., 2016. "Influencing secondary school STUDENTS’ conservation behavior intention through an interpretive education program on the malayan tapir," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 60-69.
    9. Ruel-Bergeron, Julie C. & Hurley, Kristen M. & Kang, Yunhee & Aburto, Nancy & Farhikhtah, Arghanoon & Dinucci, Alessandro & Molinas, Luca & Lee Shu Fune, Wu & Mitra, Maithilee & Phuka, John & Klemm, R, 2019. "Monitoring and evaluation design of Malawi’s Right Foods at the Right Time nutrition program," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 1-9.
    10. Kinchin, Irina & Jacups, Susan & Hunter, Gary & Rogerson, Bernadette, 2016. "Economic evaluation of ‘Return to Country’: A remote Australian initiative to address indigenous homelessness," Evaluation and Program Planning, Elsevier, vol. 56(C), pages 69-75.
    11. Burke, Holly McClain & Packer, Catherine & González-Calvo, Lázaro & Ridgeway, Kathleen & Lenzi, Rachel & Green, Ann F. & Moon, Troy D., 2019. "A longitudinal qualitative evaluation of an economic and social empowerment intervention to reduce girls’ vulnerability to HIV in rural Mozambique," Evaluation and Program Planning, Elsevier, vol. 77(C).
    12. Nielsen, Jonas Vestergaard & Skovgaard, Thomas & Bredahl, Thomas Viskum Gjelstrup & Bugge, Anna & Wedderkopp, Niels & Klakk, Heidi, 2018. "Using the RE-AIM framework to evaluate a school-based municipal programme tripling time spent on PE," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 1-11.
    13. Mac Neil, Brad A. & Leung, Pauline & Nadkarni, Pallavi & Stubbs, Laura & Singh, Manya, 2016. "A pilot evaluation of group-based programming offered at a Canadian outpatient adult eating disorders clinic," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 35-41.
    14. Udouj, Gary & Grover, Kenda & Belcher, Greg & Kacirek, Kit, 2017. "An investigation of perceptions of programme quality support of adult basic education programmes," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 106-112.
    15. Oldewage-Theron, Wilna Hendrika & Duvenage, Sara Susanna & Egal, Abdulkadir Ali & Lyford, Conrad, 2018. "Comparative analysis of the factors contributing to sustainability of a food and nutrition intervention programme: Two case studies from South Africa," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 51-57.
    16. Ford-Paz, Rebecca E. & Crown, Laurel & Lawton, Kathryn & Goldenthal, Hayley & Day, Gail & Coyne, Claire A. & Gill, Tara & Harris, Ngozi & Blakemore, Sheree & Cicchetti, Colleen, 2019. "Working on Womanhood (WOW): A participatory formative evaluation of a community-developed intervention," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 237-249.
    17. Annesi, James J., 2019. "Change in behavioral exercise program-associated self-regulation enhances self-regulation-induced eating improvements across levels of obesity severity," Evaluation and Program Planning, Elsevier, vol. 75(C), pages 31-37.
    18. Stewart, Gregory & Webster, Collin A. & Weaver, R. Glenn & Stodden, David F. & Brian, Ali & Egan, Cate A. & Michael, Robert Dan & Sacko, Ryan & Patey, Matthew, 2019. "Evaluation of a classroom movement integration training delivered in a low socioeconomic school district," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 187-194.
    19. Sapru, Saloni & Berktold, Jennifer & Crews, John E. & Katz, L. Jay & Hark, Lisa & Girkin, Christopher A. & Owsley, Cynthia & Francis, Brittney & Saaddine, Jinan B., 2017. "Applying RE-AIM to evaluate two community-based programs designed to improve access to eye care for those at high-risk for glaucoma," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 40-46.
    20. Pawlowski, Charlotte Skau & Schmidt, Tanja & Nielsen, Jonas Vestergaard & Troelsen, Jens & Schipperijn, Jasper, 2019. "Will the children use it?—A RE-AIM evaluation of a local public open space intervention involving children from a deprived neighbourhood," Evaluation and Program Planning, Elsevier, vol. 77(C).
    21. Mac Giolla Phadraig, Caoimhin & Nunn, June & Guerin, Suzanne & Normand, Charles, 2016. "Should we provide oral health training for staff caring for people with intellectual disabilities in community based residential care? A cost-effectiveness analysis," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 46-54.
    22. LaVenia, Kristina N. & Burgoon, Jacob, 2019. "Urban community as resource: Evaluation of the mentors in Toledo schools program," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 118-124.
    23. Haynes, Emma & Marawili, Minitja & Marika, Brendan Makungun & Mitchell, Alice G. & Phillips, Jodi & Bessarab, Dawn & Walker, Roz & Cook, Jeff & Ralph, Anna P., 2019. "Community-based participatory action research on rheumatic heart disease in an Australian Aboriginal homeland: Evaluation of the ‘On track watch’ project," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 38-53.
    24. Norris, E. & Dunsmuir, S. & Duke-Williams, O. & Stamatakis, E. & Shelton, N., 2018. "Mixed method evaluation of the Virtual Traveller physically active lesson intervention: An analysis using the RE-AIM framework," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 107-114.
    25. Goldberg, Jessica & Bumgarner, Erin & Jacobs, Francine, 2016. "Measuring program- and individual-level fidelity in a home visiting program for adolescent parents," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 163-173.
    26. Escribano, Silvia & Espada, José P. & Orgilés, Mireia & Morales, Alexandra, 2016. "Implementation fidelity for promoting the effectiveness of an adolescent sexual health program," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 81-87.
    27. Mehiriz, Kaddour, 2016. "The impacts of intergovernmental grants on municipal infrastructure: Evidence from the Canada-Quebec infrastructure works 2000 program," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 184-193.
    28. Ayob, Abu H. & Morell, Jonathan A., 2016. "The historical path of evaluation as reflected in the content of Evaluation and Program Planning," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 20-27.
    29. Ward, Stéphanie & Chow, Amanda Froehlich & Humbert, M. Louise & Bélanger, Mathieu & Muhajarine, Nazeem & Vatanparast, Hassan & Leis, Anne, 2018. "Promoting physical activity, healthy eating and gross motor skills development among preschoolers attending childcare centers: Process evaluation of the Healthy Start-Départ Santé intervention using the RE-AIM framework," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 90-98.
    30. Mazur, Rebecca & Woodland, Rebecca H., 2017. "Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning," Evaluation and Program Planning, Elsevier, vol. 62(C), pages 25-34.
    31. Millett, Lina Sapokaite & Ben-David, Vered & Jonson-Reid, Melissa & Echele, Greg & Moussette, Pam & Atkins, Valerie, 2016. "Understanding change among multi-problem families: Learnings from a formative program assessment," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 176-183.
    32. Boyce, Ayesha S., 2017. "Lessons learned using a values-engaged approach to attend to culture, diversity, and equity in a STEM program evaluation," Evaluation and Program Planning, Elsevier, vol. 64(C), pages 33-43.
    33. Da’ar, Omar B. & Alshaya, Abdulaziz, 2018. "Is it cost-beneficial to society? Measuring the economic worth of dental residency training," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 117-123.
    34. Shannon, Lisa M. & Birdwhistell, Shira & Hulbig, Shelia K. & Jones, Afton Jackson & Newell, Jennifer & Payne, Connie, 2017. "Examining implementation and preliminary performance indicators of veterans treatment courts: The Kentucky experience," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 54-66.
    35. Clapham, Kathleen & Manning, Claire & Williams, Kathryn & O’Brien, Ginger & Sutherland, Margaret, 2017. "Using a logic model to evaluate the Kids Together early education inclusion program for children with disabilities and additional needs," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 96-105.
    36. ., 2017. "Updating a living wage estimate," Chapters, in: Living Wages Around the World, chapter 20, pages 339-342, Edward Elgar Publishing.
    37. Kaur, Manmeet & Jaswal, Nidhi & Saddi, Anil Kumar, 2017. "Evaluation of a women group led health communication program in Haryana, India," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 12-19.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chiang, Chien-Jen & Jonson-Reid, Melissa & Drake, Brett, 2020. "Caregiver physical health and child maltreatment reports and rereports," Children and Youth Services Review, Elsevier, vol. 108(C).
    2. Lavrencic, Louise M. & Donovan, Terrence & Moffatt, Lindy & Keiller, Tamara & Allan, Wendy & Delbaere, Kim & Radford, Kylie, 2021. "Ngarraanga Giinganay (‘thinking peacefully’): Co-design and pilot study of a culturally-grounded mindfulness-based stress reduction program with older First Nations Australians," Evaluation and Program Planning, Elsevier, vol. 87(C).
    3. Kristina Vine & Tessa Benveniste & Shanthi Ramanathan & Jo Longman & Megan Williams & Alison Laycock & Veronica Matthews, 2023. "Culturally Informed Australian Aboriginal and Torres Strait Islander Evaluations: A Scoping Review," IJERPH, MDPI, vol. 20(14), pages 1-16, July.
    4. Maarja Kalma & Katrin Mägi & Evelin Mäestu & Kerli Mooses & Merike Kull, 2022. "Design Process and Implementation of Teacher Training Modules in Movement Integration: What Have We Learnt?," Sustainability, MDPI, vol. 14(9), pages 1-15, May.
    5. Nikolić, Vlastimir & Petković, Dalibor & Denić, Nebojša & Milovančević, Miloš & Gavrilović, Snežana, 2019. "Appraisal and review of e-learning and ICT systems in teaching process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 456-464.
    6. Ebenso, Bassey & Manzano, Ana & Uzochukwu, Benjamin & Etiaba, Enyi & Huss, Reinhard & Ensor, Tim & Newell, James & Onwujekwe, Obinna & Ezumah, Nkoli & Hicks, Joe & Mirzoev, Tolib, 2019. "Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 97-110.
    7. Chen, Simiao & Prettner, Klaus & Kuhn, Michael & Bloom, David E., 2021. "The economic burden of COVID-19 in the United States: Estimates and projections under an infection-based herd immunity approach," The Journal of the Economics of Ageing, Elsevier, vol. 20(C).
    8. Olena Ivanova & Masna Rai & Kristien Michielsen & Sónia Dias, 2020. "How Sexuality Education Programs Have Been Evaluated in Low- and Lower-Middle-Income Countries? A Systematic Review," IJERPH, MDPI, vol. 17(21), pages 1-17, November.
    9. María-José Vieira & Camino Ferreira & Agustín Rodríguez-Esteban & Javier Vidal, 2021. "Towards Sustainable Development in Education: Implementing a VET System for In-Service Teachers in Albania," Sustainability, MDPI, vol. 13(16), pages 1-15, August.
    10. Dowdy-Hazlett, Taylor & Killian, Michael & Woods, Makenna, 2021. "Measurement of traumatic experiences of children within survey and intervention research: A Systematic Review of the Child and Adolescent Trauma Screen," Children and Youth Services Review, Elsevier, vol. 131(C).
    11. Haynes, Emma & Walker, Roz & Mitchell, Alice G. & Katzenellenbogen, Judy & D'Antoine, Heather & Bessarab, Dawn, 2021. "Decolonizing Indigenous health: Generating a productive dialogue to eliminate Rheumatic Heart Disease in Australia," Social Science & Medicine, Elsevier, vol. 277(C).
    12. Pourhejazy, Pourya & Isaksen, K. Robert, 2024. "Exploring the curricular and pedagogical decision criteria for research-based learning design in undergraduate studies," Evaluation and Program Planning, Elsevier, vol. 103(C).
    13. Jiménez-Fernández, Eduardo & Sánchez, Angeles & Ortega-Pérez, Mario, 2022. "Dealing with weighting scheme in composite indicators: An unsupervised distance-machine learning proposal for quantitative data," Socio-Economic Planning Sciences, Elsevier, vol. 83(C).
    14. Baffoe, Gideon, 2019. "Exploring the utility of Analytic Hierarchy Process (AHP) in ranking livelihood activities for effective and sustainable rural development interventions in developing countries," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 197-204.
    15. Noor Imad & Nicole Pearson & Alix Hall & Adam Shoesmith & Nicole Nathan & Luke Giles & Alice Grady & Serene Yoong, 2023. "A Pilot Randomised Controlled Trial to Increase the Sustainment of an Indoor–Outdoor-Free-Play Program in Early Childhood Education and Care Services: A Study Protocol for the Sustaining Play, Sustaining Health (SPSH) Trial," IJERPH, MDPI, vol. 20(6), pages 1-26, March.
    16. Tamara Butler & Alana Gall & Gail Garvey & Khwanruethai Ngampromwongse & Debra Hector & Scott Turnbull & Kerri Lucas & Caroline Nehill & Anna Boltong & Dorothy Keefe & Kate Anderson, 2022. "A Comprehensive Review of Optimal Approaches to Co-Design in Health with First Nations Australians," IJERPH, MDPI, vol. 19(23), pages 1-38, December.
    17. Emma Haynes & Alice Mitchell & Stephanie Enkel & Rosemary Wyber & Dawn Bessarab, 2020. "Voices behind the Statistics: A Systematic Literature Review of the Lived Experience of Rheumatic Heart Disease," IJERPH, MDPI, vol. 17(4), pages 1-25, February.
    18. Durevall, Dick & Isaksson, Ann-Sofie, 2024. "Aid and child health: A disaggregated analysis of the effects of aid on impaired growth," World Development, Elsevier, vol. 182(C).
    19. Emma Haynes & Minitja Marawili & Makungun B. Marika & Alice Mitchell & Roz Walker & Judith M. Katzenellenbogen & Dawn Bessarab, 2022. "Living with Rheumatic Heart Disease at the Intersection of Biomedical and Aboriginal Worldviews," IJERPH, MDPI, vol. 19(8), pages 1-20, April.
    20. Marsha L. Brierley & Lindsey R. Smith & Angel M. Chater & Daniel P. Bailey, 2022. "A-REST (Activity to Reduce Excessive Sitting Time): A Feasibility Trial to Reduce Prolonged Sitting in Police Staff," IJERPH, MDPI, vol. 19(15), pages 1-27, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.