IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718923000034.html
   My bibliography  Save this article

Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program Planning

Author

Listed:
  • Teasdale, Rebecca M.
  • Strasser, Mikayla
  • Moore, Ceily
  • Graham, Kara E.

Abstract

Evaluative criteria represent values about characteristics that define a successful evaluand. Criteria direct evaluators’ lines of inquiry, including how aims are framed, which questions are asked, and what conclusions are reached. Yet, criteria often remain unstated, and little is known about criteria employed in practice.

Suggested Citation

  • Teasdale, Rebecca M. & Strasser, Mikayla & Moore, Ceily & Graham, Kara E., 2023. "Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program Planning," Evaluation and Program Planning, Elsevier, vol. 97(C).
    • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000034
    DOI: 10.1016/j.evalprogplan.2023.102226
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718923000034
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2023.102226?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Burke, Holly McClain & Packer, Catherine & González-Calvo, Lázaro & Ridgeway, Kathleen & Lenzi, Rachel & Green, Ann F. & Moon, Troy D., 2019. "A longitudinal qualitative evaluation of an economic and social empowerment intervention to reduce girls’ vulnerability to HIV in rural Mozambique," Evaluation and Program Planning, Elsevier, vol. 77(C).
    2. Udouj, Gary & Grover, Kenda & Belcher, Greg & Kacirek, Kit, 2017. "An investigation of perceptions of programme quality support of adult basic education programmes," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 106-112.
    3. Annesi, James J., 2019. "Change in behavioral exercise program-associated self-regulation enhances self-regulation-induced eating improvements across levels of obesity severity," Evaluation and Program Planning, Elsevier, vol. 75(C), pages 31-37.
    4. Haynes, Emma & Marawili, Minitja & Marika, Brendan Makungun & Mitchell, Alice G. & Phillips, Jodi & Bessarab, Dawn & Walker, Roz & Cook, Jeff & Ralph, Anna P., 2019. "Community-based participatory action research on rheumatic heart disease in an Australian Aboriginal homeland: Evaluation of the ‘On track watch’ project," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 38-53.
    5. Escribano, Silvia & Espada, José P. & Orgilés, Mireia & Morales, Alexandra, 2016. "Implementation fidelity for promoting the effectiveness of an adolescent sexual health program," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 81-87.
    6. Cuenca-García, Eduardo & Sánchez, Angeles & Navarro-Pabsdorf, Margarita, 2019. "Assessing the performance of the least developed countries in terms of the Millennium Development Goals," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 54-66.
    7. Gates, Emily F. & Madres, Joseph & Hall, Jori N. & Alvarez, Kayla Benitez, 2022. "It takes an ecosystem: Socioecological factors influencing equity-oriented evaluation in New England, U.S., 2021," Evaluation and Program Planning, Elsevier, vol. 92(C).
    8. Merrill, Katherine G. & Merrill, Jamison C. & Hershow, Rebecca B. & Barkley, Chris & Rakosa, Boitumelo & DeCelles, Jeff & Harrison, Abigail, 2018. "Linking at-risk South African girls to sexual violence and reproductive health services: A mixed-methods assessment of a soccer-based HIV prevention program and pilot SMS campaign," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 12-24.
    9. Pawlowski, Charlotte Skau & Schmidt, Tanja & Nielsen, Jonas Vestergaard & Troelsen, Jens & Schipperijn, Jasper, 2019. "Will the children use it?—A RE-AIM evaluation of a local public open space intervention involving children from a deprived neighbourhood," Evaluation and Program Planning, Elsevier, vol. 77(C).
    10. LaVenia, Kristina N. & Burgoon, Jacob, 2019. "Urban community as resource: Evaluation of the mentors in Toledo schools program," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 118-124.
    11. Norris, E. & Dunsmuir, S. & Duke-Williams, O. & Stamatakis, E. & Shelton, N., 2018. "Mixed method evaluation of the Virtual Traveller physically active lesson intervention: An analysis using the RE-AIM framework," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 107-114.
    12. Ward, Stéphanie & Chow, Amanda Froehlich & Humbert, M. Louise & Bélanger, Mathieu & Muhajarine, Nazeem & Vatanparast, Hassan & Leis, Anne, 2018. "Promoting physical activity, healthy eating and gross motor skills development among preschoolers attending childcare centers: Process evaluation of the Healthy Start-Départ Santé intervention using t," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 90-98.
    13. Ruel-Bergeron, Julie C. & Hurley, Kristen M. & Kang, Yunhee & Aburto, Nancy & Farhikhtah, Arghanoon & Dinucci, Alessandro & Molinas, Luca & Lee Shu Fune, Wu & Mitra, Maithilee & Phuka, John & Klemm, R, 2019. "Monitoring and evaluation design of Malawi’s Right Foods at the Right Time nutrition program," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 1-9.
    14. Mac Neil, Brad A. & Leung, Pauline & Nadkarni, Pallavi & Stubbs, Laura & Singh, Manya, 2016. "A pilot evaluation of group-based programming offered at a Canadian outpatient adult eating disorders clinic," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 35-41.
    15. Mazur, Rebecca & Woodland, Rebecca H., 2017. "Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning," Evaluation and Program Planning, Elsevier, vol. 62(C), pages 25-34.
    16. Clapham, Kathleen & Manning, Claire & Williams, Kathryn & O’Brien, Ginger & Sutherland, Margaret, 2017. "Using a logic model to evaluate the Kids Together early education inclusion program for children with disabilities and additional needs," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 96-105.
    17. Sharpe, Patricia A. & Wilcox, Sara & Schoffman, Danielle E. & Baruth, Meghan, 2017. "“Participation, satisfaction, perceived benefits, and maintenance of behavioral self-management strategies in a self-directed exercise program for adults with arthritis”," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 143-150.
    18. Mac Giolla Phadraig, Caoimhin & Nunn, June & Guerin, Suzanne & Normand, Charles, 2016. "Should we provide oral health training for staff caring for people with intellectual disabilities in community based residential care? A cost-effectiveness analysis," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 46-54.
    19. Mehiriz, Kaddour, 2016. "The impacts of intergovernmental grants on municipal infrastructure: Evidence from the Canada-Quebec infrastructure works 2000 program," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 184-193.
    20. Boyce, Ayesha S., 2017. "Lessons learned using a values-engaged approach to attend to culture, diversity, and equity in a STEM program evaluation," Evaluation and Program Planning, Elsevier, vol. 64(C), pages 33-43.
    21. Da’ar, Omar B. & Alshaya, Abdulaziz, 2018. "Is it cost-beneficial to society? Measuring the economic worth of dental residency training," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 117-123.
    22. Shannon, Lisa M. & Birdwhistell, Shira & Hulbig, Shelia K. & Jones, Afton Jackson & Newell, Jennifer & Payne, Connie, 2017. "Examining implementation and preliminary performance indicators of veterans treatment courts: The Kentucky experience," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 54-66.
    23. ., 2017. "Updating a living wage estimate," Chapters, in: Living Wages Around the World, chapter 20, pages 339-342, Edward Elgar Publishing.
    24. Schumacker, Randall & Hua, Cheng, 2016. "Synthesis of articles in Evaluation and Program Planning: 2010–2016," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 194-198.
    25. Jaradat, Ghaith M., 2017. "Internship training in computer science: Exploring student satisfaction levels," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 109-115.
    26. Nielsen, Jonas Vestergaard & Skovgaard, Thomas & Bredahl, Thomas Viskum Gjelstrup & Bugge, Anna & Wedderkopp, Niels & Klakk, Heidi, 2018. "Using the RE-AIM framework to evaluate a school-based municipal programme tripling time spent on PE," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 1-11.
    27. Sapru, Saloni & Berktold, Jennifer & Crews, John E. & Katz, L. Jay & Hark, Lisa & Girkin, Christopher A. & Owsley, Cynthia & Francis, Brittney & Saaddine, Jinan B., 2017. "Applying RE-AIM to evaluate two community-based programs designed to improve access to eye care for those at high-risk for glaucoma," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 40-46.
    28. Stewart, Gregory & Webster, Collin A. & Weaver, R. Glenn & Stodden, David F. & Brian, Ali & Egan, Cate A. & Michael, Robert Dan & Sacko, Ryan & Patey, Matthew, 2019. "Evaluation of a classroom movement integration training delivered in a low socioeconomic school district," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 187-194.
    29. Goldberg, Jessica & Bumgarner, Erin & Jacobs, Francine, 2016. "Measuring program- and individual-level fidelity in a home visiting program for adolescent parents," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 163-173.
    30. Millett, Lina Sapokaite & Ben-David, Vered & Jonson-Reid, Melissa & Echele, Greg & Moussette, Pam & Atkins, Valerie, 2016. "Understanding change among multi-problem families: Learnings from a formative program assessment," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 176-183.
    31. Lim, E.A & Manohar, M. & Aziz, Azlizam & Zakaria, M., 2016. "Influencing secondary school STUDENTS’ conservation behavior intention through an interpretive education program on the malayan tapir," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 60-69.
    32. Oldewage-Theron, Wilna Hendrika & Duvenage, Sara Susanna & Egal, Abdulkadir Ali & Lyford, Conrad, 2018. "Comparative analysis of the factors contributing to sustainability of a food and nutrition intervention programme: Two case studies from South Africa," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 51-57.
    33. Ayob, Abu H. & Morell, Jonathan A., 2016. "The historical path of evaluation as reflected in the content of Evaluation and Program Planning," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 20-27.
    34. Kaur, Manmeet & Jaswal, Nidhi & Saddi, Anil Kumar, 2017. "Evaluation of a women group led health communication program in Haryana, India," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 12-19.
    35. Lucas, Rochelle Irene & Promentilla, Michael Angelo & Ubando, Aristotle & Tan, Raymond Girard & Aviso, Kathleen & Yu, Krista Danielle, 2017. "An AHP-based evaluation method for teacher training workshop on information and communication technology," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 93-100.
    36. Kinchin, Irina & Jacups, Susan & Hunter, Gary & Rogerson, Bernadette, 2016. "Economic evaluation of ‘Return to Country’: A remote Australian initiative to address indigenous homelessness," Evaluation and Program Planning, Elsevier, vol. 56(C), pages 69-75.
    37. Ford-Paz, Rebecca E. & Crown, Laurel & Lawton, Kathryn & Goldenthal, Hayley & Day, Gail & Coyne, Claire A. & Gill, Tara & Harris, Ngozi & Blakemore, Sheree & Cicchetti, Colleen, 2019. "Working on Womanhood (WOW): A participatory formative evaluation of a community-developed intervention," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 237-249.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lavrencic, Louise M. & Donovan, Terrence & Moffatt, Lindy & Keiller, Tamara & Allan, Wendy & Delbaere, Kim & Radford, Kylie, 2021. "Ngarraanga Giinganay (‘thinking peacefully’): Co-design and pilot study of a culturally-grounded mindfulness-based stress reduction program with older First Nations Australians," Evaluation and Program Planning, Elsevier, vol. 87(C).
    2. Kristina Vine & Tessa Benveniste & Shanthi Ramanathan & Jo Longman & Megan Williams & Alison Laycock & Veronica Matthews, 2023. "Culturally Informed Australian Aboriginal and Torres Strait Islander Evaluations: A Scoping Review," IJERPH, MDPI, vol. 20(14), pages 1-16, July.
    3. Maarja Kalma & Katrin Mägi & Evelin Mäestu & Kerli Mooses & Merike Kull, 2022. "Design Process and Implementation of Teacher Training Modules in Movement Integration: What Have We Learnt?," Sustainability, MDPI, vol. 14(9), pages 1-15, May.
    4. Ebenso, Bassey & Manzano, Ana & Uzochukwu, Benjamin & Etiaba, Enyi & Huss, Reinhard & Ensor, Tim & Newell, James & Onwujekwe, Obinna & Ezumah, Nkoli & Hicks, Joe & Mirzoev, Tolib, 2019. "Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 97-110.
    5. Chen, Simiao & Prettner, Klaus & Kuhn, Michael & Bloom, David E., 2021. "The economic burden of COVID-19 in the United States: Estimates and projections under an infection-based herd immunity approach," The Journal of the Economics of Ageing, Elsevier, vol. 20(C).
    6. Olena Ivanova & Masna Rai & Kristien Michielsen & Sónia Dias, 2020. "How Sexuality Education Programs Have Been Evaluated in Low- and Lower-Middle-Income Countries? A Systematic Review," IJERPH, MDPI, vol. 17(21), pages 1-17, November.
    7. María-José Vieira & Camino Ferreira & Agustín Rodríguez-Esteban & Javier Vidal, 2021. "Towards Sustainable Development in Education: Implementing a VET System for In-Service Teachers in Albania," Sustainability, MDPI, vol. 13(16), pages 1-15, August.
    8. Haynes, Emma & Walker, Roz & Mitchell, Alice G. & Katzenellenbogen, Judy & D'Antoine, Heather & Bessarab, Dawn, 2021. "Decolonizing Indigenous health: Generating a productive dialogue to eliminate Rheumatic Heart Disease in Australia," Social Science & Medicine, Elsevier, vol. 277(C).
    9. Baffoe, Gideon, 2019. "Exploring the utility of Analytic Hierarchy Process (AHP) in ranking livelihood activities for effective and sustainable rural development interventions in developing countries," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 197-204.
    10. Marsha L. Brierley & Lindsey R. Smith & Angel M. Chater & Daniel P. Bailey, 2022. "A-REST (Activity to Reduce Excessive Sitting Time): A Feasibility Trial to Reduce Prolonged Sitting in Police Staff," IJERPH, MDPI, vol. 19(15), pages 1-27, July.
    11. Bujold, M. & El Sherif, R. & Bush, P.L. & Johnson-Lafleur, J. & Doray, G. & Pluye, P., 2018. "Ecological content validation of the Information Assessment Method for parents (IAM-parent): A mixed methods study," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 79-88.
    12. Morales, Alexandra & Garcia-Montaño, Eileen & Barrios-Ortega, Cristian & Niebles-Charris, Janivys & Garcia-Roncallo, Paola & Abello-Luque, Daniella & Gomez-Lugo, Mayra & Saavedra, Diego Alejandro & Va, 2019. "Adaptation of an effective school-based sexual health promotion program for youth in Colombia," Social Science & Medicine, Elsevier, vol. 222(C), pages 207-215.
    13. Adriana Nielsen-Rodríguez & Ramón Romance & Juan Carlos Dobado-Castañeda, 2021. "Teaching Methodologies and School Organization in Early Childhood Education and Its Association with Physical Activity," IJERPH, MDPI, vol. 18(7), pages 1-25, April.
    14. Srivatsa Srinivas, S. & Marathe, Rahul R., 2021. "Averting adverse selection: The Government of India's scheme to distribute affordable medicines," Socio-Economic Planning Sciences, Elsevier, vol. 78(C).
    15. Kim, Eungdo & Kim, Soyoung & Kim, Hongbum, 2017. "Development of an evaluation framework for publicly funded R&D projects: The case of Korea's Next Generation Network," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 18-28.
    16. Gates, Emily F. & Madres, Joseph & Hall, Jori N. & Alvarez, Kayla Benitez, 2022. "It takes an ecosystem: Socioecological factors influencing equity-oriented evaluation in New England, U.S., 2021," Evaluation and Program Planning, Elsevier, vol. 92(C).
    17. Fernández-Martínez, Iván & Orgilés, Mireia & Espada, José P. & Essau, Cecilia A. & Morales, Alexandra, 2021. "Effects as a function of implementation fidelity of a transdiagnostic prevention program in young school-aged children," Evaluation and Program Planning, Elsevier, vol. 89(C).
    18. Mersky, Joshua P. & Janczewski, Colleen E. & Plummer Lee, ChienTi & Yasin, Tajammal, 2022. "Impact of home visiting programs on parenting stress in low-income women: Findings from a community-based trial at an urban health department," Children and Youth Services Review, Elsevier, vol. 142(C).
    19. Chiang, Chien-Jen & Jonson-Reid, Melissa & Drake, Brett, 2020. "Caregiver physical health and child maltreatment reports and rereports," Children and Youth Services Review, Elsevier, vol. 108(C).
    20. Nikolić, Vlastimir & Petković, Dalibor & Denić, Nebojša & Milovančević, Miloš & Gavrilović, Snežana, 2019. "Appraisal and review of e-learning and ICT systems in teaching process," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 456-464.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.