IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v117y2026ics0149718926000236.html

Lessons learned from a collective evaluation and community of practice focused on evidence-based learning

Author

Listed:
  • Anderson, Kelley C.
  • Stern, Marc J.
  • Powell, Robert B.
  • Frensley, B. Troy

Abstract

While it is clear that nonformal education organizations can benefit from program evaluation in many ways, internal capacity to conduct evaluations is a challenge for many organizations. This paper describes a facilitated evidence-based learning network (EBLN) with 32 nonformal education program providers associated with the U.S. National Park Service. The EBLN combined elements of collective evaluation with a community of practice to build evaluation capacity, foster collaboration, and promote adaptive management and programmatic improvement. Network participants demonstrated gains within each cycle of value creation identified in the CoP literature: immediate, potential, applied, realized, and reframing value. They gained capacity in evaluation and adaptive management, ideas for programmatic improvement, evidence associated with the application of new practices, and new ideas about what is possible to achieve within their programming. We describe the design of the EBLN and discuss lessons learned to improve similar efforts in the future.

Suggested Citation

  • Anderson, Kelley C. & Stern, Marc J. & Powell, Robert B. & Frensley, B. Troy, 2026. "Lessons learned from a collective evaluation and community of practice focused on evidence-based learning," Evaluation and Program Planning, Elsevier, vol. 117(C).
  • Handle: RePEc:eee:epplan:v:117:y:2026:i:c:s0149718926000236
    DOI: 10.1016/j.evalprogplan.2026.102773
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718926000236
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2026.102773?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Merritt, Eileen G. & Stern, Marc J. & Powell, Robert B. & Frensley, Brandon T., 2023. "Benefits of participation in a community of practice focused on evaluation and programmatic improvement for environmental educators," Evaluation and Program Planning, Elsevier, vol. 99(C).
    2. Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
    3. Carleton-Hug, Annelise & Hug, J. William, 2010. "Challenges and opportunities for evaluating environmental education programs," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 159-164, May.
    4. Naccarella, Lucio & Pirkis, Jane & Kohn, Fay & Morley, Belinda & Burgess, Philip & Blashki, Grant, 2007. "Building evaluation capacity: Definitional and practical implications from an Australian case study," Evaluation and Program Planning, Elsevier, vol. 30(3), pages 231-236, August.
    5. Kumar Chaudhary, Anil & Diaz, John & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Evaluation capacity building in the nonformal education context: Challenges and strategies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kumar Chaudhary, Anil & Diaz, John & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Evaluation capacity building in the nonformal education context: Challenges and strategies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    2. Merritt, Eileen G. & Stern, Marc J. & Powell, Robert B. & Frensley, Brandon T., 2023. "Benefits of participation in a community of practice focused on evaluation and programmatic improvement for environmental educators," Evaluation and Program Planning, Elsevier, vol. 99(C).
    3. Allred, Shorna & Stedman, Richard & Heady, Laura & Strong, Karen, 2021. "Incorporating biodiversity in municipal land-use planning: An assessment of technical assistance, policy capacity, and conservation outcomes in New York’s Hudson Valley," Land Use Policy, Elsevier, vol. 104(C).
    4. Rochelle Tobin & Gemma Crawford & Jonathan Hallett & Bruce Richard Maycock & Roanna Lobo, 2022. "Critical factors that affect the functioning of a research and evaluation capacity building partnership: A causal loop diagram," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-22, January.
    5. Issa Ibrahim Berchin & Ana Regina de Aguiar Dutra & José Baltazar Salgueirinho Osório de Andrade Guerra, 2021. "How do higher education institutions promote sustainable development? A literature review," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(6), pages 1204-1222, November.
    6. Lim, E.A & Manohar, M. & Aziz, Azlizam & Zakaria, M., 2016. "Influencing secondary school STUDENTS’ conservation behavior intention through an interpretive education program on the malayan tapir," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 60-69.
    7. Kirsten M. M. Beyer & Elizabeth F. Heller & Jessica M. Bizub & Amy J. Kistner & Aniko Szabo & Erin E. Shawgo & Corey J. Zetts, 2015. "More than a Pretty Place: Assessing the Impact of Environmental Education on Children’s Knowledge and Attitudes about Outdoor Play in Nature," IJERPH, MDPI, vol. 12(2), pages 1-17, February.
    8. Crohn, Kara & Birnbaum, Matthew, 2010. "Environmental education evaluation: Time to reflect, time for change," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 155-158, May.
    9. Zhaoliang Wu & Min Jin & Hu Cao, 2024. "Residents' environmental behavior in eco‐community development and its influencing factors: Evidence from Dongying City, Shandong Province in China," Sustainable Development, John Wiley & Sons, Ltd., vol. 32(5), pages 4338-4353, October.
    10. Fleming, M. Lynette & Easton, Janice, 2010. "Building environmental educators' evaluation capacity through distance education," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 172-177, May.
    11. Yu.V. Lyandau & I.A. Kalinina & A.P. Garnov & Y.Yu. Garnova, 2018. "Research of the Russian Companies’ Potential and the Success Factors," European Research Studies Journal, European Research Studies Journal, vol. 0(Special1), pages 250-260.
    12. Shih-Yeh Chen & Shiang-Yao Liu, 2020. "Developing Students’ Action Competence for a Sustainable Future: A Review of Educational Research," Sustainability, MDPI, vol. 12(4), pages 1-14, February.
    13. Tseng, Shu-Hui, 2011. "An assessment scale of ECB: Perspectives from the faculty and staff of technical colleges in Taiwan," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 154-159, May.
    14. Rogers, Alison F. & Kelly, Leanne M. & McCoy, Alicia, 2019. "Pathways to becoming an internal evaluator: Perspectives from the Australian non-government sector," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 102-109.
    15. Pedro Mauricio Acosta Castellanos & Araceli Queiruga-Dios & Ascensión Hernández Encinas & Libia Cristina Acosta, 2020. "Environmental Education in Environmental Engineering: Analysis of the Situation in Colombia and Latin America," Sustainability, MDPI, vol. 12(18), pages 1-14, September.
    16. Hummell, Caroline & Bean, Corliss & Riche, Micaella & Penrose, Chris, 2026. "Organizational learning through evaluation: A reflective case narrative of a Canadian sport-for-development program evaluation champion," Evaluation and Program Planning, Elsevier, vol. 117(C).
    17. Mayer, Duncan J. & Fischer, Robert L., 2023. "Exploring data use in nonprofit organizations," Evaluation and Program Planning, Elsevier, vol. 97(C).
    18. Katerina Kabassi, 2021. "Comparing Multi-Criteria Decision Making Models for Evaluating Environmental Education Programs," Sustainability, MDPI, vol. 13(20), pages 1-17, October.
    19. Nielsen, Steffen Bohni & Lemire, Sebastian & Bourgeois, Isabelle & Fierro, Leslie A., 2023. "Mapping the evaluation capacity building landscape: A bibliometric analysis of scholarly communities and themes," Evaluation and Program Planning, Elsevier, vol. 99(C).
    20. Teodoro Rafael Wendlandt Amézaga & José Luis Camarena & Roberto Celaya Figueroa & Karla Alejandra Garduño Realivazquez, 2022. "Measuring sustainable development knowledge, attitudes, and behaviors: evidence from university students in Mexico," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 24(1), pages 765-788, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:117:y:2026:i:c:s0149718926000236. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.