How program evaluators use and learn to use rubrics to make evaluative reasoning explicit

A rubric is a tool that can support evaluators in a core function of their practice—the process of combining evidence with values to determine merit, worth, or significance—however, little guidance specific to evaluation exists. This study examined, through semi-structured interviews, how a rare group of nine rubric-using seasoned evaluators from across the globe use and learned to use rubrics in their program evaluation practice. Key findings revealed rubrics were a critical component to the practice of these evaluators to make determinations, but also as frameworks to sharpen an evaluation’s focus. Additionally, findings support the notion that there is a paucity of formal channels for learning about rubrics and indicate these early adopters are instead, honing their skills through informal channels such as trial and error and by tapping into a community of practice. Future directions for training and research should include expanding understanding, application, and acceptance of use.