Validating an evaluation checklist using a mixed method design

When used in evaluation, checklists provide guidance for the collection of relevant evidence used to determine the merit, worth, or significance of an evaluand. The inherently systematic process found in the use of a checklist makes it highly relevant and useful for evaluative purposes. As such, the value of checklists for evaluation purposes is generally accepted. However, the methods for validating evaluation checklists are less commonly presented and lack specificity with respect to study designs and outcomes. This article addresses this deficit by presenting a case example of a mixed methods validation study applied to an evaluation checklist. The validation approach presented herein is relatively quick and was demonstrated to be feasible on a limited budget all the while providing a reasonable level of validation for the checklist. Following a brief overview of the checklist, the two-part validation study is presented followed by a discussion of the limitations of the methodology.