A Participatory Method of Assessing Program Implementation

This article integrates previous research on program implementation and extends it to form a participatory approach to evaluating program implementation. A central focus of this method is the continuous, active involvement of program developers, managers, and staff in the evaluation process. The methodology accomplishes this goal while maintaining a high degree of methodological rigor. Initially, program documents are reviewed and several meetings are arranged to discuss the program's activities with program developers, management, and staff. From these documents and meetings, a series of items describing each program activity and three possible levels of implementation are created and formulated into an implementation inventory. Multiple methods for measuring implementation level are then developed in consultation with program developers, management, and staff. Following the collection of data, levels of implementation are determined, and this information is fed back to all concerned parties. Advantages of the participatory approach include increased cooperation of program manage ment and staff; the setting of quantitatively based, realistic levels of implementation; and the combined usage of quantitative and qualitative information. Throughout the article, the basic procedures are illustrated through the application of the method to an actual program.