Use of outcome harvesting to understand the outcomes of a COVID-19 pandemic leadership and management program in six countries

The global response to COVID-19 highlighted gaps in pandemic preparedness and response. The Leading and Managing for Results in Pandemics (LMRP) program was developed to strengthen the capacity of public health leaders responding to COVID-19. To assess the influence of the program on applying leadership and management practices and on pandemic readiness, a mixed methods outcome harvesting evaluation approach was adapted. Quantitative programmatic data and supplemental qualitative program participant interview data were analyzed to inform draft outcomes. Program participants validated outcomes, which were then updated, triangulated, and used to inform recommendations. The results illustrated increases in applying leadership and management practices, and improvements in team dynamics and morale. Themes from the qualitative interviews included strengthened teamwork, leadership skills, and ability to manage disease outbreaks and future pandemics. The validated outcomes described improvements in leadership and management skills, pandemic readiness, and interpersonal skills following LMRP participation. The evaluation found evidence that LMRP program participants gained knowledge, skills, and tools, which they applied to perform more effectively as a team and to lead preparation for and management of public health emergencies and disease outbreaks. The program brought about positive changes in the systems and processes through which participants approach their work and apply the leading and managing practices to collaboratively work towards a common goal. Similar evaluation approaches should be utilized to understand and contribute to the limited available evidence on the effect of capacity strengthening programs on developing and applying leadership and management skills.