IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v77y2019ics0149718918303902.html

Assessment of the monitoring and evaluation system of a population-based program: Theory-driven evaluation approach

Author

Listed:
  • Chen, Huey T.
  • Morosanu, Liliana
  • Powell-Threets, Kia
  • Lian, Brad
  • Turner, Nannette

Abstract

The purpose of this study was to assess the performance of a monitoring and evaluation system (M&E) for a population-based program and to identify factors influencing its performance. The state health department provided a grant, guide, and training for health districts to implement the program and report quarterly and annually to the M&E. Some health districts did not meet this requirement. We also found that the M&E did not adequately capture the actual work of the districts in communities as related to the work plan. We identified several factors that negatively affected the performances of the M&E. For example, the state and health districts did not have a shared vision on how to develop and implement the program, and what to report to the M&E. We proposed strategies that could improve the timeliness and content of reports to the M&E, as well as its utilization in the future.

Suggested Citation

  • Chen, Huey T. & Morosanu, Liliana & Powell-Threets, Kia & Lian, Brad & Turner, Nannette, 2019. "Assessment of the monitoring and evaluation system of a population-based program: Theory-driven evaluation approach," Evaluation and Program Planning, Elsevier, vol. 77(C).
    • Handle: RePEc:eee:epplan:v:77:y:2019:i:c:s0149718918303902
    DOI: 10.1016/j.evalprogplan.2019.101719
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718918303902
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.101719?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. repec:wbk:wbpubs:6851 is not listed on IDEAS
    2. repec:wbk:wbpubs:27574 is not listed on IDEAS
    3. Peter Dahler-Larsen, 2014. "Constitutive Effects of Performance Indicators: Getting beyond unintended consequences," Public Management Review, Taylor & Francis Journals, vol. 16(7), pages 969-986, October.
    4. Marra, Mita, 2018. "The ambiguities of performance-based governance reforms in Italy: Reviving the fortunes of evaluation and performance measurement," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 173-182.
    5. Midgley, G., 2006. "Systemic intervention for public health," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 466-472.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Melinda Craike & Bojana Klepac & Amy Mowle & Therese Riley, 2023. "Theory of systems change: An initial, middle-range theory of public health research impact," Research Evaluation, Oxford University Press, vol. 32(3), pages 603-621.
    2. Chiara Oppi & Cristina Campanale & Lino Cinquini, 2021. "Il problema dell?ambiguit? nei sistemi di misurazione della performance nel settore pubblico: un?analisi della letteratura internazionale," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2021(2), pages 11-38.
    3. Aleksi Aaltonen & Marta Stelmaszak, 2024. "The Performative Production of Trace Data in Knowledge Work," Information Systems Research, INFORMS, vol. 35(3), pages 1448-1462, September.
    4. Giliberto Capano & Benedetto Lepori, 2024. "Designing policies that could work: understanding the interaction between policy design spaces and organizational responses in public sector," Policy Sciences, Springer;Society of Policy Sciences, vol. 57(1), pages 53-82, March.
    5. Fontdevila, Clara, 2023. "The politics of good enough data. Developments, dilemmas and deadlocks in the production of global learning metrics," International Journal of Educational Development, Elsevier, vol. 96(C).
    6. Céline Bérard & L.M., Cloutier & Luc Cassivi, 2017. "The effects of using system dynamics-based decision support models: testing policy-makers’ boundaries in a complex situation," Post-Print hal-02128255, HAL.
    7. Jeongeun Kim, 2018. "The Functions and Dysfunctions of College Rankings: An Analysis of Institutional Expenditure," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(1), pages 54-87, February.
    8. Julia Heuritsch, 2023. "The Evaluation Gap in Astronomy—Explained through a Rational Choice Framework," Publications, MDPI, vol. 11(2), pages 1-26, June.
    9. Daniel Culotta & Arnim Wiek & Nigel Forrest, 2016. "Selecting and coordinating local and regional climate change interventions," Environment and Planning C, , vol. 34(7), pages 1241-1266, November.
    10. Elizabeth Troncoso & Francisco Ganga-Contreras & Margarita Briceño, 2022. "Incentive Policies for Scientific Publications in the State Universities of Chile," Publications, MDPI, vol. 10(2), pages 1-19, June.
    11. Therese Riley & Liza Hopkins & Maria Gomez & Seanna Davidson & Daniel Chamberlain & Jessica Jacob & Sonia Wutzke, 2021. "A Systems Thinking Methodology for Studying Prevention Efforts in Communities," Systemic Practice and Action Research, Springer, vol. 34(5), pages 555-573, October.
    12. Nicolò, Giuseppe & Raimo, Nicola & Polcini, Paolo Tartaglia & Vitolla, Filippo, 2021. "Unveiling the link between performance and Intellectual Capital disclosure in the context of Italian Public universities," Evaluation and Program Planning, Elsevier, vol. 88(C).
    13. Lino Cinquini & Cristina Campanale & Flavio Del Bianco & Chiara Oppi, 2021. "Un modello di performance management per mitigare il problema dell?ambiguit? nell?organizzazione della prevenzione collettiva: il caso della Regione Friuli-Venezia Giulia," MECOSAN, FrancoAngeli Editore, vol. 0(117), pages 77-109.
    14. Berkeley, Dina & Springett, Jane, 2006. "From rhetoric to reality: A systemic approach to understanding the constraints faced by Health For All initiatives in England," Social Science & Medicine, Elsevier, vol. 63(11), pages 2877-2889, December.
    15. Julia Heuritsch, 2021. "Reflexive Behaviour: How Publication Pressure Affects Research Quality in Astronomy," Publications, MDPI, vol. 9(4), pages 1-23, November.
    16. Sydelko, Pamela & Midgley, Gerald & Espinosa, Angela, 2021. "Designing interagency responses to wicked problems: Creating a common, cross-agency understanding," European Journal of Operational Research, Elsevier, vol. 294(1), pages 250-263.
    17. Ha TN Hoang & Norma RA Romm, 2020. "Systemic Research Practices Towards the Development of an Eco-Community in Vietnam: some Joint Post-Facto Reflections," Systemic Practice and Action Research, Springer, vol. 33(6), pages 599-624, December.
    18. Chen, Huey T., 2016. "Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 109-118.
    19. Sadhvi Krishnamoorthy & Sharna Mathieu & Victoria Ross & Gregory Armstrong & Kairi Kõlves, 2022. "What Are Complex Interventions in Suicide Research? Definitions, Challenges, Opportunities, and the Way Forward," IJERPH, MDPI, vol. 19(14), pages 1-10, July.
    20. Melton, Theresa N. & Sjogren, Ashlee L. & Agans, Jennifer P., 2024. "Engaging evaluation champions: strategies to build evaluation capacity and promote data-informed decision making in youth development," Evaluation and Program Planning, Elsevier, vol. 106(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:77:y:2019:i:c:s0149718918303902. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.