IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v96y2023ics0149718922001410.html
   My bibliography  Save this article

A problem-bound evaluation approach

Author

Listed:
  • Rohanna, Kristen L.
  • Christie, Christina A.

Abstract

Traditional modes of evaluation can be constraining when seeking to improve persistent societal problems within complex systems. Frameworks that assume stability and predictability may not match the system dynamics within which a program resides. This paper seeks to further evaluators' understanding of how to improve problems in complex systems by offering a "problem-bound" evaluation approach. This model is grounded in theoretical concepts from complexity science, complex adaptive systems, systems thinking, and improvement science. As such, it provides an agile and flexible framework for continually learning from emergent findings related to the problem. By offering this model, we seek to contribute to the limited knowledge base on how to apply systems change theoretical ideas in evaluation practice, along with practical implications regarding the evaluator's role.

Suggested Citation

  • Rohanna, Kristen L. & Christie, Christina A., 2023. "A problem-bound evaluation approach," Evaluation and Program Planning, Elsevier, vol. 96(C).
    • Handle: RePEc:eee:epplan:v:96:y:2023:i:c:s0149718922001410
    DOI: 10.1016/j.evalprogplan.2022.102187
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718922001410
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2022.102187?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Derek Cabrera & Laura Cabrera & Erin Powers, 2015. "A Unifying Theory of Systems Thinking with Psychosocial Applications," Systems Research and Behavioral Science, Wiley Blackwell, vol. 32(5), pages 534-545, September.
    2. Gates, Emily F., 2016. "Making sense of the emerging conversation in evaluation about systems thinking and complexity science," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 62-73.
    3. Maria Alejandra Torres‐Cuello & Luis Pinzón‐Salcedo & Gerald Midgley, 2018. "Developing a Systemic Program Evaluation Methodology: A Critical Systems Perspective," Systems Research and Behavioral Science, Wiley Blackwell, vol. 35(5), pages 538-547, September.
    4. Bob Williams, 2015. "Prosaic or Profound? The Adoption of Systems Ideas by Impact Evaluation," IDS Bulletin, Blackwell Publishing, vol. 46(1), pages 7-16, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luis Arturo Pinzon‐Salcedo & María Alejandra Torres‐Cuello, 2022. "Systems thinking concepts within a collaborative programme evaluation methodology: The Hermes Programme evaluation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(4), pages 708-722, July.
    2. McGill, Elizabeth & Er, Vanessa & Penney, Tarra & Egan, Matt & White, Martin & Meier, Petra & Whitehead, Margaret & Lock, Karen & Anderson de Cuevas, Rachel & Smith, Richard & Savona, Natalie & Rutter, 2021. "Evaluation of public health interventions from a complex systems perspective: A research methods review," Social Science & Medicine, Elsevier, vol. 272(C).
    3. Jagustović, Renata & Zougmoré, Robert B. & Kessler, Aad & Ritsema, Coen J. & Keesstra, Saskia & Reynolds, Martin, 2019. "Contribution of systems thinking and complex adaptive system attributes to sustainable food production: Example from a climate-smart village," Agricultural Systems, Elsevier, vol. 171(C), pages 65-75.
    4. Cabrera, Derek & Cabrera, Laura & Powers, Erin & Solin, Jeremy & Kushner, Jennifer, 2018. "Applying systems thinking models of organizational design and change in community operational research," European Journal of Operational Research, Elsevier, vol. 268(3), pages 932-945.
    5. Brocklesby, John & Midgley, Gerald, 2016. "Boundary games: How teams of OR practitioners explore the boundaries of interventionAuthor-Name: Velez-Castiblanco, Jorge," European Journal of Operational Research, Elsevier, vol. 249(3), pages 968-982.
    6. Luis Arturo Pinzon‐Salcedo & Juanita Bernal‐Alvarado, 2022. "Dealing with complexity by using multilevel system boundary models," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(2), pages 175-184, March.
    7. Gianna Moscardo, 2021. "Using Systems Thinking to Improve Tourism and Hospitality Research Quality and Relevance: A Critical Review and Conceptual Analysis," Tourism and Hospitality, MDPI, vol. 2(1), pages 1-20, March.
    8. Luis Arturo Pinzón‐Salcedo & Juanita Bernal‐Alvarado & Eloisa María Ramírez‐Franco & Mario Alejandro Pesca‐Perdomo, 2023. "Do jaguars of the Amazon rainforest have a systemic perspective?," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 3-15, January.
    9. Foote, J. & Midgley, G. & Ahuriri-Driscoll, A. & Hepi, M. & Earl-Goulet, J., 2021. "Systemic evaluation of community environmental management programmes," European Journal of Operational Research, Elsevier, vol. 288(1), pages 207-224.
    10. Martin Reynolds & Emily Gates & Richard Hummelbrunner & Mita Marra & Bob Williams, 2016. "Towards Systemic Evaluation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 33(5), pages 662-673, September.
    11. Bloomfield, Katherine & Williams, Terry & Bovis, Chris & Merali, Yasmin, 2019. "Systemic risk in major public contracts," International Journal of Forecasting, Elsevier, vol. 35(2), pages 667-676.
    12. Gates, Emily F. & Madres, Joseph & Hall, Jori N. & Alvarez, Kayla Benitez, 2022. "It takes an ecosystem: Socioecological factors influencing equity-oriented evaluation in New England, U.S., 2021," Evaluation and Program Planning, Elsevier, vol. 92(C).
    13. Gerald Midgley & Erik Lindhult, 2021. "A systems perspective on systemic innovation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(5), pages 635-670, October.
    14. Gerald Midgley & Jennifer Wilby, 2015. "Learning across Boundaries: Exploring the Variety of Systems Theory and Practice," Systems Research and Behavioral Science, Wiley Blackwell, vol. 32(5), pages 509-513, September.
    15. Szijarto, Barbara & Bradley Cousins, J., 2019. "Mapping the practice of developmental evaluation: Insights from a concept mapping study," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    16. Raghav Rajagopalan & Gerald Midgley, 2015. "Knowing Differently in Systemic Intervention," Systems Research and Behavioral Science, Wiley Blackwell, vol. 32(5), pages 546-561, September.
    17. Daniel E. Ufua & Evans Osabuohien & Mercy E. Ogbari & Hezekiah O. Falola & Emmanuel E. Okoh & Adnan Lakhani, 2021. "Re-Strategising Government Palliative Support Systems in Tackling the Challenges of COVID-19 Lockdown in Lagos State, Nigeria," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 22(1), pages 19-32, June.
    18. Töhönen, Harri & Kauppinen, Marjo & Männistö, Tomi & Itälä, Timo, 2020. "A conceptual framework for valuing IT within a business system," International Journal of Accounting Information Systems, Elsevier, vol. 36(C).
    19. Örsan Şenalp & Gerald Midgley, 2023. "Alexander Bogdanov and the question of unity: An emerging research agenda," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(2), pages 328-348, March.
    20. Lawlor, Jennifer A. & McGirr, Sara, 2017. "Agent-based modeling as a tool for program design and evaluation," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 131-138.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:96:y:2023:i:c:s0149718922001410. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.