IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v59y2016icp62-73.html
   My bibliography  Save this article

Making sense of the emerging conversation in evaluation about systems thinking and complexity science

Author

Listed:
  • Gates, Emily F.

Abstract

In the last twenty years, a conversation has emerged in the evaluation field about the potential of systems thinking and complexity science (STCS) to transform the practice of evaluating social interventions. Documenting and interpreting this conversation are necessary to advance our understanding of the significance of using STCS in planning, implementing, and evaluating social interventions. Guided by a generic framework for evaluation practice, this paper reports on an inter-disciplinary literature review and argues that STCS raises some new ways of thinking about and carrying out the following six activities: 1) supporting social problem solving; 2) framing interventions and contexts; 3) selecting and using methods; 4) engaging in valuing; 5) producing and justifying knowledge; and 6) facilitating use. Following a discussion of these issues, future directions for research and practice are suggested.

Suggested Citation

  • Gates, Emily F., 2016. "Making sense of the emerging conversation in evaluation about systems thinking and complexity science," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 62-73.
  • Handle: RePEc:eee:epplan:v:59:y:2016:i:c:p:62-73
    DOI: 10.1016/j.evalprogplan.2016.08.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915300860
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2016.08.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dyehouse, Melissa & Bennett, Deborah & Harbor, Jon & Childress, Amy & Dark, Melissa, 2009. "A comparison of linear and systems thinking approaches for program evaluation illustrated using the Indiana Interdisciplinary GK-12," Evaluation and Program Planning, Elsevier, vol. 32(3), pages 187-196, August.
    2. -, 1998. "Evaluación de Quito," Copublicaciones, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 2058.
    3. Kinschak À. V., 2015. "World experience of regional development policy," Visnyk of National University of Civil Protection of Ukraine. Public Administration series., National University of Civil Protection of Ukraine, vol. 3(2), pages 187-196, July.
    4. Ipdev ., 2015. "Impacts of the IPR Rules on Sustainable Development," Working Papers id:7226, eSocialSciences.
    5. Sterman, J.D., 2006. "Learning from evidence in a complex world," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 505-514.
    6. Leischow, S.J. & Milstein, B., 2006. "Systems thinking and modeling for public health practice," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 403-405.
    7. A Boyd & T Geerling & W J Gregory & C Kagan & G Midgley & P Murray & M P Walsh, 2007. "Systemic evaluation: a participative, multi-method approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(10), pages 1306-1320, October.
    8. Cabrera, Derek & Colosi, Laura & Lobdell, Claire, 2008. "Systems thinking," Evaluation and Program Planning, Elsevier, vol. 31(3), pages 299-310, August.
    9. Bharat Diwakar & Gilad Sorek, 2015. "Economic Development and Stage-Dependent IPR," Auburn Economics Working Paper Series auwp2015-16, Department of Economics, Auburn University.
    10. ., 2015. "Theoretical evolution of economic development," Chapters, in: Introduction to Regional Economic Development, chapter 2, pages 25-35, Edward Elgar Publishing.
    11. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    12. Margaret B. Hargreaves, 2010. "Evaluating System Change: A Planning Guide," Mathematica Policy Research Reports c0adec4cd1984ff1b2b29ebab, Mathematica Policy Research.
    13. repec:mpr:mprres:6558 is not listed on IDEAS
    14. Ian Sanderson, 2009. "Intelligent Policy Making for a Complex World: Pragmatism, Evidence and Learning," Political Studies, Political Studies Association, vol. 57(4), pages 699-719, December.
    15. anonymous, 1998. "Evaluating the power of monetary policy," Economics Update, Federal Reserve Bank of Atlanta, issue Oct, pages 1-5.
    16. Kincaid, Harold (ed.), 2012. "The Oxford Handbook of Philosophy of Social Science," OUP Catalogue, Oxford University Press, number 9780195392753, Decembrie.
    17. Chan, Jackie M.L. & Manova, Kalina, 2015. "Financial development and the choice of trade partners," Journal of Development Economics, Elsevier, vol. 116(C), pages 122-145.
    18. ., 2015. "Conflict management in regional development," Chapters, in: Introduction to Regional Economic Development, chapter 4, pages 50-60, Edward Elgar Publishing.
    19. Michael W-P Fortunato, 2015. "Entrepreneurship, innovation and regional development," Community Development, Taylor & Francis Journals, vol. 46(5), pages 601-603, December.
    20. Wasserman, Deborah L., 2010. "Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 67-80, May.
    21. Ian Sanderson, 2009. "Intelligent Policy Making for a Complex World: Pragmatism, Evidence and Learning," Political Studies, Political Studies Association, vol. 57, pages 699-719, December.
    22. Maendra Dev, S., 2015. "India Development Report 2015," OUP Catalogue, Oxford University Press, number 9780199459452, Decembrie.
    23. Trochim, W.M. & Cabrera, D.A. & Milstein, B. & Gallagher, R.S. & Leischow, S.J., 2006. "Practical challenges of systems thinking and modeling in public health," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 538-546.
    24. ., 2015. "Traditional regional economic development theories," Chapters, in: Introduction to Regional Economic Development, chapter 5, pages 61-84, Edward Elgar Publishing.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rohanna, Kristen L. & Christie, Christina A., 2023. "A problem-bound evaluation approach," Evaluation and Program Planning, Elsevier, vol. 96(C).
    2. McGill, Elizabeth & Er, Vanessa & Penney, Tarra & Egan, Matt & White, Martin & Meier, Petra & Whitehead, Margaret & Lock, Karen & Anderson de Cuevas, Rachel & Smith, Richard & Savona, Natalie & Rutter, 2021. "Evaluation of public health interventions from a complex systems perspective: A research methods review," Social Science & Medicine, Elsevier, vol. 272(C).
    3. Lawlor, Jennifer A. & McGirr, Sara, 2017. "Agent-based modeling as a tool for program design and evaluation," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 131-138.
    4. Töhönen, Harri & Kauppinen, Marjo & Männistö, Tomi & Itälä, Timo, 2020. "A conceptual framework for valuing IT within a business system," International Journal of Accounting Information Systems, Elsevier, vol. 36(C).
    5. Gianna Moscardo, 2021. "Using Systems Thinking to Improve Tourism and Hospitality Research Quality and Relevance: A Critical Review and Conceptual Analysis," Tourism and Hospitality, MDPI, vol. 2(1), pages 1-20, March.
    6. Daniel E. Ufua & Evans Osabuohien & Mercy E. Ogbari & Hezekiah O. Falola & Emmanuel E. Okoh & Adnan Lakhani, 2021. "Re-Strategising Government Palliative Support Systems in Tackling the Challenges of COVID-19 Lockdown in Lagos State, Nigeria," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 22(1), pages 19-32, June.
    7. Cunico, Giovanni & Aivazidou, Eirini & Mollona, Edoardo, 2021. "Beyond financial proxies in Cohesion Policy inputs’ monitoring: A system dynamics approach," Evaluation and Program Planning, Elsevier, vol. 89(C).
    8. Luis Arturo Pinzon‐Salcedo & María Alejandra Torres‐Cuello, 2022. "Systems thinking concepts within a collaborative programme evaluation methodology: The Hermes Programme evaluation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(4), pages 708-722, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    2. Pietrapertosa, Filomena & Khokhlov, Valeriy & Salvia, Monica & Cosmi, Carmelina, 2018. "Climate change adaptation policies and plans: A survey in 11 South East European countries," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P2), pages 3041-3050.
    3. DIARRA, Setou & LEBIHAN, Laetitia & MAO TAKONGMO, Charles Olivier, 2018. "Polygyny, Child Education, Health and Labour: Theory and Evidence from Mali," MPRA Paper 88518, University Library of Munich, Germany.
    4. Selamawit G. Kebede & Almas Heshmati, 2020. "Energy Use and Labor Productivity in Ethiopia: The Case of the Manufacturing Industry," Energies, MDPI, vol. 13(11), pages 1-21, May.
    5. Juliane Schütt & Katharina Löhr & Michelle Bonatti & Stefan Sieber, 2019. "Conflict Causes and Prevention Strategies at the Society-Science Nexus in Transdisciplinary Collaborative Research Settings: A Case Study of a Food Security Project in Tanzania," Sustainability, MDPI, vol. 11(22), pages 1-19, November.
    6. Priniti Panday, 2020. "Women’s Empowerment and the Well-being of Children in Nepal," Journal of Developing Societies, , vol. 36(2), pages 129-154, June.
    7. Willis, Cameron David & Corrigan, Crystal & Stockton, Lisa & Greene, Julie Kathryn & Riley, Barbara Lyn, 2017. "Exploring the unanticipated effects of multi-sectoral partnerships in chronic disease prevention," Health Policy, Elsevier, vol. 121(2), pages 158-168.
    8. Áron Perényi & Miklós Losoncz, 2018. "A Systematic Review of International Entrepreneurship Special Issue Articles," Sustainability, MDPI, vol. 10(10), pages 1-26, September.
    9. Hazel Squires & James Chilcott & Ronald Akehurst & Jennifer Burr & Michael P. Kelly, 2016. "A systematic literature review of the key challenges for developing the structure of public health economic models," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 61(3), pages 289-298, April.
    10. Priniti Panday & Deanna Rackie & Maria Cornachione Kula, 2020. "The status of women and its influence on children’s well‐being: Do geography, religion and income matter? A comparative study," Development Policy Review, Overseas Development Institute, vol. 38(6), pages 766-782, November.
    11. Pásztor, Szabolcs, 2019. "Gondolatok a fejlesztési segélyek negatív hatásairól P. T. Bauer szellemi örökségének tükrében [Some thoughts on the negative effects of development aid in terms of P. T. Bauers Intellectual Legacy," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(10), pages 1093-1120.
    12. Weeks, Margaret R. & Green Montaque, Helena D. & Lounsbury, David W. & Li, Jianghong & Ferguson, Alice & Warren-Dias, Danielle, 2022. "Using participatory system dynamics learning to support Ryan White Planning Council priority setting and resource allocations," Evaluation and Program Planning, Elsevier, vol. 93(C).
    13. O’Connor John, 2022. "Strengthening the science–policy interface in Ireland," Administration, Sciendo, vol. 70(4), pages 29-52, December.
    14. Sarah Chapman & Adiilah Boodhoo & Carren Duffy & Suki Goodman & Maria Michalopoulou, 2023. "Theory of Change in Complex Research for Development Programmes: Challenges and Solutions from the Global Challenges Research Fund," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(2), pages 298-322, April.
    15. Jason M. Orr & Jonathon P. Leider & Margaret J. Gutilla, 2023. "System approaches in governmental public health: Findings from an analysis of the literature," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 159-169, January.
    16. Crabolu, Gloria & Font, Xavier & Eker, Sibel, 2023. "Evaluating policy complexity with Causal Loop Diagrams," Annals of Tourism Research, Elsevier, vol. 100(C).
    17. repec:mpr:mprres:6558 is not listed on IDEAS
    18. Margaret Hargreaves & Diane Paulsell, 2009. "Evaluating Systems Change Efforts to Support Evidence-Based Home Visiting: Concepts and Methods," Mathematica Policy Research Reports c24fc47e9c744b52a00e2137c, Mathematica Policy Research.
    19. Céline Bérard & L.M., Cloutier & Luc Cassivi, 2017. "The effects of using system dynamics-based decision support models: testing policy-makers’ boundaries in a complex situation," Post-Print hal-02128255, HAL.
    20. Ansell, Christopher K. & Bartenberger, Martin, 2016. "Varieties of experimentalism," Ecological Economics, Elsevier, vol. 130(C), pages 64-73.
    21. Liesel Carlsson & Edith Callaghan & Göran Broman, 2021. "Assessing Community Contributions to Sustainable Food Systems: Dietitians Leverage Practice, Process and Paradigms," Systemic Practice and Action Research, Springer, vol. 34(5), pages 575-601, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:59:y:2016:i:c:p:62-73. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.