IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v59y2016icp62-73.html

Making sense of the emerging conversation in evaluation about systems thinking and complexity science

Author

Listed:
  • Gates, Emily F.

Abstract

In the last twenty years, a conversation has emerged in the evaluation field about the potential of systems thinking and complexity science (STCS) to transform the practice of evaluating social interventions. Documenting and interpreting this conversation are necessary to advance our understanding of the significance of using STCS in planning, implementing, and evaluating social interventions. Guided by a generic framework for evaluation practice, this paper reports on an inter-disciplinary literature review and argues that STCS raises some new ways of thinking about and carrying out the following six activities: 1) supporting social problem solving; 2) framing interventions and contexts; 3) selecting and using methods; 4) engaging in valuing; 5) producing and justifying knowledge; and 6) facilitating use. Following a discussion of these issues, future directions for research and practice are suggested.

Suggested Citation

  • Gates, Emily F., 2016. "Making sense of the emerging conversation in evaluation about systems thinking and complexity science," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 62-73.
  • Handle: RePEc:eee:epplan:v:59:y:2016:i:c:p:62-73
    DOI: 10.1016/j.evalprogplan.2016.08.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915300860
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2016.08.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    2. Kincaid, Harold (ed.), 2012. "The Oxford Handbook of Philosophy of Social Science," OUP Catalogue, Oxford University Press, number 9780195392753.
    3. Margaret B. Hargreaves, 2010. "Evaluating System Change: A Planning Guide," Mathematica Policy Research Reports c0adec4cd1984ff1b2b29ebab, Mathematica Policy Research.
    4. repec:mpr:mprres:6558 is not listed on IDEAS
    5. ., 2015. "Traditional regional economic development theories," Chapters, in: Introduction to Regional Economic Development, chapter 5, pages 61-84, Edward Elgar Publishing.
    6. Chan, Jackie M.L. & Manova, Kalina, 2015. "Financial development and the choice of trade partners," Journal of Development Economics, Elsevier, vol. 116(C), pages 122-145.
    7. ., 2015. "Conflict management in regional development," Chapters, in: Introduction to Regional Economic Development, chapter 4, pages 50-60, Edward Elgar Publishing.
    8. Leischow, S.J. & Milstein, B., 2006. "Systems thinking and modeling for public health practice," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 403-405.
    9. A Boyd & T Geerling & W J Gregory & C Kagan & G Midgley & P Murray & M P Walsh, 2007. "Systemic evaluation: a participative, multi-method approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(10), pages 1306-1320, October.
    10. Michael W-P Fortunato, 2015. "Entrepreneurship, innovation and regional development," Community Development, Taylor & Francis Journals, vol. 46(5), pages 601-603, December.
    11. Kinschak À. V., 2015. "World experience of regional development policy," Visnyk of National University of Civil Protection of Ukraine. Public Administration series., National University of Civil Protection of Ukraine, vol. 3(2), pages 187-196, July.
    12. Trochim, W.M. & Cabrera, D.A. & Milstein, B. & Gallagher, R.S. & Leischow, S.J., 2006. "Practical challenges of systems thinking and modeling in public health," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 538-546.
    13. Dyehouse, Melissa & Bennett, Deborah & Harbor, Jon & Childress, Amy & Dark, Melissa, 2009. "A comparison of linear and systems thinking approaches for program evaluation illustrated using the Indiana Interdisciplinary GK-12," Evaluation and Program Planning, Elsevier, vol. 32(3), pages 187-196, August.
    14. Wasserman, Deborah L., 2010. "Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 67-80, May.
    15. Ipdev ., 2015. "Impacts of the IPR Rules on Sustainable Development," Working Papers id:7226, eSocialSciences.
    16. Ian Sanderson, 2009. "Intelligent Policy Making for a Complex World: Pragmatism, Evidence and Learning," Political Studies, Political Studies Association, vol. 57(4), pages 699-719, December.
    17. Cabrera, Derek & Colosi, Laura & Lobdell, Claire, 2008. "Systems thinking," Evaluation and Program Planning, Elsevier, vol. 31(3), pages 299-310, August.
    18. anonymous, 1998. "Evaluating the power of monetary policy," Economics Update, Federal Reserve Bank of Atlanta, issue Oct, pages 1-5.
    19. Ian Sanderson, 2009. "Intelligent Policy Making for a Complex World: Pragmatism, Evidence and Learning," Political Studies, Political Studies Association, vol. 57, pages 699-719, December.
    20. -, 1998. "Evaluación de Quito," Copublicaciones, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 2058.
    21. Bharat Diwakar & Gilad Sorek, 2015. "Economic Development and Stage-Dependent IPR," Auburn Economics Working Paper Series auwp2015-16, Department of Economics, Auburn University.
    22. ., 2015. "Theoretical evolution of economic development," Chapters, in: Introduction to Regional Economic Development, chapter 2, pages 25-35, Edward Elgar Publishing.
    23. Sterman, J.D., 2006. "Learning from evidence in a complex world," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 505-514.
    24. Maendra Dev, S., 2015. "India Development Report 2015," OUP Catalogue, Oxford University Press, number 9780199459452.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. McGill, Elizabeth & Er, Vanessa & Penney, Tarra & Egan, Matt & White, Martin & Meier, Petra & Whitehead, Margaret & Lock, Karen & Anderson de Cuevas, Rachel & Smith, Richard & Savona, Natalie & Rutter, 2021. "Evaluation of public health interventions from a complex systems perspective: A research methods review," Social Science & Medicine, Elsevier, vol. 272(C).
    2. Luis Arturo Pinzon‐Salcedo & María Alejandra Torres‐Cuello, 2022. "Systems thinking concepts within a collaborative programme evaluation methodology: The Hermes Programme evaluation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(4), pages 708-722, July.
    3. Daniel E. Ufua & Evans Osabuohien & Mercy E. Ogbari & Hezekiah O. Falola & Emmanuel E. Okoh & Adnan Lakhani, 2021. "Re-Strategising Government Palliative Support Systems in Tackling the Challenges of COVID-19 Lockdown in Lagos State, Nigeria," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 22(1), pages 19-32, June.
    4. Töhönen, Harri & Kauppinen, Marjo & Männistö, Tomi & Itälä, Timo, 2020. "A conceptual framework for valuing IT within a business system," International Journal of Accounting Information Systems, Elsevier, vol. 36(C).
    5. Rochelle Tobin & Gemma Crawford & Jonathan Hallett & Bruce Richard Maycock & Roanna Lobo, 2022. "Critical factors that affect the functioning of a research and evaluation capacity building partnership: A causal loop diagram," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-22, January.
    6. Lawlor, Jennifer A. & McGirr, Sara, 2017. "Agent-based modeling as a tool for program design and evaluation," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 131-138.
    7. Rohanna, Kristen L. & Christie, Christina A., 2023. "A problem-bound evaluation approach," Evaluation and Program Planning, Elsevier, vol. 96(C).
    8. Cunico, Giovanni & Aivazidou, Eirini & Mollona, Edoardo, 2021. "Beyond financial proxies in Cohesion Policy inputs’ monitoring: A system dynamics approach," Evaluation and Program Planning, Elsevier, vol. 89(C).
    9. Scarth, Amy & Novelli, Marina, 2024. "Travel philanthropy: A multifaceted ‘exchange economy’," Annals of Tourism Research, Elsevier, vol. 106(C).
    10. Gianna Moscardo, 2021. "Using Systems Thinking to Improve Tourism and Hospitality Research Quality and Relevance: A Critical Review and Conceptual Analysis," Tourism and Hospitality, MDPI, vol. 2(1), pages 1-20, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    2. Pietrapertosa, Filomena & Khokhlov, Valeriy & Salvia, Monica & Cosmi, Carmelina, 2018. "Climate change adaptation policies and plans: A survey in 11 South East European countries," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P2), pages 3041-3050.
    3. Priniti Panday, 2020. "Women’s Empowerment and the Well-being of Children in Nepal," Journal of Developing Societies, , vol. 36(2), pages 129-154, June.
    4. DIARRA, Setou & LEBIHAN, Laetitia & MAO TAKONGMO, Charles Olivier, 2018. "Polygyny, Child Education, Health and Labour: Theory and Evidence from Mali," MPRA Paper 88518, University Library of Munich, Germany.
    5. Willis, Cameron David & Corrigan, Crystal & Stockton, Lisa & Greene, Julie Kathryn & Riley, Barbara Lyn, 2017. "Exploring the unanticipated effects of multi-sectoral partnerships in chronic disease prevention," Health Policy, Elsevier, vol. 121(2), pages 158-168.
    6. Áron Perényi & Miklós Losoncz, 2018. "A Systematic Review of International Entrepreneurship Special Issue Articles," Sustainability, MDPI, vol. 10(10), pages 1-26, September.
    7. Selamawit G. Kebede & Almas Heshmati, 2020. "Energy Use and Labor Productivity in Ethiopia: The Case of the Manufacturing Industry," Energies, MDPI, vol. 13(11), pages 1-21, May.
    8. Hazel Squires & James Chilcott & Ronald Akehurst & Jennifer Burr & Michael P. Kelly, 2016. "A systematic literature review of the key challenges for developing the structure of public health economic models," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 61(3), pages 289-298, April.
    9. Priniti Panday & Deanna Rackie & Maria Cornachione Kula, 2020. "The status of women and its influence on children’s well‐being: Do geography, religion and income matter? A comparative study," Development Policy Review, Overseas Development Institute, vol. 38(6), pages 766-782, November.
    10. Pásztor, Szabolcs, 2019. "Gondolatok a fejlesztési segélyek negatív hatásairól P. T. Bauer szellemi örökségének tükrében [Some thoughts on the negative effects of development aid in terms of P. T. Bauers Intellectual Legacy]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(10), pages 1093-1120.
    11. Juliane Schütt & Katharina Löhr & Michelle Bonatti & Stefan Sieber, 2019. "Conflict Causes and Prevention Strategies at the Society-Science Nexus in Transdisciplinary Collaborative Research Settings: A Case Study of a Food Security Project in Tanzania," Sustainability, MDPI, vol. 11(22), pages 1-19, November.
    12. Weeks, Margaret R. & Green Montaque, Helena D. & Lounsbury, David W. & Li, Jianghong & Ferguson, Alice & Warren-Dias, Danielle, 2022. "Using participatory system dynamics learning to support Ryan White Planning Council priority setting and resource allocations," Evaluation and Program Planning, Elsevier, vol. 93(C).
    13. repec:mpr:mprres:6554 is not listed on IDEAS
    14. Nguyen, Sun V. & Langston, Nancy & Wellstead, Adam & Howlett, Michael, 2020. "Mining the evidence: Public comments and evidence-based policymaking in the controversial Minnesota PolyMet mining project," Resources Policy, Elsevier, vol. 69(C).
    15. L. Shakiyla Smith & Natalie J. Wilkins & Roderick J. McClure, 2021. "A systemic approach to achieving population‐level impact in injury and violence prevention," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(1), pages 21-30, January.
    16. repec:osf:socarx:xtnfg_v1 is not listed on IDEAS
    17. William Ascher, 2021. "Coping with intelligence deficits in poverty-alleviation policies in low-income countries," Policy Sciences, Springer;Society of Policy Sciences, vol. 54(2), pages 345-370, June.
    18. O’Connor John, 2022. "Strengthening the science–policy interface in Ireland," Administration, Sciendo, vol. 70(4), pages 29-52, December.
    19. Kurt C. Stange & Anne Gaglioti & James Bindas, 2022. "Integrated, Personalized Care for Older People," Journal of Elder Policy, John Wiley & Sons, vol. 2(2), pages 23-78, September.
    20. Sarah Chapman & Adiilah Boodhoo & Carren Duffy & Suki Goodman & Maria Michalopoulou, 2023. "Theory of Change in Complex Research for Development Programmes: Challenges and Solutions from the Global Challenges Research Fund," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(2), pages 298-322, April.
    21. Jason M. Orr & Jonathon P. Leider & Margaret J. Gutilla, 2023. "System approaches in governmental public health: Findings from an analysis of the literature," Systems Research and Behavioral Science, Wiley Blackwell, vol. 40(1), pages 159-169, January.
    22. Crabolu, Gloria & Font, Xavier & Eker, Sibel, 2023. "Evaluating policy complexity with Causal Loop Diagrams," Annals of Tourism Research, Elsevier, vol. 100(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:59:y:2016:i:c:p:62-73. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.