IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v55y2016icp144-154.html
   My bibliography  Save this article

Do we really care about unintended outcomes? An analysis of evaluation theory and practice

Author

Listed:
  • Jabeen, Sumera

Abstract

The concept of ‘unintended outcomes’ has a long history. Contributions to the topic have appeared under the guise of various disciplinary lenses, including programme evaluation. There is now solid consensus among the international evaluation community regarding the need to consider side effects as a key aspect in any evaluative study. However, this concern often equates to nothing more than false piety. In this article, shortcomings of existing theoretical developments to evaluate unintended outcomes are identified. Current evaluation practices in international development are then analysed to demonstrate ways in which unintended outcomes remain peripheral. Reasons for neglect are discussed and the need for a stronger re-focusing on unintended effects of development interventions is advocated.

Suggested Citation

  • Jabeen, Sumera, 2016. "Do we really care about unintended outcomes? An analysis of evaluation theory and practice," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 144-154.
    • Handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:144-154
    DOI: 10.1016/j.evalprogplan.2015.12.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915001342
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2015.12.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Becker, Henk A., 2001. "Social impact assessment," European Journal of Operational Research, Elsevier, vol. 128(2), pages 311-321, January.
    2. -, 1998. "Evaluación de Quito," Copublicaciones, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 2058.
    3. Carol H. Weiss, 1997. "How Can Theory-Based Evaluation Make Greater Headway?," Evaluation Review, , vol. 21(4), pages 501-524, August.
    4. Platteau, Jean-Philippe & Gaspart, Frederic, 2003. "The Risk of Resource Misappropriation in Community-Driven Development," World Development, Elsevier, vol. 31(10), pages 1687-1703, October.
    5. Judy L. Baker, 2000. "Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners," World Bank Publications - Books, The World Bank Group, number 13949, December.
    6. Katharina Michaelowa & Axel Borrmann, 2006. "Evaluation Bias and Incentive Structures in Bi‐ and Multilateral Aid Agencies," Review of Development Economics, Wiley Blackwell, vol. 10(2), pages 313-329, May.
    7. anonymous, 1998. "Evaluating the power of monetary policy," Economics Update, Federal Reserve Bank of Atlanta, issue Oct, pages 1-5.
    8. Annette L. Binnendijk, 1989. "Donor Agency Experience With the Monitoring and Evaluation of Development Projects," Evaluation Review, , vol. 13(3), pages 206-222, June.
    9. Howard White, 2009. "Theory-based impact evaluation: principles and practice," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(3), pages 271-284.
    10. Sherrill, Sam, 1984. "Identifying and measuring unintended outcomes," Evaluation and Program Planning, Elsevier, vol. 7(1), pages 27-34, January.
    11. White, Howard, 2009. "Theory-Based Impact Evaluation," 3ie Publications 2009-3, International Initiative for Impact Evaluation (3ie).
    12. Claus C. Rebien, 1997. "Development Assistance Evaluation and the Foundations of Program Evaluation," Evaluation Review, , vol. 21(4), pages 438-460, August.
    13. -, 1998. "Evaluación de proyectos: tres artículos," Sede de la CEPAL en Santiago (Estudios e Investigaciones) 31002, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    14. S. Akbar Zaidi, 1999. "NGO failure and the need to bring back the state," Journal of International Development, John Wiley & Sons, Ltd., vol. 11(2), pages 259-271.
    15. Chambers, Robert, 1994. "The origins and practice of participatory rural appraisal," World Development, Elsevier, vol. 22(7), pages 953-969, July.
    16. Bamberger, Michael, 1991. "The politics of evaluation in developing countries," Evaluation and Program Planning, Elsevier, vol. 14(4), pages 325-339, January.
    17. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Davidson, Angus Alexander & Young, Michael Denis & Leake, John Espie & O’Connor, Patrick, 2022. "Aid and forgetting the enemy: A systematic review of the unintended consequences of international development in fragile and conflict-affected situations," Evaluation and Program Planning, Elsevier, vol. 92(C).
    2. Peterson, Christina & Skolits, Gary, 2019. "Evaluating unintended program outcomes through Ripple Effects Mapping (REM): Application of REM using grounded theory," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    3. Jabeen, Sumera, 2018. "Unintended outcomes evaluation approach: A plausible way to evaluate unintended outcomes of social development programmes," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 262-274.
    4. de Alteriis, Martin, 2020. "What can we learn about unintended consequences from a textual analysis of monitoring reports and evaluations for U.S. foreign assistance programs?," Evaluation and Program Planning, Elsevier, vol. 79(C).
    5. Koch, Dirk-Jan & Schulpen, Lau, 2018. "Introduction to the special issue ‘unintended effects of international cooperation’," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 202-209.
    6. Smith, Jonathan D., 2017. "Positioning Missionaries in Development Studies, Policy, and Practice," World Development, Elsevier, vol. 90(C), pages 63-76.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    2. Jolley, Gwyneth, 2014. "Evaluating complex community-based health promotion: Addressing the challenges," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 71-81.
    3. Hansen, Marc, 2013. "Aid's Incomplete Trial: reconsidering the aid-growth paradigm in the macro aid effectiveness literature," IEE Working Papers 200, Ruhr University Bochum, Institute of Development Research and Development Policy (IEE).
    4. Peterson, Christina & Skolits, Gary, 2019. "Evaluating unintended program outcomes through Ripple Effects Mapping (REM): Application of REM using grounded theory," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    5. Yerko Rojas, 2017. "Evictions and short-term all-cause mortality: a 3-year follow-up study of a middle-aged Swedish population," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 62(3), pages 343-351, April.
    6. Kabeer, Naila, 2020. "‘Misbehaving’ RCTs: The confounding problem of human agency," World Development, Elsevier, vol. 127(C).
    7. Johnson, Nancy L. & Atherstone, Christine & Grace, Delia, 2015. "The potential of farm-level technologies and practices to contribute to reducing consumer exposure to aflatoxins: A theory of change analysis:," IFPRI discussion papers 1452, International Food Policy Research Institute (IFPRI).
    8. Cornwall, Andrea & Aghajanian, Alia, 2017. "How to Find out What’s Really Going On: Understanding Impact through Participatory Process Evaluation," World Development, Elsevier, vol. 99(C), pages 173-185.
    9. Naila Kabeer & Munshi Sulaiman, 2015. "Assessing the Impact of Social Mobilization: Nijera Kori and the Construction of Collective Capabilities in Rural Bangladesh," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 16(1), pages 47-68, February.
    10. Azzam, Tarek & Levine, Bret, 2015. "Politics in evaluation: Politically responsive evaluation in high stakes environments," Evaluation and Program Planning, Elsevier, vol. 53(C), pages 44-56.
    11. Maredia, Mywish K., 2009. "Improving the proof: Evolution of and emerging trends in impact assessment methods and approaches in agricultural development," IFPRI discussion papers 929, International Food Policy Research Institute (IFPRI).
    12. Sara Rafael Almeida & Joana Sousa Lourenco & Francois J. Dessart & Emanuele Ciriolo, 2017. "Insights from behavioural sciences to prevent and combat violence against women. Literature review," JRC Research Reports JRC103975, Joint Research Centre.
    13. Quentin Ssossé & Johanna Wagner & Carina Hopper, 2021. "Assessing the Impact of ESD: Methods, Challenges, Results," Sustainability, MDPI, vol. 13(5), pages 1-26, March.
    14. Joana Silva Afonso, 2020. "Impact evaluation, social performance assessment and standardisation: reflections from microfinance evaluations in Pakistan and Zimbabwe," Working Papers in Economics & Finance 2020-14, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    15. Oya, Carlos & Schaefer, Florian & Skalidou, Dafni, 2018. "The effectiveness of agricultural certification in developing countries: A systematic review," World Development, Elsevier, vol. 112(C), pages 282-312.
    16. Gwenolé Le Velly & Céline Dutilly, 2016. "Evaluating Payments for Environmental Services: Methodological Challenges," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-20, February.
    17. Calina-Ana Butiu, 2017. "Evidence based practice in academic dropout policy. The pro-integra model," Journal of Community Positive Practices, Catalactica NGO, issue 1, pages 3-12.
    18. Channarith Meng & Wade Pfau, 2012. "Simulating the Impacts of Cash Transfers on Poverty and School Attendance: The Case of Cambodia," Journal of Family and Economic Issues, Springer, vol. 33(4), pages 436-452, December.
    19. Johnson, Nancy L. & Guedenet, Hannah & Saltzman, Amy, 2015. "What will it take for biofortification to have impact on the ground? Theories of change for three crop-country combinations:," IFPRI discussion papers 1427, International Food Policy Research Institute (IFPRI).
    20. Jorge García Hombrados & Maira Devisscher & María Herreros Martínez, 2015. "The Impact of land titling on agricultural production and agricultural investments in Tanzania: a theory-based approach," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 7(4), pages 530-544, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:144-154. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.