IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v55y2016icp144-154.html

Do we really care about unintended outcomes? An analysis of evaluation theory and practice

Author

Listed:
  • Jabeen, Sumera

Abstract

The concept of ‘unintended outcomes’ has a long history. Contributions to the topic have appeared under the guise of various disciplinary lenses, including programme evaluation. There is now solid consensus among the international evaluation community regarding the need to consider side effects as a key aspect in any evaluative study. However, this concern often equates to nothing more than false piety. In this article, shortcomings of existing theoretical developments to evaluate unintended outcomes are identified. Current evaluation practices in international development are then analysed to demonstrate ways in which unintended outcomes remain peripheral. Reasons for neglect are discussed and the need for a stronger re-focusing on unintended effects of development interventions is advocated.

Suggested Citation

  • Jabeen, Sumera, 2016. "Do we really care about unintended outcomes? An analysis of evaluation theory and practice," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 144-154.
    • Handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:144-154
    DOI: 10.1016/j.evalprogplan.2015.12.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915001342
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2015.12.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Howard White, 2009. "Theory-based impact evaluation: principles and practice," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(3), pages 271-284.
    2. Platteau, Jean-Philippe & Gaspart, Frederic, 2003. "The Risk of Resource Misappropriation in Community-Driven Development," World Development, Elsevier, vol. 31(10), pages 1687-1703, October.
    3. Sherrill, Sam, 1984. "Identifying and measuring unintended outcomes," Evaluation and Program Planning, Elsevier, vol. 7(1), pages 27-34, January.
    4. Judy L. Baker, 2000. "Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners," World Bank Publications - Books, The World Bank Group, number 13949, April.
    5. Carol H. Weiss, 1997. "How Can Theory-Based Evaluation Make Greater Headway?," Evaluation Review, , vol. 21(4), pages 501-524, August.
    6. Katharina Michaelowa & Axel Borrmann, 2006. "Evaluation Bias and Incentive Structures in Bi‐ and Multilateral Aid Agencies," Review of Development Economics, Wiley Blackwell, vol. 10(2), pages 313-329, May.
    7. Becker, Henk A., 2001. "Social impact assessment," European Journal of Operational Research, Elsevier, vol. 128(2), pages 311-321, January.
    8. Howard White, 2009. "Theory-Based Impact Evaluation," 3ie Publications 2009-3, International Initiative for Impact Evaluation (3ie).
    9. Chambers, Robert, 1994. "The origins and practice of participatory rural appraisal," World Development, Elsevier, vol. 22(7), pages 953-969, July.
    10. Claus C. Rebien, 1997. "Development Assistance Evaluation and the Foundations of Program Evaluation," Evaluation Review, , vol. 21(4), pages 438-460, August.
    11. -, 1998. "Evaluación de proyectos: tres artículos," Sede de la CEPAL en Santiago (Estudios e Investigaciones) 31002, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    12. anonymous, 1998. "Evaluating the power of monetary policy," Economics Update, Federal Reserve Bank of Atlanta, issue Oct, pages 1-5.
    13. -, 1998. "Evaluación de Quito," Copublicaciones, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), number 2058.
    14. S. Akbar Zaidi, 1999. "NGO failure and the need to bring back the state," Journal of International Development, John Wiley & Sons, Ltd., vol. 11(2), pages 259-271.
    15. Bamberger, Michael, 1991. "The politics of evaluation in developing countries," Evaluation and Program Planning, Elsevier, vol. 14(4), pages 325-339, January.
    16. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    17. Annette L. Binnendijk, 1989. "Donor Agency Experience With the Monitoring and Evaluation of Development Projects," Evaluation Review, , vol. 13(3), pages 206-222, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Peterson, Christina & Skolits, Gary, 2019. "Evaluating unintended program outcomes through Ripple Effects Mapping (REM): Application of REM using grounded theory," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    2. Smith, Jonathan D., 2017. "Positioning Missionaries in Development Studies, Policy, and Practice," World Development, Elsevier, vol. 90(C), pages 63-76.
    3. de Alteriis, Martin, 2020. "What can we learn about unintended consequences from a textual analysis of monitoring reports and evaluations for U.S. foreign assistance programs?," Evaluation and Program Planning, Elsevier, vol. 79(C).
    4. Koch, Dirk-Jan & Schulpen, Lau, 2018. "Introduction to the special issue ‘unintended effects of international cooperation’," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 202-209.
    5. Jabeen, Sumera, 2018. "Unintended outcomes evaluation approach: A plausible way to evaluate unintended outcomes of social development programmes," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 262-274.
    6. Davidson, Angus Alexander & Young, Michael Denis & Leake, John Espie & O’Connor, Patrick, 2022. "Aid and forgetting the enemy: A systematic review of the unintended consequences of international development in fragile and conflict-affected situations," Evaluation and Program Planning, Elsevier, vol. 92(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hansen, Marc, 2013. "Aid's Incomplete Trial: reconsidering the aid-growth paradigm in the macro aid effectiveness literature," IEE Working Papers 200, Ruhr University Bochum, Institute of Development Research and Development Policy (IEE).
    2. Walton, Mat, 2014. "Applying complexity theory: A review to inform evaluation design," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 119-126.
    3. Peterson, Christina & Skolits, Gary, 2019. "Evaluating unintended program outcomes through Ripple Effects Mapping (REM): Application of REM using grounded theory," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    4. Jolley, Gwyneth, 2014. "Evaluating complex community-based health promotion: Addressing the challenges," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 71-81.
    5. Abdul-Manan, Amir F.N. & Baharuddin, Azizan & Chang, Lee Wei, 2015. "Application of theory-based evaluation for the critical analysis of national biofuel policy: A case study in Malaysia," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 39-49.
    6. Hughes, Karl & Morgan, Seth & Baylis, Katherine & Oduol, Judith & Smith-Dumont, Emilie & Vågen, Tor-Gunnar & Kegode, Hilda, 2020. "Assessing the downstream socioeconomic impacts of agroforestry in Kenya," World Development, Elsevier, vol. 128(C).
    7. Yerko Rojas, 2017. "Evictions and short-term all-cause mortality: a 3-year follow-up study of a middle-aged Swedish population," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 62(3), pages 343-351, April.
    8. Ofek, Yuval, 2017. "Evaluating social exclusion interventions in university-community partnerships," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 46-55.
    9. Kabeer, Naila, 2020. "‘Misbehaving’ RCTs: The confounding problem of human agency," World Development, Elsevier, vol. 127(C).
    10. Isnawati Hidayah & Imam Mukhlis, 2019. "Dana Desa on clean water and sanitation access in Indonesia: Does Cash-for-work (PKT) matter?," Proceedings of Economics and Finance Conferences 9512011, International Institute of Social and Economic Sciences.
    11. John Gaventa & Rosemary McGee, 2013. "The Impact of Transparency and Accountability Initiatives," Development Policy Review, Overseas Development Institute, vol. 31, pages 3-28, July.
    12. Johnson, Nancy L. & Atherstone, Christine & Grace, Delia, 2015. "The potential of farm-level technologies and practices to contribute to reducing consumer exposure to aflatoxins: A theory of change analysis," IFPRI discussion papers 1452, International Food Policy Research Institute (IFPRI).
    13. Michael Jacobson & Cori Ham, 2020. "The (un)broken promise of agroforestry: a case study of improved fallows in Zambia," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 22(8), pages 8247-8260, December.
    14. Cornwall, Andrea & Aghajanian, Alia, 2017. "How to Find out What’s Really Going On: Understanding Impact through Participatory Process Evaluation," World Development, Elsevier, vol. 99(C), pages 173-185.
    15. Varghese, Rekha & Roy, Manan, 2019. "Coresidence with mother-in-law and maternal anemia in rural India," Social Science & Medicine, Elsevier, vol. 226(C), pages 37-46.
    16. Naila Kabeer & Munshi Sulaiman, 2015. "Assessing the Impact of Social Mobilization: Nijera Kori and the Construction of Collective Capabilities in Rural Bangladesh," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 16(1), pages 47-68, February.
    17. Gaarder, Marie M. & Bartsch, Ulrich, 2014. "The second wave of independence : shopping for solutions," Policy Research Working Paper Series 7069, The World Bank.
    18. Garbero, A., 2016. "IFAD RESEARCH SERIES 7 - Measuring IFAD’s impact: background paper to the IFAD9 Impact Assessment Initiative," IFAD Research Series 280045, International Fund for Agricultural Development (IFAD).
    19. repec:plo:pone00:0151073 is not listed on IDEAS
    20. Azzam, Tarek & Levine, Bret, 2015. "Politics in evaluation: Politically responsive evaluation in high stakes environments," Evaluation and Program Planning, Elsevier, vol. 53(C), pages 44-56.
    21. Howard White, 2013. "An introduction to the use of randomised control trials to evaluate development interventions," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 5(1), pages 30-49, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:144-154. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.