IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v46y2014icp25-37.html

Ethical implications of resource-limited evaluations: Lessons from an INGO in the eastern Democratic Republic of Congo

Author

Listed:
  • Ramanath, Ramya

Abstract

The emphasis on demonstrable program results in international development work has produced countless evaluation guidelines and numerous scholars have championed specific, ethical-based evaluation approaches to guide international nongovernmental organizations (INGOs). Yet few studies have examined the ethical implications of current evaluation practices among INGOs or the resulting effects on INGO-funded programs. This article focuses on one among a growing population of young, U.S.-based INGOs whose evaluation practices reflect limitations of time, methodological expertise and funding. Drawing on existing principles of ethical evaluations, the author explores the circumstances and potential implications of one evaluation performed by an INGO in the eastern Democratic Republic of Congo and concludes that an ethically defensible evaluation exceeds the capacity of this young INGO. Four propositions are forwarded to highlight the tensions between currently accepted evaluation guidelines and INGO realities. Finally, to help under-resourced INGOs minimize the potential ethical implications for their programs, the article recommends that they prioritize their limited resources to: (1) build local capacity and decentralize evaluation tasks and responsibilities; (2) share program agendas and solicit feedback on implementation from evaluands; (3) share field impressions with local and expert stakeholders; and, (4) translate communications into local dialects to facilitate discussion about structuring future programs and their evaluation.

Suggested Citation

  • Ramanath, Ramya, 2014. "Ethical implications of resource-limited evaluations: Lessons from an INGO in the eastern Democratic Republic of Congo," Evaluation and Program Planning, Elsevier, vol. 46(C), pages 25-37.
  • Handle: RePEc:eee:epplan:v:46:y:2014:i:c:p:25-37
    DOI: 10.1016/j.evalprogplan.2014.04.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718914000457
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2014.04.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Muralidharan, Karthik & Sundararaman, Venkatesh, 2011. "Teacher opinions on performance pay: Evidence from India," Economics of Education Review, Elsevier, vol. 30(3), pages 394-403, June.
    2. Alnoor Ebrahim & V. Kasturi Rangan, 2010. "The Limits of Nonprofit Impact: A Contingency Framework For Measuring Social Performance," Harvard Business School Working Papers 10-099, Harvard Business School.
    3. O'Dwyer, Brendan & Unerman, Jeffrey, 2008. "The paradox of greater NGO accountability: A case study of Amnesty Ireland," Accounting, Organizations and Society, Elsevier, vol. 33(7-8), pages 801-824.
    4. S. Akbar Zaidi, 1999. "NGO failure and the need to bring back the state," Journal of International Development, John Wiley & Sons, Ltd., vol. 11(2), pages 259-271.
    5. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    6. Jeffrey Unerman & Brendan O'Dwyer, 2006. "Theorising accountability for NGO advocacy," Accounting, Auditing & Accountability Journal, Emerald Group Publishing, vol. 19(3), pages 349-376, April.
    7. Fetterman, David M., 1994. "Steps of empowerment evaluation: From California to Cape Town," Evaluation and Program Planning, Elsevier, vol. 17(3), pages 305-313.
    8. Chambers, Robert, 1994. "The origins and practice of participatory rural appraisal," World Development, Elsevier, vol. 22(7), pages 953-969, July.
    9. Hallfors, D. & Cho, H. & Rusakaniko, S. & Iritani, B. & Mapfumo, J. & Halpern, C., 2011. "Supporting adolescent orphan girls to stay in school as HIV risk prevention: Evidence from a randomized controlled trial in Zimbabwe," American Journal of Public Health, American Public Health Association, vol. 101(6), pages 1082-1088.
    10. McLaughlin, John A. & Jordan, Gretchen B., 1999. "Logic models: a tool for telling your programs performance story," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 65-72.
    11. David Lewis & Paul Opoku-Mensah, 2006. "Moving forward research agendas on international NGOs: theory, agency and context," Journal of International Development, John Wiley & Sons, Ltd., vol. 18(5), pages 665-675.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Balch, Ryan & Springer, Matthew G., 2015. "Performance pay, test scores, and student learning objectives," Economics of Education Review, Elsevier, vol. 44(C), pages 114-125.
    2. Will, Matthias Georg & Pies, Ingo, 2014. "Discourse and regulation failures: The ambivalent influence of NGOs on political organizations," Discussion Papers 2014-2, Martin Luther University of Halle-Wittenberg, Chair of Economic Ethics.
    3. Murphy, Richard & Weinhardt, Felix & Wyness, Gill, 2021. "Who teaches the teachers? A RCT of peer-to-peer observation and feedback in 181 schools," Economics of Education Review, Elsevier, vol. 82(C).
    4. Dewan, Prerna & Ray, Tridip & Roy Chaudhuri, Arka & Tater, Kirti, 2024. "Gender peer effects in high schools: Evidence from India," Journal of Economic Behavior & Organization, Elsevier, vol. 220(C), pages 470-494.
    5. Julien Kleszczowski, 2016. "La place des parties prenantes dans l’évaluation de l’impact social des organisations non lucratives: étude empirique au sein d’une organisation française," Post-Print hal-01901230, HAL.
    6. Claudine Grisard, 2012. "Accountability and Bottom of the Pyramid projects: the two sides of the mirror," Post-Print hal-00690956, HAL.
    7. Heath, Rachel & Mushfiq Mobarak, A., 2015. "Manufacturing growth and the lives of Bangladeshi women," Journal of Development Economics, Elsevier, vol. 115(C), pages 1-15.
    8. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    9. David K. Evans & Fei Yuan & Deon Filmer, 2020. "Are Teachers in Africa Poorly Paid? Evidence from 15 Countries," Working Papers 538, Center for Global Development.
    10. Duval, Anne-Marie & Gendron, Yves & Roux-Dufort, Christophe, 2015. "Exhibiting nongovernmental organizations: Reifying the performance discourse through framing power," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 29(C), pages 31-53.
    11. Hyman Zyl & Frederik Claeyé, 2019. "Up and Down, and Inside Out: Where do We Stand on NGO Accountability?," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(3), pages 604-619, July.
    12. repec:dau:papers:123456789/9498 is not listed on IDEAS
    13. Brendan O'Dwyer & Jeffrey Unerman, 2010. "Enhancing the role of accountability in promoting the rights of beneficiaries of development NGOs," Accounting and Business Research, Taylor & Francis Journals, vol. 40(5), pages 451-471.
    14. Simon Burgess & Carol Propper & Marisa Ratto & Emma Tominey, 2017. "Incentives in the Public Sector: Evidence from a Government Agency," Economic Journal, Royal Economic Society, vol. 127(605), pages 117-141, October.
    15. Jabeen, Sumera, 2016. "Do we really care about unintended outcomes? An analysis of evaluation theory and practice," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 144-154.
    16. Singh, Prakarsh & Mitra, Sandip, 2017. "Incentives, information and malnutrition: Evidence from an experiment in India," European Economic Review, Elsevier, vol. 93(C), pages 24-46.
    17. Kalaj, Jozefina & Rogger, Daniel & Somani, Ravi, 2022. "Bureaucrat time-use: Evidence from a survey experiment," World Development, Elsevier, vol. 152(C).
    18. Isaac Mbiti & Mauricio Romero & Youdi Schipper, 2023. "Designing Effective Teacher Performance Pay Programs: Experimental Evidence from Tanzania," The Economic Journal, Royal Economic Society, vol. 133(653), pages 1968-2000.
    19. repec:ags:aaea22:335793 is not listed on IDEAS
    20. J. Oriol Escardíbul & Simon Burgess & Oscar D. Marcenaro Gutiérrez & Helen F. Ladd & Lucy Sorensen, 2017. "Effects of teacher quality on student achievement / Impacto de la calidad del profesorado en el rendimiento académico de los estudiantes / Impacte de la qualitat del professorat en el rendiment acadèmic dels estudiants," IEB Reports ieb_report_2_2017, Institut d'Economia de Barcelona (IEB).
    21. Marta Favara & Irajen Appasamy & Marito H. Garcia, 2015. "Nigeria," World Bank Publications - Reports 24454, The World Bank Group.
    22. O’Leary, Susan, 2017. "Grassroots accountability promises in rights-based approaches to development: The role of transformative monitoring and evaluation in NGOs," Accounting, Organizations and Society, Elsevier, vol. 63(C), pages 21-41.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:46:y:2014:i:c:p:25-37. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.