IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v46y2014icp25-37.html
   My bibliography  Save this article

Ethical implications of resource-limited evaluations: Lessons from an INGO in the eastern Democratic Republic of Congo

Author

Listed:
  • Ramanath, Ramya

Abstract

The emphasis on demonstrable program results in international development work has produced countless evaluation guidelines and numerous scholars have championed specific, ethical-based evaluation approaches to guide international nongovernmental organizations (INGOs). Yet few studies have examined the ethical implications of current evaluation practices among INGOs or the resulting effects on INGO-funded programs. This article focuses on one among a growing population of young, U.S.-based INGOs whose evaluation practices reflect limitations of time, methodological expertise and funding. Drawing on existing principles of ethical evaluations, the author explores the circumstances and potential implications of one evaluation performed by an INGO in the eastern Democratic Republic of Congo and concludes that an ethically defensible evaluation exceeds the capacity of this young INGO. Four propositions are forwarded to highlight the tensions between currently accepted evaluation guidelines and INGO realities. Finally, to help under-resourced INGOs minimize the potential ethical implications for their programs, the article recommends that they prioritize their limited resources to: (1) build local capacity and decentralize evaluation tasks and responsibilities; (2) share program agendas and solicit feedback on implementation from evaluands; (3) share field impressions with local and expert stakeholders; and, (4) translate communications into local dialects to facilitate discussion about structuring future programs and their evaluation.

Suggested Citation

  • Ramanath, Ramya, 2014. "Ethical implications of resource-limited evaluations: Lessons from an INGO in the eastern Democratic Republic of Congo," Evaluation and Program Planning, Elsevier, vol. 46(C), pages 25-37.
  • Handle: RePEc:eee:epplan:v:46:y:2014:i:c:p:25-37
    DOI: 10.1016/j.evalprogplan.2014.04.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718914000457
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2014.04.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Muralidharan, Karthik & Sundararaman, Venkatesh, 2011. "Teacher opinions on performance pay: Evidence from India," Economics of Education Review, Elsevier, vol. 30(3), pages 394-403, June.
    2. Alnoor Ebrahim & V. Kasturi Rangan, 2010. "The Limits of Nonprofit Impact: A Contingency Framework For Measuring Social Performance," Harvard Business School Working Papers 10-099, Harvard Business School.
    3. O'Dwyer, Brendan & Unerman, Jeffrey, 2008. "The paradox of greater NGO accountability: A case study of Amnesty Ireland," Accounting, Organizations and Society, Elsevier, vol. 33(7-8), pages 801-824.
    4. S. Akbar Zaidi, 1999. "NGO failure and the need to bring back the state," Journal of International Development, John Wiley & Sons, Ltd., vol. 11(2), pages 259-271.
    5. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    6. Jeffrey Unerman & Brendan O'Dwyer, 2006. "Theorising accountability for NGO advocacy," Accounting, Auditing & Accountability Journal, Emerald Group Publishing, vol. 19(3), pages 349-376, April.
    7. Fetterman, David M., 1994. "Steps of empowerment evaluation: From California to Cape Town," Evaluation and Program Planning, Elsevier, vol. 17(3), pages 305-313.
    8. Chambers, Robert, 1994. "The origins and practice of participatory rural appraisal," World Development, Elsevier, vol. 22(7), pages 953-969, July.
    9. Hallfors, D. & Cho, H. & Rusakaniko, S. & Iritani, B. & Mapfumo, J. & Halpern, C., 2011. "Supporting adolescent orphan girls to stay in school as HIV risk prevention: Evidence from a randomized controlled trial in Zimbabwe," American Journal of Public Health, American Public Health Association, vol. 101(6), pages 1082-1088.
    10. McLaughlin, John A. & Jordan, Gretchen B., 1999. "Logic models: a tool for telling your programs performance story," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 65-72.
    11. David Lewis & Paul Opoku-Mensah, 2006. "Moving forward research agendas on international NGOs: theory, agency and context," Journal of International Development, John Wiley & Sons, Ltd., vol. 18(5), pages 665-675.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Murphy, Richard & Weinhardt, Felix & Wyness, Gill, 2021. "Who teaches the teachers? A RCT of peer-to-peer observation and feedback in 181 schools," Economics of Education Review, Elsevier, vol. 82(C).
    2. Simon Burgess & Carol Propper & Marisa Ratto & Emma Tominey, 2017. "Incentives in the Public Sector: Evidence from a Government Agency," Economic Journal, Royal Economic Society, vol. 127(605), pages 117-141, October.
    3. Balch, Ryan & Springer, Matthew G., 2015. "Performance pay, test scores, and student learning objectives," Economics of Education Review, Elsevier, vol. 44(C), pages 114-125.
    4. Will, Matthias Georg & Pies, Ingo, 2014. "Discourse and regulation failures: The ambivalent influence of NGOs on political organizations," Discussion Papers 2014-2, Martin Luther University of Halle-Wittenberg, Chair of Economic Ethics.
    5. Dewan, Prerna & Ray, Tridip & Roy Chaudhuri, Arka & Tater, Kirti, 2024. "Gender peer effects in high schools: Evidence from India," Journal of Economic Behavior & Organization, Elsevier, vol. 220(C), pages 470-494.
    6. Julien Kleszczowski, 2016. "La place des parties prenantes dans l’évaluation de l’impact social des organisations non lucratives: étude empirique au sein d’une organisation française," Post-Print hal-01901230, HAL.
    7. Claudine Grisard, 2012. "Accountability and Bottom of the Pyramid projects: the two sides of the mirror," Post-Print hal-00690956, HAL.
    8. Heath, Rachel & Mushfiq Mobarak, A., 2015. "Manufacturing growth and the lives of Bangladeshi women," Journal of Development Economics, Elsevier, vol. 115(C), pages 1-15.
    9. Berlinski, Samuel & Ramos, Alejandra, 2020. "Teacher mobility and merit pay: Evidence from a voluntary public award program," Journal of Public Economics, Elsevier, vol. 186(C).
    10. David K. Evans & Fei Yuan & Deon Filmer, 2020. "Are Teachers in Africa Poorly Paid? Evidence from 15 Countries," Working Papers 538, Center for Global Development.
    11. Duval, Anne-Marie & Gendron, Yves & Roux-Dufort, Christophe, 2015. "Exhibiting nongovernmental organizations: Reifying the performance discourse through framing power," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 29(C), pages 31-53.
    12. Callen, Michael & Gulzar, Saad & Hasanain, Ali & Khan, Muhammad Yasir & Rezaee, Arman, 2023. "The political economy of public sector absence," Journal of Public Economics, Elsevier, vol. 218(C).
    13. Lant Pritchett, 2014. "The Risks to Education Systems from Design Mismatch and Global Isomorphism," CID Working Papers 277, Center for International Development at Harvard University.
    14. Hyman Zyl & Frederik Claeyé, 2019. "Up and Down, and Inside Out: Where do We Stand on NGO Accountability?," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 31(3), pages 604-619, July.
    15. repec:dau:papers:123456789/9498 is not listed on IDEAS
    16. Brendan O'Dwyer & Jeffrey Unerman, 2010. "Enhancing the role of accountability in promoting the rights of beneficiaries of development NGOs," Accounting and Business Research, Taylor & Francis Journals, vol. 40(5), pages 451-471.
    17. Agarwal, Siddhant & Kayina, Athisii & Mukhopadhyay, Abhiroop & Reddy, Anugula N., 2018. "Redistributing teachers using local transfers," World Development, Elsevier, vol. 110(C), pages 333-344.
    18. Jabeen, Sumera, 2016. "Do we really care about unintended outcomes? An analysis of evaluation theory and practice," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 144-154.
    19. Singh, Prakarsh & Mitra, Sandip, 2017. "Incentives, information and malnutrition: Evidence from an experiment in India," European Economic Review, Elsevier, vol. 93(C), pages 24-46.
    20. Kalaj, Jozefina & Rogger, Daniel & Somani, Ravi, 2022. "Bureaucrat time-use: Evidence from a survey experiment," World Development, Elsevier, vol. 152(C).
    21. Isaac Mbiti & Mauricio Romero & Youdi Schipper, 2023. "Designing Effective Teacher Performance Pay Programs: Experimental Evidence from Tanzania," The Economic Journal, Royal Economic Society, vol. 133(653), pages 1968-2000.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:46:y:2014:i:c:p:25-37. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.