IDEAS home Printed from https://ideas.repec.org/a/eee/socmed/v168y2016icp7-15.html
   My bibliography  Save this article

Empty rituals? A qualitative study of users’ experience of monitoring & evaluation systems in HIV interventions in western India

Author

Listed:
  • Shukla, Anuprita
  • Teedon, Paul
  • Cornish, Flora

Abstract

In global health initiatives, particularly in the context of private philanthropy and its ‘business minded’ approach, detailed programme data plays an increasing role in informing assessments, improvements, evaluations, and ultimately continuation or discontinuation of funds for individual programmes. The HIV/AIDS literature predominantly treats monitoring as unproblematic. However, the social science of audit and indicators emphasises the constitutive power of indicators, noting that their effects at a grassroots level are often at odds with the goals specified in policy. This paper investigates users' experiences of Monitoring and Evaluation (M&E) systems in the context of HIV interventions in western India. Six focus groups (totalling 51 participants) were held with employees of 6 different NGOs working for government or philanthropy-funded HIV interventions for sex workers in western India. Ten donor employees were interviewed. Thematic analysis was conducted. NGO employees described a major gap between what they considered their “real work” and the indicators used to monitor it. They could explain the official purposes of M&E systems in terms of programme improvement and financial accountability. More cynically, they valued M&E experience on their CVs and the rhetorical role of data in demonstrating their achievements. They believed that inappropriate and unethical means were being used to meet targets, including incentives and coercion, and criticised indicators for being misleading and inflexible. Donor employees valued the role of M&E in programme improvement, financial accountability, and professionalising NGO-donor relationships. However, they were suspicious that NGOs might be falsifying data, criticised the insensitivity of indicators, and complained that data were under-used. For its users, M& E appears an ‘empty ritual’, enacted because donors require it, but not put to local use. In this context, monitoring is constituted as an instrument of performance management rather than as a means of rational programme improvement.

Suggested Citation

  • Shukla, Anuprita & Teedon, Paul & Cornish, Flora, 2016. "Empty rituals? A qualitative study of users’ experience of monitoring & evaluation systems in HIV interventions in western India," Social Science & Medicine, Elsevier, vol. 168(C), pages 7-15.
    • Handle: RePEc:eee:socmed:v:168:y:2016:i:c:p:7-15
    DOI: 10.1016/j.socscimed.2016.08.041
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0277953616304774
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socscimed.2016.08.041?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lorway, Robert & Khan, Shamshad, 2014. "Reassembling epidemiology: Mapping, monitoring and making-up people in the context of HIV prevention in India," Social Science & Medicine, Elsevier, vol. 112(C), pages 51-62.
    2. Hood, Christopher, 1995. "The "new public management" in the 1980s: Variations on a theme," Accounting, Organizations and Society, Elsevier, vol. 20(2-3), pages 93-109.
    3. Power, Michael, 1999. "The Audit Society: Rituals of Verification," OUP Catalogue, Oxford University Press, number 9780198296034, Decembrie.
    4. Biradavolu, Monica R. & Blankenship, Kim M. & George, Annie & Dhungana, Nimesh, 2015. "Unintended Consequences of Community-Based Monitoring Systems: Lessons from an HIV Prevention Intervention for Sex Workers in South India," World Development, Elsevier, vol. 67(C), pages 1-10.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nimesh Dhungana, 2020. "Doing Civil Society-Driven Social Accountability in a Disaster Context: Evidence from Post-Earthquake Nepal," Politics and Governance, Cogitatio Press, vol. 8(4), pages 395-406.
    2. Vijayakumar, Gowri, 2018. "Collective demands and secret codes: The multiple uses of “community” in “community mobilization”," World Development, Elsevier, vol. 104(C), pages 173-182.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wæraas, Arild, 2015. "Putting on the velvet glove: The paradox of "soft" core values in "hard" organizations," Working Paper Series 09-2015, Norwegian University of Life Sciences, School of Economics and Business.
    2. Mehrpouya, Afshin & Salles-Djelic, Marie-Laure, 2019. "Seeing like the market; exploring the mutual rise of transparency and accounting in transnational economic and market governance," Accounting, Organizations and Society, Elsevier, vol. 76(C), pages 12-31.
    3. Vijayakumar, Gowri, 2018. "Collective demands and secret codes: The multiple uses of “community” in “community mobilization”," World Development, Elsevier, vol. 104(C), pages 173-182.
    4. Guénin-Paracini, Henri & Malsch, Bertrand & Paillé, Anne Marché, 2014. "Fear and risk in the audit process," Accounting, Organizations and Society, Elsevier, vol. 39(4), pages 264-288.
    5. Ian Hodge & William M. Adams, 2016. "Short-Term Projects versus Adaptive Governance: Conflicting Demands in the Management of Ecological Restoration," Land, MDPI, vol. 5(4), pages 1-17, November.
    6. Rosta, Miklós, 2013. "New Public Management: opportunity for the Centre, thread for the Periphery," MPRA Paper 68474, University Library of Munich, Germany.
    7. Tóth, Balázs, 2021. "Milyen kapcsolatban állnak a közszféra reformjai a gazdaságpolitikai paradigmákkal? [How reforms of the public sector relate to the paradigms of economic policy]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(2), pages 205-222.
    8. Loke-Min Foo & Darinka Asenova & Stephen Bailey & John Hood, 2011. "Stakeholder Engagement and Compliance Culture," Public Management Review, Taylor & Francis Journals, vol. 13(5), pages 707-729, June.
    9. Mennicken, Andrea, 2006. "Translation and standardisation: audit world building in Post-Soviet Russia," LSE Research Online Documents on Economics 3033, London School of Economics and Political Science, LSE Library.
    10. Mr. Richard I Allen & Yasemin Hurcan & Peter Murphy & Mr. Maximilien Queyranne & Mr. Sami Yläoutinen, 2015. "The Evolving Functions and Organization of Finance Ministries," IMF Working Papers 2015/232, International Monetary Fund.
    11. repec:cuf:journl:y:2017:v:18:i:1:moreno-enguix is not listed on IDEAS
    12. repec:dau:papers:123456789/3505 is not listed on IDEAS
    13. Nolas, Sevasti-Melissa, 2011. "Reflections on the enactment of children's participation rights through research: Between transactional and relational spaces," Children and Youth Services Review, Elsevier, vol. 33(7), pages 1196-1202, July.
    14. Ferry, Laurence & Zakaria, Zamzulaila & Zakaria, Zarina & Slack, Richard, 2018. "Framing public governance in Malaysia: Rhetorical appeals through accrual accounting," Accounting forum, Elsevier, vol. 42(2), pages 170-183.
    15. Mathias Ericson, 2018. "“Sweden Has Been Naïve”: Nationalism, Protectionism and Securitisation in Response to the Refugee Crisis of 2015," Social Inclusion, Cogitatio Press, vol. 6(4), pages 95-102.
    16. Jennifer Jo Thompson & A. June Brawner & Usha Kaila, 2017. "“You can’t manage with your heart”: risk and responsibility in farm to school food safety," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 34(3), pages 683-699, September.
    17. Marta Solórzano-García & Julio Navío-Marco & Luis Manuel Ruiz-Gómez, 2019. "Ambiguity in the Attribution of Social Impact: A Study of the Difficulties of Calculating Filter Coefficients in the SROI Method," Sustainability, MDPI, vol. 11(2), pages 1-19, January.
    18. Ahgren, Bengt, 2010. "Competition and integration in Swedish health care," Health Policy, Elsevier, vol. 96(2), pages 91-97, July.
    19. Cieslik, Katarzyna, 2016. "Moral Economy Meets Social Enterprise Community-Based Green Energy Project in Rural Burundi," World Development, Elsevier, vol. 83(C), pages 12-26.
    20. Tom Willems & Wouter Van Dooren, 2012. "Coming to Terms with Accountability," Public Management Review, Taylor & Francis Journals, vol. 14(7), pages 1011-1036, January.
    21. Rob Imrie & Emma Street, 2009. "Risk, Regulation and the Practices of Architects," Urban Studies, Urban Studies Journal Limited, vol. 46(12), pages 2555-2576, November.
    22. Marco Giovanni Rizzo, 2014. "La relazione tra il livello di coinvolgimento nel processo di budget, il commitment verso gli obiettivi, la soddisfazione lavorativa e i relativi risvolti sulla performance manageriale. I risultati di," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2014(1), pages 9-34.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:socmed:v:168:y:2016:i:c:p:7-15. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/315/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.