IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/6958.html
   My bibliography  Save this paper

The anatomy of failure : an ethnography of a randomized trial to deepen democracy in rural India

Author

Listed:
  • Ananthpur, Kripa
  • Malik, Kabir
  • Rao, Vijayendra

Abstract

Programs that induce citizen participation to improve the quality of government at the local level are the subjects of large amounts of funding and intense debate. This paper combines a randomized control trial of a citizenship training and facilitation program in rural India, with an in-depth, four-year ethnography of the intervention to understand the underlying mechanisms of change. The quantitative data show no impact from the intervention. Household and village survey data from 100 treatment and 100 control villages show considerable improvement across a wide variety of governance and participation indicators over time, but the differences in the changes between treatment and control villages are not statistically significant. The detailed qualitative data from a 10 percent subsample allow us to unpack the reasons why the intervention"failed,"highlighting the role of variations in the quality of facilitation, lack of top-down support, and difficulties with confronting the stubborn challenge of persistent inequality. However, the qualitative investigation also uncovered subtle treatment effects that are difficult to observe in structured surveys. The paper thus demonstrates that a concerted effort to use"thick description"to uncover the process of change using careful and detailed qualitative work can add value to standard impact evaluations.

Suggested Citation

  • Ananthpur, Kripa & Malik, Kabir & Rao, Vijayendra, 2014. "The anatomy of failure : an ethnography of a randomized trial to deepen democracy in rural India," Policy Research Working Paper Series 6958, The World Bank.
    • Handle: RePEc:wbk:wbrwps:6958
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2014/06/30/000158349_20140630161414/Rendered/PDF/WPS6958.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Michael Woolcock, 2009. "Toward a plurality of methods in project evaluation: a contextualised approach to understanding impact trajectories and efficacy," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(1), pages 1-14.
    2. Abhijit V. Banerjee & Rukmini Banerji & Esther Duflo & Rachel Glennerster & Stuti Khemani, 2010. "Pitfalls of Participatory Programs: Evidence from a Randomized Evaluation in Education in India," American Economic Journal: Economic Policy, American Economic Association, vol. 2(1), pages 1-30, February.
    3. Jha, Saumitra & Rao, Vijayendra & Woolcock, Michael, 2007. "Governance in the Gullies: Democratic Responsiveness and Leadership in Delhi's Slums," World Development, Elsevier, vol. 35(2), pages 230-246, February.
    4. Angus Deaton & Nancy Cartwright, 2016. "Understanding and Misunderstanding Randomized Controlled Trials," Working Papers august_25.pdf, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    5. Auerbach, Adam Michael, 2017. "Neighborhood Associations and the Urban Poor: India’s Slum Development Committees," World Development, Elsevier, vol. 96(C), pages 119-135.
    6. Timothy Besley & Rohini Pande & Vijayendra Rao, 2005. "Participatory Democracy in Action: Survey Evidence from South India," Journal of the European Economic Association, MIT Press, vol. 3(2-3), pages 648-657, 04/05.
    7. Ban, Radu & Jha, Saumitra & Rao, Vijayendra, 2012. "Who has voice in a deliberative democracy? Evidence from transcripts of village parliaments in south India," Journal of Development Economics, Elsevier, vol. 99(2), pages 428-438.
    8. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, September.
    9. Timothy Besley & Rohini Pande & Vijayendra Rao, 2012. "Just Rewards? Local Politics and Public Resource Allocation in South India," The World Bank Economic Review, World Bank, vol. 26(2), pages 191-216.
    10. Francois Bourguignon & Luiz A. Pereira da Silva, 2003. "The Impact of Economic Policies on Poverty and Income Distribution : Evaluation Techniques and Tools," World Bank Publications - Books, The World Bank Group, number 15090.
    11. Andrews, Matt & Pritchett, Lant & Woolcock, Michael, 2017. "Building State Capability: Evidence, Analysis, Action," OUP Catalogue, Oxford University Press, number 9780198747482.
    12. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    13. Khera, Reetika (ed.), 2011. "The Battle for Employment Guarantee," OUP Catalogue, Oxford University Press, number 9780198070627.
    14. Dunning, Thad & Nilekani, Janhavi, 2013. "Ethnic Quotas and Political Mobilization: Caste, Parties, and Distribution in Indian Village Councils," American Political Science Review, Cambridge University Press, vol. 107(1), pages 35-56, February.
    15. Gerber, Alan S. & Green, Donald P. & Nickerson, David, 2001. "Testing for Publication Bias in Political Science," Political Analysis, Cambridge University Press, vol. 9(4), pages 385-392, January.
    16. Heller, Patrick & Harilal, K.N. & Chaudhuri, Shubham, 2007. "Building Local Democracy: Evaluating the Impact of Decentralization in Kerala, India," World Development, Elsevier, vol. 35(4), pages 626-648, April.
    17. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 200-249.
    18. Macartan Humphreys & William Masters & Martin Sandbu, 2006. "The role of leadership in democratic deliberations: Results from a field experiment in sao tome and principe," Natural Field Experiments 00303, The Field Experiments Website.
    19. Howard White, 2011. "Achieving high-quality impact evaluation design through mixed methods: the case of infrastructure," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 3(1), pages 131-144.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Folorunso Obayemi Temitope Obasuyi & Rajah Rasiah & Santha Chenayah, 2020. "Identification of Measurement Variables for Understanding Vulnerability to Education Inequality in Developing Countries: A Conceptual Article," SAGE Open, , vol. 10(2), pages 21582440209, May.
    2. Patricia J. Rogers & Michael Woolcock, 2023. "Process and Implementation Evaluations: A Primer," CID Working Papers 433, Center for International Development at Harvard University.
    3. Srikrishna Ayyangar & Sham N. Kashyap & Prateeti Prasad & Rishikesh B.S., 2020. "School Choice and Implementation: Survey Evidence Across Indian States," Studies in Indian Politics, , vol. 8(2), pages 170-185, December.
    4. Anindya Bhattacharya & Anirban Kar & Sunil Kumar & Alita Nandi, 2018. "Patronage and power in rural India: a study based on interaction networks," Discussion Papers 18/19, Department of Economics, University of York.
    5. Burt S. Barnow & Sanjay K. Pandey & Qian “Eric†Luo, 2024. "How Mixed-Methods Research Can Improve the Policy Relevance of Impact Evaluations," Evaluation Review, , vol. 48(3), pages 495-514, June.
    6. Vijayendra Rao, 2023. "Can Economics Become More Reflexive? Exploring the Potential of Mixed Methods," Springer Books, in: Ashwini Deshpande (ed.), Handbook on Economics of Discrimination and Affirmative Action, chapter 14, pages 323-349, Springer.
    7. Anindya Bhattacharya & Anirban Kar & Alita Nandi, 2016. "Local institutional structure and clientelistic access to employment: the case of MGNREGS in three states of India," Working papers 269, Centre for Development Economics, Delhi School of Economics.
    8. Rao, Vijayendra, 2020. "Evidence-based development needs a diversity of tools, with a bottom-up process of “embedded” dialogue," World Development, Elsevier, vol. 127(C).
    9. Mendoza Alcantara, Alejandra & Woolcock, Michael, 2014. "Integrating qualitative methods into investment climate impact evaluations," Policy Research Working Paper Series 7145, The World Bank.
    10. Mehak Majeed & Saeed Owais Mushtaq & Zahid Gulzar Rather, 2022. "The Complementarity Between the Formal and Informal Sub-sectors of the Indian Industry," The Indian Journal of Labour Economics, Springer;The Indian Society of Labour Economics (ISLE), vol. 65(4), pages 981-1006, December.
    11. Mansuri, Ghazala & Palaniswamy, Nethra & Rao, Vijayendra & Shrestha, Slesh A., 2023. "Money versus Kudos: The impact of incentivizing local politicians in India," Journal of Public Economics, Elsevier, vol. 224(C).
    12. Kumar, Tanu & Post, Alison E. & Ray, Isha, 2018. "Flows, leaks and blockages in informational interventions: A field experimental study of Bangalore's water sector," World Development, Elsevier, vol. 106(C), pages 149-160.
    13. Klick, Matthew T., 2016. "The Effect of State–Local Complementarity and Local Governance on Development: A Comparative Analysis from Post-War Guatemala," World Development, Elsevier, vol. 82(C), pages 1-13.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arkedis, Jean & Creighton, Jessica & Dixit, Akshay & Fung, Archon & Kosack, Stephen & Levy, Dan & Tolmie, Courtney, 2019. "Can Transparency and Accountability Programs Improve Health? Experimental Evidence from Indonesia and Tanzania," Working Paper Series rwp19-020, Harvard University, John F. Kennedy School of Government.
    2. Dan Levy, 2019. "Can Transparency and Accountability Programs Improve Health? Experimental Evidence from Indonesia and Tanzania," CID Working Papers 352, Center for International Development at Harvard University.
    3. Arkedis, Jean & Creighton, Jessica & Dixit, Akshay & Fung, Archon & Kosack, Stephen & Levy, Dan & Tolmie, Courtney, 2021. "Can transparency and accountability programs improve health? Experimental evidence from Indonesia and Tanzania," World Development, Elsevier, vol. 142(C).
    4. Fox, Jonathan A., 2015. "Social Accountability: What Does the Evidence Really Say?," World Development, Elsevier, vol. 72(C), pages 346-361.
    5. Grillos, Tara, 2017. "Participatory Budgeting and the Poor: Tracing Bias in a Multi-Staged Process in Solo, Indonesia," World Development, Elsevier, vol. 96(C), pages 343-358.
    6. Sabyasachi Das & Abhiroop Mukhopadhyay & Rajas Saroy, 2018. "Does Affirmative Action in Politics Hinder Performance? Evidence from India," Working Papers 1007, Ashoka University, Department of Economics.
    7. World Bank Group, 2014. "Strategic Framework for Mainstreaming Citizen Engagement in World Bank Group Operations," World Bank Publications - Books, The World Bank Group, number 21113.
    8. Platteau, Jean-Philippe & Somville, Vincent & Wahhaj, Zaki, 2014. "Elite capture through information distortion: A theoretical essay," Journal of Development Economics, Elsevier, vol. 106(C), pages 250-263.
    9. Callen, Michael & Long, James D., 2015. "Institutional corruption and election fraud: evidence from a field experiment in Afghanistan," LSE Research Online Documents on Economics 102931, London School of Economics and Political Science, LSE Library.
    10. Bhalotra, Sonia & Clots-Figueras, Irma & Iyer, Lakshmi, 2021. "Religion and abortion: The role of politician identity," Journal of Development Economics, Elsevier, vol. 153(C).
    11. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    12. Das, Sabyasachi & Mukhopadhyay, Abhiroop & Saroy, Rajas, 2023. "Does affirmative action in politics hinder performance? Evidence from India," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 370-405.
    13. Diether Beuermann & Maria Amelina, 2014. "Does Participatory Budgeting Improve Decentralized Public Service Delivery?," IDB Publications (Working Papers) 87095, Inter-American Development Bank.
    14. Beath, A. & BenYishay, A. & d’Adda, G. & Grosjean, P. & Weber, R.A., 2018. "Can vouchers reduce elite capture of local development projects? Experimental evidence from the Solomon Islands," Journal of Public Economics, Elsevier, vol. 160(C), pages 117-131.
    15. Palaniswamy, Nethra & Parthasarathy, Ramya & Rao, Vijayendra, 2019. "Unheard voices: The challenge of inducing women’s civic speech," World Development, Elsevier, vol. 115(C), pages 64-77.
    16. Diether W. Beuermann & Maria Amelina, 2018. "Does participatory budgeting improve decentralized public service delivery? Experimental evidence from rural Russia," Economics of Governance, Springer, vol. 19(4), pages 339-379, November.
    17. Abhijit Banerjee & Rema Hanna, 2012. "Corruption [The Handbook of Organizational Economics]," Introductory Chapters,, Princeton University Press.
      • Hanna, Rema N. & Mullainathan, Sendhil & Banerjee, Abhijit, 2012. "Corruption," Scholarly Articles 8830779, Harvard Kennedy School of Government.
      • Banerjee, Abhijit & Hanna, Rema & Mullainathan, Sendhil, 2012. "Corruption," Working Paper Series rwp12-023, Harvard University, John F. Kennedy School of Government.
      • Abhijit Banerjee & Rema Hanna & Sendhil Mullainathan, 2012. "Corruption," Working Papers id:4952, eSocialSciences.
      • Abhijit Banerjee & Sendhil Mullainathan & Rema Hanna, 2012. "Corruption," NBER Working Papers 17968, National Bureau of Economic Research, Inc.
    18. Beath, Andrew & Christia, Fotini & Enikolopov, Ruben, 2017. "Direct democracy and resource allocation: Experimental evidence from Afghanistan," Journal of Development Economics, Elsevier, vol. 124(C), pages 199-213.
    19. Jack, B. Kelsey & Recalde, María P., 2015. "Leadership and the voluntary provision of public goods: Field evidence from Bolivia," Journal of Public Economics, Elsevier, vol. 122(C), pages 80-93.
    20. Das, Sabyasachi & Mukhopadhyay, Abhiroop & Saroy, Rajas, 2017. "Efficiency Consequences of Affirmative Action in Politics: Evidence from India," IZA Discussion Papers 11093, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    Social Accountability; Housing&Human Habitats; Poverty Monitoring&Analysis; Governance Indicators; Public Sector Corruption&Anticorruption Measures;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:6958. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.