IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v99y2017icp481-497.html
   My bibliography  Save this article

The Anatomy of Failure: An Ethnography of a Randomized Trial to Deepen Democracy in Rural India

Author

Listed:
  • Rao, Vijayendra
  • Ananthpur, Kripa
  • Malik, Kabir

Abstract

Programs that induce citizen participation to improve the quality of government at the local level are the subjects of large amounts of funding and intense debate. This paper combines a randomized control trial of a citizenship training and facilitation program in rural India, with an in-depth, four-year, ethnography of the intervention to understand the underlying mechanisms of change. The quantitative data show no impact from the intervention. Household and village survey data from 100 treatment and 100 control villages show considerable improvement across a wide variety of governance and participation indicators over time, but the differences in the changes between treatment and control villages are not statistically significant. The detailed qualitative data from a 10% subsample allow us to unpack the reasons why the intervention “failed” highlighting the role of variations in the quality of facilitation, lack of top-down support, and difficulties with confronting the stubborn challenge of persistent inequality. However, the qualitative investigation also uncovered subtle treatment effects that are difficult to observe in structured surveys. The paper thus demonstrates that a concerted effort to use “thick description” to uncover process of change using careful and detailed qualitative work can add value to standard impact evaluations.

Suggested Citation

  • Rao, Vijayendra & Ananthpur, Kripa & Malik, Kabir, 2017. "The Anatomy of Failure: An Ethnography of a Randomized Trial to Deepen Democracy in Rural India," World Development, Elsevier, vol. 99(C), pages 481-497.
    • Handle: RePEc:eee:wdevel:v:99:y:2017:i:c:p:481-497
    DOI: 10.1016/j.worlddev.2017.05.037
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X17302115
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.worlddev.2017.05.037?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Michael Woolcock, 2009. "Toward a plurality of methods in project evaluation: a contextualised approach to understanding impact trajectories and efficacy," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 1(1), pages 1-14.
    2. Abhijit V. Banerjee & Rukmini Banerji & Esther Duflo & Rachel Glennerster & Stuti Khemani, 2010. "Pitfalls of Participatory Programs: Evidence from a Randomized Evaluation in Education in India," American Economic Journal: Economic Policy, American Economic Association, vol. 2(1), pages 1-30, February.
    3. Jha, Saumitra & Rao, Vijayendra & Woolcock, Michael, 2007. "Governance in the Gullies: Democratic Responsiveness and Leadership in Delhi's Slums," World Development, Elsevier, vol. 35(2), pages 230-246, February.
    4. Angus Deaton & Nancy Cartwright, 2016. "Understanding and Misunderstanding Randomized Controlled Trials," Working Papers august_25.pdf, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    5. Auerbach, Adam Michael, 2017. "Neighborhood Associations and the Urban Poor: India’s Slum Development Committees," World Development, Elsevier, vol. 96(C), pages 119-135.
    6. Timothy Besley & Rohini Pande & Vijayendra Rao, 2005. "Participatory Democracy in Action: Survey Evidence from South India," Journal of the European Economic Association, MIT Press, vol. 3(2-3), pages 648-657, 04/05.
    7. Ban, Radu & Jha, Saumitra & Rao, Vijayendra, 2012. "Who has voice in a deliberative democracy? Evidence from transcripts of village parliaments in south India," Journal of Development Economics, Elsevier, vol. 99(2), pages 428-438.
    8. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, September.
    9. Timothy Besley & Rohini Pande & Vijayendra Rao, 2012. "Just Rewards? Local Politics and Public Resource Allocation in South India," The World Bank Economic Review, World Bank, vol. 26(2), pages 191-216.
    10. Francois Bourguignon & Luiz A. Pereira da Silva, 2003. "The Impact of Economic Policies on Poverty and Income Distribution : Evaluation Techniques and Tools," World Bank Publications - Books, The World Bank Group, number 15090, April.
    11. Andrews, Matt & Pritchett, Lant & Woolcock, Michael, 2017. "Building State Capability: Evidence, Analysis, Action," OUP Catalogue, Oxford University Press, number 9780198747482, Decembrie.
    12. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    13. Khera, Reetika (ed.), 2011. "The Battle for Employment Guarantee," OUP Catalogue, Oxford University Press, number 9780198070627, Decembrie.
    14. Dunning, Thad & Nilekani, Janhavi, 2013. "Ethnic Quotas and Political Mobilization: Caste, Parties, and Distribution in Indian Village Councils," American Political Science Review, Cambridge University Press, vol. 107(1), pages 35-56, February.
    15. Gerber, Alan S. & Green, Donald P. & Nickerson, David, 2001. "Testing for Publication Bias in Political Science," Political Analysis, Cambridge University Press, vol. 9(4), pages 385-392, January.
    16. Heller, Patrick & Harilal, K.N. & Chaudhuri, Shubham, 2007. "Building Local Democracy: Evaluating the Impact of Decentralization in Kerala, India," World Development, Elsevier, vol. 35(4), pages 626-648, April.
    17. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 200-249.
    18. Macartan Humphreys & William Masters & Martin Sandbu, 2006. "The role of leadership in democratic deliberations: Results from a field experiment in sao tome and principe," Natural Field Experiments 00303, The Field Experiments Website.
    19. Howard White, 2011. "Achieving high-quality impact evaluation design through mixed methods: the case of infrastructure," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 3(1), pages 131-144.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. George,Siddharth & Rao,Vijayendra & Sharan,M. R., 2024. "Two Hundred and Fifty-Thousand Democracies : A Review of Village Government in India," Policy Research Working Paper Series 10793, The World Bank.
    2. Srikrishna Ayyangar & Sham N. Kashyap & Prateeti Prasad & Rishikesh B.S., 2020. "School Choice and Implementation: Survey Evidence Across Indian States," Studies in Indian Politics, , vol. 8(2), pages 170-185, December.
    3. Vijayendra Rao, 2023. "Can Economics Become More Reflexive? Exploring the Potential of Mixed Methods," Springer Books, in: Ashwini Deshpande (ed.), Handbook on Economics of Discrimination and Affirmative Action, chapter 14, pages 323-349, Springer.
    4. Anindya Bhattacharya & Anirban Kar & Alita Nandi, 2016. "Local institutional structure and clientelistic access to employment: the case of MGNREGS in three states of India," Working papers 269, Centre for Development Economics, Delhi School of Economics.
    5. Rao, Vijayendra, 2020. "Evidence-based development needs a diversity of tools, with a bottom-up process of “embedded” dialogue," World Development, Elsevier, vol. 127(C).
    6. Anindya Bhattacharya & Anirban Kar & Sunil Kumar & Alita Nandi, 2018. "Patronage and power in rural India: a study based on interaction networks," Discussion Papers 18/19, Department of Economics, University of York.
    7. Mansuri, Ghazala & Palaniswamy, Nethra & Rao, Vijayendra & Shrestha, Slesh A., 2023. "Money versus Kudos: The impact of incentivizing local politicians in India," Journal of Public Economics, Elsevier, vol. 224(C).
    8. Folorunso Obayemi Temitope Obasuyi & Rajah Rasiah & Santha Chenayah, 2020. "Identification of Measurement Variables for Understanding Vulnerability to Education Inequality in Developing Countries: A Conceptual Article," SAGE Open, , vol. 10(2), pages 21582440209, May.
    9. Patricia J. Rogers & Michael Woolcock, 2023. "Process and Implementation Evaluations: A Primer," CID Working Papers 433, Center for International Development at Harvard University.
    10. Burt S. Barnow & Sanjay K. Pandey & Qian “Eric†Luo, 2024. "How Mixed-Methods Research Can Improve the Policy Relevance of Impact Evaluations," Evaluation Review, , vol. 48(3), pages 495-514, June.
    11. Mendoza Alcantara, Alejandra & Woolcock, Michael, 2014. "Integrating qualitative methods into investment climate impact evaluations," Policy Research Working Paper Series 7145, The World Bank.
    12. Mehak Majeed & Saeed Owais Mushtaq & Zahid Gulzar Rather, 2022. "The Complementarity Between the Formal and Informal Sub-sectors of the Indian Industry," The Indian Journal of Labour Economics, Springer;The Indian Society of Labour Economics (ISLE), vol. 65(4), pages 981-1006, December.
    13. Kumar, Tanu & Post, Alison E. & Ray, Isha, 2018. "Flows, leaks and blockages in informational interventions: A field experimental study of Bangalore's water sector," World Development, Elsevier, vol. 106(C), pages 149-160.
    14. Klick, Matthew T., 2016. "The Effect of State–Local Complementarity and Local Governance on Development: A Comparative Analysis from Post-War Guatemala," World Development, Elsevier, vol. 82(C), pages 1-13.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dan Levy, 2019. "Can Transparency and Accountability Programs Improve Health? Experimental Evidence from Indonesia and Tanzania," CID Working Papers 352, Center for International Development at Harvard University.
    2. Arkedis, Jean & Creighton, Jessica & Dixit, Akshay & Fung, Archon & Kosack, Stephen & Levy, Dan & Tolmie, Courtney, 2019. "Can Transparency and Accountability Programs Improve Health? Experimental Evidence from Indonesia and Tanzania," Working Paper Series rwp19-020, Harvard University, John F. Kennedy School of Government.
    3. Fox, Jonathan A., 2015. "Social Accountability: What Does the Evidence Really Say?," World Development, Elsevier, vol. 72(C), pages 346-361.
    4. Arkedis, Jean & Creighton, Jessica & Dixit, Akshay & Fung, Archon & Kosack, Stephen & Levy, Dan & Tolmie, Courtney, 2021. "Can transparency and accountability programs improve health? Experimental evidence from Indonesia and Tanzania," World Development, Elsevier, vol. 142(C).
    5. Grillos, Tara, 2017. "Participatory Budgeting and the Poor: Tracing Bias in a Multi-Staged Process in Solo, Indonesia," World Development, Elsevier, vol. 96(C), pages 343-358.
    6. Sabyasachi Das & Abhiroop Mukhopadhyay & Rajas Saroy, 2018. "Does Affirmative Action in Politics Hinder Performance? Evidence from India," Working Papers 1007, Ashoka University, Department of Economics.
    7. Michael Callen & James D. Long, 2015. "Institutional Corruption and Election Fraud: Evidence from a Field Experiment in Afghanistan," American Economic Review, American Economic Association, vol. 105(1), pages 354-381, January.
    8. Diether W. Beuermann & Maria Amelina, 2018. "Does participatory budgeting improve decentralized public service delivery? Experimental evidence from rural Russia," Economics of Governance, Springer, vol. 19(4), pages 339-379, November.
    9. Beath, Andrew & Christia, Fotini & Enikolopov, Ruben, 2017. "Direct democracy and resource allocation: Experimental evidence from Afghanistan," Journal of Development Economics, Elsevier, vol. 124(C), pages 199-213.
    10. Abhijit Banerjee & Rema Hanna, 2012. "Corruption [The Handbook of Organizational Economics]," Introductory Chapters,, Princeton University Press.
      • Banerjee, Abhijit & Hanna, Rema & Mullainathan, Sendhil, 2012. "Corruption," Working Paper Series rwp12-023, Harvard University, John F. Kennedy School of Government.
      • Hanna, Rema N. & Mullainathan, Sendhil & Banerjee, Abhijit, 2012. "Corruption," Scholarly Articles 8830779, Harvard Kennedy School of Government.
      • Abhijit Banerjee & Rema Hanna & Sendhil Mullainathan, 2012. "Corruption," Working Papers id:4952, eSocialSciences.
      • Abhijit Banerjee & Sendhil Mullainathan & Rema Hanna, 2012. "Corruption," NBER Working Papers 17968, National Bureau of Economic Research, Inc.
    11. Jack, B. Kelsey & Recalde, María P., 2015. "Leadership and the voluntary provision of public goods: Field evidence from Bolivia," Journal of Public Economics, Elsevier, vol. 122(C), pages 80-93.
    12. Das, Sabyasachi & Mukhopadhyay, Abhiroop & Saroy, Rajas, 2017. "Efficiency Consequences of Affirmative Action in Politics: Evidence from India," IZA Discussion Papers 11093, Institute of Labor Economics (IZA).
    13. Krisztina Kis-Katos & Günther G. Schulze, 2013. "Corruption in Southeast Asia: a survey of recent research," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 27(1), pages 79-109, May.
    14. Rao, Vijayendra, 2020. "Evidence-based development needs a diversity of tools, with a bottom-up process of “embedded” dialogue," World Development, Elsevier, vol. 127(C).
    15. Anirban Mitra, 2018. "Mandated Political Representation and Redistribution," Economica, London School of Economics and Political Science, vol. 85(338), pages 266-280, April.
    16. Mu, Ren & Zhang, Xiaobo, 2014. "Do elected leaders in a limited democracy have real power? Evidence from rural China," Journal of Development Economics, Elsevier, vol. 107(C), pages 17-27.
    17. Tessa Bold & Ezequiel Molina & Abla Safir, 2017. "Clientelism in the Public Sector," World Bank Publications - Reports 26257, The World Bank Group.
    18. Palaniswamy, Nethra & Parthasarathy, Ramya & Rao, Vijayendra, 2019. "Unheard voices: The challenge of inducing women’s civic speech," World Development, Elsevier, vol. 115(C), pages 64-77.
    19. Katherine Casey & Rachel Glennerster & Edward Miguel, 2012. "Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(4), pages 1755-1812.
    20. Jeong, Dahyeon & Shenoy, Ajay & Zimmermann, Laura V., 2023. "De Jure versus De Facto transparency: Corruption in local public office in India," Journal of Public Economics, Elsevier, vol. 221(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:99:y:2017:i:c:p:481-497. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.