IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v142y2021ics0305750x20304976.html
   My bibliography  Save this article

Can transparency and accountability programs improve health? Experimental evidence from Indonesia and Tanzania

Author

Listed:
  • Arkedis, Jean
  • Creighton, Jessica
  • Dixit, Akshay
  • Fung, Archon
  • Kosack, Stephen
  • Levy, Dan
  • Tolmie, Courtney

Abstract

We assess the impact of a transparency and accountability program designed to improve maternal and newborn health (MNH) outcomes in Indonesia and Tanzania. Co-designed with local partner organizations to be community-led and non-prescriptive, the program sought to encourage community participation to address local barriers in access to high quality care for pregnant women and infants. We evaluate the impact of this program through randomized controlled trials (RCTs), involving 100 treatment and 100 control communities in each country. We find that on average, this program did not have a statistically significant impact on the use or content of maternal and newborn health services, nor on perceptions of civic efficacy or civic participation among recent mothers in the communities where it was offered. These findings hold in both countries and in a set of prespecified subgroups. To identify reasons for the lack of impacts, we use a mixed-method approach combining interviews, observations, surveys, focus groups, and ethnographic studies that together provide an in-depth assessment of the complex causal paths linking participation in the program to improvements in MNH outcomes. Although participation in program meetings was substantial and sustained in most communities, and most attempted at least some of what they had planned, only a minority achieved tangible improvements, and fewer still saw more than one such success. In our assessment, the main explanation for the lack of impact is that few communities were able to traverse the complex causal paths from planning actions to accomplishing tangible improvements in their access to quality health care.

Suggested Citation

  • Arkedis, Jean & Creighton, Jessica & Dixit, Akshay & Fung, Archon & Kosack, Stephen & Levy, Dan & Tolmie, Courtney, 2021. "Can transparency and accountability programs improve health? Experimental evidence from Indonesia and Tanzania," World Development, Elsevier, vol. 142(C).
  • Handle: RePEc:eee:wdevel:v:142:y:2021:i:c:s0305750x20304976
    DOI: 10.1016/j.worlddev.2020.105369
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X20304976
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2020.105369?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yoav Benjamini & Abba M. Krieger & Daniel Yekutieli, 2006. "Adaptive linear step-up procedures that control the false discovery rate," Biometrika, Biometrika Trust, vol. 93(3), pages 491-507, September.
    2. Keefer, Philip & Khemani, Stuti, 2014. "Mass media and public education: The effects of access to community radio in Benin," Journal of Development Economics, Elsevier, vol. 109(C), pages 57-72.
    3. Reinikka, Ritva & Svensson, Jakob, 2011. "The power of information in public services: Evidence from education in Uganda," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 956-966, August.
    4. Katherine Casey & Rachel Glennerster & Edward Miguel, 2012. "Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(4), pages 1755-1812.
    5. Abhijit Banerjee & Rema Hanna & Jordan Kyle & Benjamin A. Olken & Sudarno Sumarto, 2018. "Tangible Information and Citizen Empowerment: Identification Cards and Food Subsidy Programs in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 451-491.
    6. Martina Björkman & Jakob Svensson, 2009. "Power to the People: Evidence from a Randomized Field Experiment on Community-Based Monitoring in Uganda," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 735-769.
    7. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja, 2017. "Report Cards: The Impact of Providing School and Child Test Scores on Educational Markets," American Economic Review, American Economic Association, vol. 107(6), pages 1535-1563, June.
    8. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    9. Anuradha Joshi & Peter P. Houtzager, 2012. "Widgets or Watchdogs?," Public Management Review, Taylor & Francis Journals, vol. 14(2), pages 145-162, February.
    10. Pascaline Dupas & Élise Huillery & Juliette Seban, 2018. "Risk Information, Risk Salience, and Teenagers Sexual Behavior: Experimental Evidence from Cameroon," Post-Print hal-01645677, HAL.
    11. Abhijit V. Banerjee & Rukmini Banerji & Esther Duflo & Rachel Glennerster & Stuti Khemani, 2010. "Pitfalls of Participatory Programs: Evidence from a Randomized Evaluation in Education in India," American Economic Journal: Economic Policy, American Economic Association, vol. 2(1), pages 1-30, February.
    12. Lant Pritchett & Salimah Samji & Jeffrey S. Hammer, 2012. "It's All about MeE: Using Structured Experiential Learning ('e') to Crawl the Design Space," WIDER Working Paper Series wp-2012-104, World Institute for Development Economic Research (UNU-WIDER).
    13. Dupas, Pascaline & Huillery, Elise & Seban, Juliette, 2018. "Risk information, risk salience, and adolescent sexual behavior: Experimental evidence from Cameroon," Journal of Economic Behavior & Organization, Elsevier, vol. 145(C), pages 151-175.
    14. Ezequiel Molina & Laura Carella & Ana Pacheco & Guillermo Cruces & Leonardo Gasparini, 2017. "Community monitoring interventions to curb corruption and increase access and quality in service delivery: a systematic review," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 9(4), pages 462-499, October.
    15. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115(2), pages 200-249.
    16. Lieberman, Evan S. & Posner, Daniel N. & Tsai, Lily L., 2014. "Does Information Lead to More Active Citizenship? Evidence from an Education Intervention in Rural Kenya," World Development, Elsevier, vol. 60(C), pages 69-83.
    17. Ritva Reinikka & Jakob Svensson, 2005. "Fighting Corruption to Improve Schooling: Evidence from a Newspaper Campaign in Uganda," Journal of the European Economic Association, MIT Press, vol. 3(2-3), pages 259-267, 04/05.
    18. Fox, Jonathan A., 2007. "Accountability Politics: Power and Voice in Rural Mexico," OUP Catalogue, Oxford University Press, number 9780199208852.
    19. Howard White, 2011. "Achieving high-quality impact evaluation design through mixed methods: the case of infrastructure," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 3(1), pages 131-144.
    20. Fox, Jonathan A., 2015. "Social Accountability: What Does the Evidence Really Say?," World Development, Elsevier, vol. 72(C), pages 346-361.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Allakulov, Umrbek & Cocciolo, Serena & Das, Binayak & Habib, Md. Ahasan & Rambjer, Lovisa & Tompsett, Anna, 2023. "Transparency, governance, and water and sanitation: Experimental evidence from schools in rural Bangladesh," Journal of Development Economics, Elsevier, vol. 163(C).
    2. Ardanaz, Martin & Otálvaro-Ramírez, Susana & Scartascini, Carlos, 2023. "Does information about citizen participation initiatives increase political trust?," World Development, Elsevier, vol. 162(C).
    3. Mogues, Tewodaj & Van Campenhout, Bjorn & Miehe, Caroline & Kabunga, Nassul, 2023. "The impact of community-based monitoring on public service delivery: A randomized control trial in Uganda," World Development, Elsevier, vol. 172(C).
    4. Ardanaz, Martín & Otálvaro-Ramírez, Susana & Scartascini, Carlos, 2022. "Does Citizen Participation in Budget Allocation Pay? A Survey Experiment on Political Trust and Participatory Governance," IDB Publications (Working Papers) 12256, Inter-American Development Bank.
    5. Kyando, Doreen Nico, 2022. "Social accountability initiatives in the delivery of public services in Sub-Saharan Africa: a systematic literature review," IOB Discussion Papers 2022.03, Universiteit Antwerpen, Institute of Development Policy (IOB).
    6. John Gaventa & Anuradha Joshi & Colin Anderson, 2023. "Citizen action for accountability in challenging contexts: What have we learned?," Development Policy Review, Overseas Development Institute, vol. 41(S1), March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arkedis, Jean & Creighton, Jessica & Dixit, Akshay & Fung, Archon & Kosack, Stephen & Levy, Dan & Tolmie, Courtney, 2019. "Can Transparency and Accountability Programs Improve Health? Experimental Evidence from Indonesia and Tanzania," Working Paper Series rwp19-020, Harvard University, John F. Kennedy School of Government.
    2. Dan Levy, 2019. "Can Transparency and Accountability Programs Improve Health? Experimental Evidence from Indonesia and Tanzania," CID Working Papers 352, Center for International Development at Harvard University.
    3. Fox, Jonathan A., 2015. "Social Accountability: What Does the Evidence Really Say?," World Development, Elsevier, vol. 72(C), pages 346-361.
    4. Kosec, Katrina & Wantchekon, Leonard, 2020. "Can information improve rural governance and service delivery?," World Development, Elsevier, vol. 125(C).
    5. World Bank Group, 2014. "Strategic Framework for Mainstreaming Citizen Engagement in World Bank Group Operations," World Bank Publications - Books, The World Bank Group, number 21113, December.
    6. Allakulov, Umrbek & Cocciolo, Serena & Das, Binayak & Habib, Md. Ahasan & Rambjer, Lovisa & Tompsett, Anna, 2023. "Transparency, governance, and water and sanitation: Experimental evidence from schools in rural Bangladesh," Journal of Development Economics, Elsevier, vol. 163(C).
    7. Vincenzo Di Maro & Stefan Leeffers & Danila Serra & Pedro C. Vicente, 2020. "Mobilizing parents at home and at school: an experiment on primary education in Angola," NOVAFRICA Working Paper Series wp2002, Universidade Nova de Lisboa, Nova School of Business and Economics, NOVAFRICA.
    8. Afridi, Farzana & Basistha, Ahana & Dhillon, Amrita & Serra, Danila, 2023. "Activating Change: The Role of Information and Beliefs in Social Activism," IZA Discussion Papers 16358, Institute of Labor Economics (IZA).
    9. Falisse, Jean-Benoit & Ntakarutimana, Léonard, 2020. "When information is not power: Community-elected health facility committees and health facility performance indicators," Social Science & Medicine, Elsevier, vol. 265(C).
    10. Kahsay, Goytom Abraha & Bulte, Erwin, 2021. "Internal versus top-down monitoring in community resource management: Experimental evidence from Ethiopia," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 111-131.
    11. Adnan M. S. Fakir & Tushar Bharati, 2022. "Healthy, nudged, and wise: Experimental evidence on the role of information salience in reducing tobacco intake," Health Economics, John Wiley & Sons, Ltd., vol. 31(6), pages 1129-1166, June.
    12. Afridi, Farzana & Dhillon, Amrita & Chaudhuri, Arka Roy & Kaur, Dashleen, 2020. "Efficacy of Top down audits and Community Monitoring," OSF Preprints akpdy, Center for Open Science.
    13. Darin Christensen & Oeindrila Dube & Johannes Haushofer & Bilal Siddiqi & Maarten Voors, 2021. "Building Resilient Health Systems: Experimental Evidence from Sierra Leone and The 2014 Ebola Outbreak," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(2), pages 1145-1198.
    14. Ardanaz, Martin & Otálvaro-Ramírez, Susana & Scartascini, Carlos, 2023. "Does information about citizen participation initiatives increase political trust?," World Development, Elsevier, vol. 162(C).
    15. Platteau, Jean-Philippe & Somville, Vincent & Wahhaj, Zaki, 2014. "Elite capture through information distortion: A theoretical essay," Journal of Development Economics, Elsevier, vol. 106(C), pages 250-263.
    16. Gaduh,Arya Budhiastra & Pradhan,Menno Prasad & Priebe,Jan & Susanti,Dewi, 2021. "Scores, Camera, Action : Social Accountability and Teacher Incentives in Remote Areas," Policy Research Working Paper Series 9748, The World Bank.
    17. Berry, James & Mehta, Saurabh & Mukherjee, Priya & Ruebeck, Hannah & Shastry, Gauri Kartini, 2021. "Crowd-out in school-based health interventions: Evidence from India’s midday meals program," Journal of Public Economics, Elsevier, vol. 204(C).
    18. Tohari, Achmad & Parsons, Christopher & Rammohan, Anu, 2017. "Does Information Empower the Poor? Evidence from Indonesia's Social Security Card," IZA Discussion Papers 11137, Institute of Labor Economics (IZA).
    19. Nyqvist, Martina Bjorkman & de Walque, Damien & Svensson, Jakob, 2014. "Information is power : experimental evidence on the long-run impact of community based monitoring," Policy Research Working Paper Series 7015, The World Bank.
    20. Igor Francetic & Günther Fink & Fabrizio Tediosi, 2021. "Impact of social accountability monitoring on health facility performance: Evidence from Tanzania," Health Economics, John Wiley & Sons, Ltd., vol. 30(4), pages 766-785, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:142:y:2021:i:c:s0305750x20304976. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.