IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v127y2020ics0305750x19304711.html

Randomized controlled trials of multi-sectoral programs: Lessons from development research

Author

Listed:
  • Quisumbing, Agnes R.
  • Ahmed, Akhter
  • Gilligan, Daniel O.
  • Hoddinott, John
  • Kumar, Neha
  • Leroy, Jef L.
  • Menon, Purnima
  • Olney, Deanna K.
  • Roy, Shalini
  • Ruel, Marie

Abstract

Development is a multi-faceted process; achieving development goals thus requires a multi-sectoral approach. For over two decades, our research group of economists and nutritionists has designed and implemented randomized trials to assess the effectiveness of multisectoral programs in improving nutrition, food security, and other measures of well-being, largely at the request of developing country governments, development partners, and non-governmental organizations. Our approach addresses three perceived pitfalls of RCTs: the “black box” nature of RCTs, limited external validity, and challenges in translation of results to impacts at scale. We address these concerns by identifying and assessing programmatic pathways to impact with quantitative and qualitative methods; studying similar programs implemented by different organizations across various settings; and working closely with implementing partners in the design, research, and dissemination processes to inform adaptation and scale-up of programs and policies.

Suggested Citation

  • Quisumbing, Agnes R. & Ahmed, Akhter & Gilligan, Daniel O. & Hoddinott, John & Kumar, Neha & Leroy, Jef L. & Menon, Purnima & Olney, Deanna K. & Roy, Shalini & Ruel, Marie, 2020. "Randomized controlled trials of multi-sectoral programs: Lessons from development research," World Development, Elsevier, vol. 127(C).
    • Handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304711
    DOI: 10.1016/j.worlddev.2019.104822
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X19304711
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.worlddev.2019.104822?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Hidrobo, Melissa & Hoddinott, John & Peterman, Amber & Margolies, Amy & Moreira, Vanessa, 2014. "Cash, food, or vouchers? Evidence from a randomized experiment in northern Ecuador," Journal of Development Economics, Elsevier, vol. 107(C), pages 144-156.
    2. John Hoddinott & Susanna Sandström & Joanna Upton, 2018. "The Impact of Cash and Food Transfers: Evidence from a Randomized Intervention in Niger," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(4), pages 1032-1049.
    3. Ana Maria Buller & Amber Peterman & Meghna Ranganathan & Alexandra Bleile & Melissa Hidrobo & Lori Heise, 2018. "A Mixed-Method Review of Cash Transfers and Intimate Partner Violence in Low- and Middle-Income Countries," The World Bank Research Observer, World Bank, vol. 33(2), pages 218-258.
    4. Alan de Brauw & Patrick Eozenou & Daniel O Gilligan & Christine Hotz & Neha Kumar & J V Meenakshi, 2018. "Biofortification, Crop Adoption and Health Information: Impact Pathways in Mozambique and Uganda," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(3), pages 906-930.
    5. Skoufias, Emmanuel, 2005. "PROGRESA and its impacts on the welfare of rural households in Mexico," Research reports 139, International Food Policy Research Institute (IFPRI).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2026. "Estimating Causal Effects With Observational Data: Guidelines for Agricultural and Applied Economists," Journal of Agricultural Economics, Wiley Blackwell, vol. 77(2), pages 356-382, June.
    2. Koppenberg, Maximilian & Mishra, Ashok K. & Hirsch, Stefan, 2023. "Food aid and violent conflict: A review and Empiricist’s companion," Food Policy, Elsevier, vol. 121(C).
    3. Roelen, Keetie & Saha, Amrita, 2021. "Pathways to stronger futures? The role of social protection in reducing psychological risk factors for child development in Haiti," World Development, Elsevier, vol. 142(C).
    4. Raghunathan, Kalyani & Kumar, Neha & Gupta, Shivani & Chauhan, Tarana & Kathuria, Ashi Kohli & Menon, Purnima, 2023. "Learning together: Experimental evidence on the impact of group-based nutrition interventions in rural Bihar," World Development, Elsevier, vol. 168(C).
    5. James R. Stevenson & Karen Macours & Douglas Gollin, 2023. "The Rigor Revolution: New Standards of Evidence for Impact Assessment of International Agricultural Research," Annual Review of Resource Economics, Annual Reviews, vol. 15(1), pages 495-515, October.
    6. Koppenberg, Maximilian & Mishra, Ashok K. & Hirsch, Stefan, 2023. "Food Aid and Violent Conflict: A Review of Literature," IZA Discussion Papers 16574, IZA Network @ LISER.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nelson, Suzanne & Brown, Vicky & Presnall, Carrie & Downen, Jeanne & Frankenberger, Timothy R., 2015. "Ex-Post impact assessment review of IFPRI’s research program on social protection, 2000–2012," Impact assessments 40, International Food Policy Research Institute (IFPRI).
    2. Lehmann, M. Christian & Matarazzo, Hellen, 2019. "Voters’ response to in-kind transfers: Quasi-experimental evidence from prescription drug cost-sharing in Brazil," Economics Letters, Elsevier, vol. 184(C).
    3. Mariapia Mendola & Mengesha Yayo Negasi, 2019. "Nutritional and Schooling Impact of a Cash Transfer Program in Ethiopia: A Retrospective Analysis of Childhood Experience," Development Working Papers 451, Centro Studi Luca d'Agliano, University of Milano.
    4. Lara Cockx & Nathalie Francken, 2016. "Evolution and impact of EU aid for food and nutrition security: a review," Working Papers of Department of Economics, Leuven 540512, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    5. Marina Mastrorillo & Antonio Scognamillo & Camille Ginet & Rebecca Pietrelli & Marco D’Errico & Adriana Ignaciuk, 2024. "Is the self-reliance strategy sustainable? Evidence from assistance programmes to refugees in Uganda," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 16(6), pages 1587-1617, December.
    6. Manda, Constantine & Sango, Danford & Hoffmann, Vivian & de Brauw, Alan & Zakaria, Zakayo & Temba, George & Brown, Elizabeth & Richards, Dorothy & Rashid, Said, 2025. "Overcoming budget constraints to healthy diets: Evidence from urban Tanzania," IFPRI discussion papers 2372, International Food Policy Research Institute (IFPRI).
    7. Claire MacPherson & Olivier Sterck, 2019. "Humanitarian vs. Development Aid for Refugees: Evidence from a Regression Discontinuity Design," CSAE Working Paper Series 2019-15, Centre for the Study of African Economies, University of Oxford.
    8. World Bank Group, 2016. "Cash Transfers in Humanitarian Contexts," World Bank Publications - Reports 24699, The World Bank Group.
    9. McIntosh, Craig & Zeitlin, Andrew, 2022. "Using household grants to benchmark the cost effectiveness of a USAID workforce readiness program," Journal of Development Economics, Elsevier, vol. 157(C).
    10. Ghulam Mustafa & Nasir Iqbal & Faiz Ur Rehman, 2022. "Evaluating the Short Run and Long Run Impacts of Unconditional Cash Transfers on Food-Seeking Behaviour: New Insights from BISP, Pakistan (Article)," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 61(1), pages 85-102.
    11. Michael Callen & Miguel Fajardo-Steinhäuser & Michael G. Findley & Tarek Ghani, 2025. "Can Digital Aid Deliver During Humanitarian Crises?," Management Science, INFORMS, vol. 71(11), pages 9730-9748, November.
    12. Tenenbaum, Victoria & Vigorito, Andrea, 2025. "Public transfers, food consumption and dietary diversity. The case of Tarjeta Uruguay Social," Food Policy, Elsevier, vol. 132(C).
    13. Quattrochi, John & Aker, Jenny C. & van der Windt, Peter & Voors, Maarten, 2020. "Contributions of experimental approaches to development and poverty alleviation: Field experiments and humanitarian assistance," World Development, Elsevier, vol. 127(C).
    14. Upton, Joanna B., 2014. "Resolving the Puzzle of the Conditional Superiority of In-kind versus Cash Food Assistance: Evidence from Niger," 2014 Annual Meeting, July 27-29, 2014, Minneapolis, Minnesota 172942, Agricultural and Applied Economics Association.
    15. Hailemariam Teklewold & Tagel Gebrehiwot & Mintewab Bezabih, 2022. "Social protection and vulnerability to nutrition security: empirical evidence from Ethiopia," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 14(5), pages 1191-1205, October.
    16. Samuel Berlinski & Norbert Schady, 2015. "Daycare Services: It’s All about Quality," Palgrave Macmillan Books, in: Samuel Berlinski & Norbert Schady (ed.), The Early Years, chapter 4, pages 91-119, Palgrave Macmillan.
    17. Стукач, Виктор & Помогаев, Виталий & Старовойтова, Наталья & Зинич, Алла, 2016. "Инфраструктура Распределения Продовольственной Помощи В Регионе [Infrastructure Distribution Of Food Aid In The Region]," MPRA Paper 73086, University Library of Munich, Germany.
    18. Harris-Fry, Helen & Saville, Naomi M. & Paudel, Puskar & Manandhar, Dharma S. & Cortina-Borja, Mario & Skordis, Jolene, 2022. "Relative power: Explaining the effects of food and cash transfers on allocative behaviour in rural Nepalese households," Journal of Development Economics, Elsevier, vol. 154(C).
    19. repec:fpr:export:1342 is not listed on IDEAS
    20. Gentilini,Ugo, 2016. "The revival of the"cash versus food"debate : new evidence for an old quandary ?," Policy Research Working Paper Series 7584, The World Bank.
    21. Manfredini Bohm, Alfredo & Acosta, Pablo & Lebow, Jeremy & Migliaccio, Emanuela, 2025. "Refugees and Social Assistance in Low- and middle-income Countries : A Review of Operational Experiences," The Social Policy and Labor Discussion Paper Series 203254, The World Bank.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304711. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.