IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v127y2020ics0305750x19304474.html
   My bibliography  Save this article

Challenges in using RCTs for evaluation of large-scale public programs with complex designs: Lessons from Peru

Author

Listed:
  • Escobal, Javier
  • Ponce, Carmen

Abstract

The use of randomized control trials (RCTs) to evaluate public policies and interventions in developing countries faces several challenges. These include limited budgets to finance sample designs and sample sizes required to evaluate multifaceted interventions, potential small-sample bias arising from such limited samples, and difficulties in random assignment when participants self-exclude from parts of the intervention. In addition, institutional challenges arise when seeking to evaluate large-scale interventions implemented within a state bureaucracy as compared to NGO small pilots’ evaluations. This short article seeks to discuss the practical challenges facing RCTs when used as a public policy and program evaluation mechanism. This discussion is based on the impact evaluation of a public project that offered several productive interventions to rural households who were already receiving conditional cash transfers.

Suggested Citation

  • Escobal, Javier & Ponce, Carmen, 2020. "Challenges in using RCTs for evaluation of large-scale public programs with complex designs: Lessons from Peru," World Development, Elsevier, vol. 127(C).
  • Handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304474
    DOI: 10.1016/j.worlddev.2019.104798
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X19304474
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    2. Javier Escobal & Carmen Ponce & Ramón Pajuelo Teves & Mauricio Espinoza, 2012. "Estudio comparativo de intervenciones para el desarrollo rural en la Sierra sur del Perú," Libros, Grupo de Análisis para el Desarrollo (GRADE), edition 1, number 2012-3, May.
    3. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    4. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.),Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    5. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    6. Escobal, Javier & Ponce, Carmen, 2016. "Combinando protección social con generación de oportunidades económicas: una evaluación de los avances del programa Haku Wiñay," Libros, Grupo de Análisis para el Desarrollo (GRADE), edition 1, number 2016-1, May.
    Full references (including those not matched with items on IDEAS)

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:127:y:2020:i:c:s0305750x19304474. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Haili He). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.