IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Login to save this book chapter or follow this series

Using Randomization in Development Economics Research: A Toolkit

  • Duflo, Esther
  • Glennerster, Rachel
  • Kremer, Michael

This paper is a practical guide (a toolkit) for researchers, students and practitioners wishing to introduce randomization as part of a research design in the field. It first covers the rationale for the use of randomization, as a solution to selection bias and a partial solution to publication biases. Second, it discusses various ways in which randomization can be practically introduced in a field settings. Third, it discusses designs issues such as sample size requirements, stratification, level of randomization and data collection methods. Fourth, it discusses how to analyze data from randomized evaluations when there are departures from the basic framework. It reviews in particular how to handle imperfect compliance and externalities. Finally, it discusses some of the issues involved in drawing general conclusions from randomized evaluations, including the necessary use of theory as a guide when designing evaluations and interpreting results.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.sciencedirect.com/science/article/B7P5D-4RWXCH1-S/1/2bec02a77a1685a4d7c7b406d0156462
Download Restriction: Full text for ScienceDirect subscribers only

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

as
in new window

This chapter was published in:
  • T. Paul Schultz & John A. Strauss (ed.), 2008. "Handbook of Development Economics," Handbook of Development Economics, Elsevier, edition 1, volume 4, number 5, January.
  • This item is provided by Elsevier in its series Handbook of Development Economics with number 5-61.
    Handle: RePEc:eee:devchp:5-61
    Contact details of provider: Web page: http://www.elsevier.com/wps/find/bookseriesdescription.cws_home/BS_HE/description

    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as in new window
    1. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
    2. Michael Kremer, 2003. "Randomized Evaluations of Educational Programs in Developing Countries: Some Lessons," American Economic Review, American Economic Association, vol. 93(2), pages 102-106, May.
    3. Karlan, Dean S. & Zinman, Jonathan, 2007. "Expanding Credit Access: Using Randomized Supply Decisions to Estimate the Impacts," CEPR Discussion Papers 6407, C.E.P.R. Discussion Papers.
    4. Paul Glewwe & Nauman Ilias & Michael Kremer, 2003. "Teacher Incentives," NBER Working Papers 9671, National Bureau of Economic Research, Inc.
    5. Michael Kremer & Edward Miguel & Rebecca Thornton, 2004. "Incentives to Learn," NBER Working Papers 10971, National Bureau of Economic Research, Inc.
    6. Pascaline Dupas, 2006. "Relative risks and the market for sex: Teenagers, sugar daddies, and hiv in kenya," Natural Field Experiments 00235, The Field Experiments Website.
    7. Glenn Harrison & John List, 2004. "Field experiments," Artefactual Field Experiments 00058, The Field Experiments Website.
    8. Banerjee, Abhijit & Bardhan, Pranab & Basu, Kaushik, 2005. "New Directions in Development Economics: Theory or Empirics? A Symposium in Economic and Political Weekly," Working Papers 127128, Cornell University, Department of Applied Economics and Management.
    9. Elizabeth King & Eric Bettinger & Erik Bloom & Joshua Angrist & Michael Kremer, 2002. "Vouchers for private schooling in colombia: Evidence from a randomized natural experiment," Natural Field Experiments 00203, The Field Experiments Website.
    10. Hausman, Jerry A & Wise, David A, 1979. "Attrition Bias in Experimental and Panel Data: The Gary Income Maintenance Experiment," Econometrica, Econometric Society, vol. 47(2), pages 455-73, March.
    11. Duflo, Esther & Hanna, Rema & Ryan, Stephen, 2008. "Monitoring Works: Getting Teachers to Come to School," CEPR Discussion Papers 6682, C.E.P.R. Discussion Papers.
    12. Esther Duflo & Emmanuel Saez, 2002. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," NBER Working Papers 8885, National Bureau of Economic Research, Inc.
    13. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-36, June.
    14. Paul Glewwe & Michael Kremer & Sylvie Moulin & Eric Zitzewitz, 2000. "Retrospective vs. Prospective Analyses of School Inputs: The Case of Flip Charts in Kenya," NBER Working Papers 8018, National Bureau of Economic Research, Inc.
    15. Marianne Bertrand & Dean S. Karlan & Sendhil Mullainathan & Eldar Shafir & Jonathan Zinman, 2005. "What's Psychology Worth? A Field Experiment in the Consumer Credit Market," Working Papers 918, Economic Growth Center, Yale University.
    16. repec:feb:natura:0021 is not listed on IDEAS
    17. Duflo, Esther & Dupas, Pascaline & Kremer, Michael & Sinei, Samuel, 2006. "Education and HIV/AIDS prevention : evidence from a randomized evaluation in Western Kenya," Policy Research Working Paper Series 4024, The World Bank.
    18. Marianne Bertrand & Rema Hanna & Sendhil Mullainathan & Simeon Djankov, 2006. "Does corruption produce unsafe drivers?," Natural Field Experiments 00218, The Field Experiments Website.
    19. Benjamin A. Olken, 2007. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 115, pages 200-249.
    20. Dean Karlan & Nava Ashaf & Wesley Yin, 2004. "Tying odysseus to the mast: Evidence from a commitment savings product in the philippines," Natural Field Experiments 00206, The Field Experiments Website.
    21. Grasdal, A., 2000. "The Performance of Sample Selection Estimators to Control for Attrition Bias," Norway; Department of Economics, University of Bergen 0101, Department of Economics, University of Bergen.
    22. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, MIT Press, vol. 122(3), pages 1235-1264, 08.
    23. Maluccio, John A. & Flores, Rafael, 2004. "Impact evaluation of a conditional cash transfer program," FCND briefs 184, International Food Policy Research Institute (IFPRI).
    24. Orley Ashenfelter & Colm Harmon & Hessel Oosterbeek, 2000. "A Review of Estimates of the Schooling/Earnings Relationship, with Tests for Publication Bias," NBER Working Papers 7457, National Bureau of Economic Research, Inc.
    25. Steven Glazerman Dan Levy David Myers, 2002. "Nonexperimental Replications of Social Experiments A Systematic Review Interim ReportDiscussion Paper," Mathematica Policy Research Reports 9e8a2edf60ef4fa89ad9a5acf, Mathematica Policy Research.
    26. Dean S. Karlan & Jonathan Zinman, 2005. "Observing Unobservables: Identifying Information Asymmetries with a Consumer Credit Field Experiment," Working Papers 911, Economic Growth Center, Yale University.
    27. Petra E. TODD & Kenneth I. WOLPIN, 2008. "Ex Ante Evaluation of Social Programs," Annales d'Economie et de Statistique, ENSAE, issue 91-92, pages 263-291.
    28. Caroline M. Hoxby, 2003. "The Economics of School Choice," NBER Books, National Bureau of Economic Research, Inc, number hox03-1, October.
    29. Das, J. & Dercon, S. & Habyarimana, J. & Krishnan, P., 2004. "‘When Can School Inputs Improve Test Scores?’," Cambridge Working Papers in Economics 0437, Faculty of Economics, University of Cambridge.
    30. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    31. Ravallion, Martin, 2008. "Evaluating Anti-Poverty Programs," Handbook of Development Economics, Elsevier.
    32. Schady, Norbert & Araujo, Maria Caridad, 2006. "Cash transfers, conditions, school enrollment, and child work : evidence from a randomized experiment in Ecuador," Policy Research Working Paper Series 3930, The World Bank.
    33. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2002. "How Much Should We Trust Differences-in-Differences Estimates?," NBER Working Papers 8841, National Bureau of Economic Research, Inc.
    34. J.D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
    35. Gustavo J. Bobonis & Edward Miguel & Charu Puri-Sharma, 2006. "Anemia and School Participation," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    36. J. Bradford De Long & Kevin Lang, . "Are All Economic Hypotheses False?," J. Bradford De Long's Working Papers _117, University of California at Berkeley, Economics Department.
    37. Joshua Angrist & Eric Bettinger & Michael Kremer, 2006. "Long-Term Educational Consequences of Secondary School Vouchers: Evidence from Administrative Records in Colombia," American Economic Review, American Economic Association, vol. 96(3), pages 847-862, June.
    38. Buddelmeyer, Hielke & Skoufias, Emmanuel, 2003. "An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA," IZA Discussion Papers 827, Institute for the Study of Labor (IZA).
    39. Manski, Charles F., 1989. "Schooling as experimentation: a reappraisal of the postsecondary dropout phenomenon," Economics of Education Review, Elsevier, vol. 8(4), pages 305-312, August.
    40. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," NBER Working Papers 6699, National Bureau of Economic Research, Inc.
    41. Dean Karlan & Eldar Shafir & Jonathan Zinman & Marianne Bertrand & Sendhil Mullainathan, 2006. "What's psychology worth? A field experiment in the consumer credit market," Natural Field Experiments 00217, The Field Experiments Website.
    42. David S. Lee, 2002. "Trimming for Bounds on Treatment Effects with Missing Outcomes," NBER Technical Working Papers 0277, National Bureau of Economic Research, Inc.
    43. Parker, Susan W. & Rubalcava, Luis & Teruel, Graciela, 2008. "Evaluating Conditional Schooling and Health Programs," Handbook of Development Economics, Elsevier.
    44. Chang-Tai Hsieh & Miguel Urquiola, 2003. "When Schools Compete, How Do They Compete? An Assessment of Chile's Nationwide School Voucher Program," NBER Working Papers 10008, National Bureau of Economic Research, Inc.
    45. Glewwe, Paul & Kremer, Michael, 2006. "Schools, Teachers, and Education Outcomes in Developing Countries," Handbook of the Economics of Education, Elsevier.
    46. Esther Duflo & Michael Kremer & Pascaline Dupas & Samuel Sinei, 2006. "Education and hiv/aids prevention: Evidence from a randomized evaluation in western kenya," Framed Field Experiments 00143, The Field Experiments Website.
    47. Heckman, James J & Ichimura, Hidehiko & Todd, Petra, 1998. "Matching as an Econometric Evaluation Estimator," Review of Economic Studies, Wiley Blackwell, vol. 65(2), pages 261-94, April.
    48. Dupas, Pascaline, 2005. "Relative Risks and the Market for Sex: Teenagers, Sugar Daddies and HIV in Kenya," MPRA Paper 248, University Library of Munich, Germany, revised Aug 2006.
    49. Juan Jose Diaz & Sudhanshu Handa, 2006. "An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico’s PROGRESA Program," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    50. Dean Karlan & Jonathan Zinman, 2005. "Elasticities of Demand for Consumer Credit," Working Papers 926, Economic Growth Center, Yale University.
    51. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
    52. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    53. Edward Miguel & Michael Kremer, 2003. "Networks, social learning, and technology adoption: The case of deworming drugs in kenya," Natural Field Experiments 00312, The Field Experiments Website.
    54. Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 605-54, October.
    55. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    56. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, 09.
    57. Paul Schultz, T., 2004. "School subsidies for the poor: evaluating the Mexican Progresa poverty program," Journal of Development Economics, Elsevier, vol. 74(1), pages 199-250, June.
    58. Marianne Bertrand & Simeon Djankov & Rema Hanna & Sendhil Mullainathan, 2007. "Obtaining a Driver's License in India: An Experimental Approach to Studying Corruption," The Quarterly Journal of Economics, MIT Press, vol. 122(4), pages 1639-1676, November.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:eee:devchp:5-61. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.