Advanced Search
MyIDEAS: Login to save this article or follow this journal

In Pursuit of Balance: Randomization in Practice in Development Field Experiments

Contents:

Author Info

  • Miriam Bruhn
  • David McKenzie

Abstract

We present new evidence on the randomization methods used in existing experiments, and new simulations comparing these methods. We find that many papers do not describe the randomization in detail, implying that better reporting is needed. Our simulations suggest that in samples of 300 or more, the different methods perform similarly. However, for very persistent outcome variables, and in smaller samples, pair-wise matching and stratification perform best and appear to dominate the rerandomization methods commonly used in practice. The simulations also point to specific recommendations for which variables to balance on, and for which controls to include in the ex post analysis. (JEL C83, C93, O12)

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.aeaweb.org/articles.php?doi=10.1257/app.1.4.200
Download Restriction: no

File URL: http://www.aeaweb.org/aej/app/data/2008-0182_data.zip
Download Restriction: no

File URL: http://www.aeaweb.org/aej/app/app/2008-0182_app.pdf
Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.

Bibliographic Info

Article provided by American Economic Association in its journal American Economic Journal: Applied Economics.

Volume (Year): 1 (2009)
Issue (Month): 4 (October)
Pages: 200-232

as in new window
Handle: RePEc:aea:aejapp:v:1:y:2009:i:4:p:200-232

Note: DOI: 10.1257/app.1.4.200
Contact details of provider:
Email:
Web page: http://www.aeaweb.org/aej-applied
More information through EDIRC

Order Information:
Web: http://www.aeaweb.org/subscribe.html

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Abhijit Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2005. "Remedying Education: Evidence from Two Randomized Experiments in India," NBER Working Papers 11904, National Bureau of Economic Research, Inc.
  2. Khwaja, Asim Ijaz & Andrabi, Tahir & Das, Jishnu & Zajonc, Tristan, 2009. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," Scholarly Articles 4435671, Harvard Kennedy School of Government.
  3. Esther Duflo & Rema Hanna, 2005. "Monitoring Works: Getting Teachers to Come to School," NBER Working Papers 11880, National Bureau of Economic Research, Inc.
  4. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  5. Marianne Bertrand & Simeon Djankov & Rema Hanna & Sendhil Mullainathan, 2006. "Does corruption produce unsafe drivers?," Natural Field Experiments 00218, The Field Experiments Website.
  6. Benjamin A. Olken, 2005. "Monitoring Corruption: Evidence from a Field Experiment in Indonesia," NBER Working Papers 11753, National Bureau of Economic Research, Inc.
  7. Paul Glewwe & Michael Kremer & Sylvie Moulin & Eric Zitzewitz, 2004. "Retrospective vs. prospective analyses of school inputs: The case of flip charts in kenya," Natural Field Experiments 00256, The Field Experiments Website.
  8. Dean Karlan & Martin Valdivia, 2011. "Teaching Entrepreneurship: Impact of Business Training on Microfinance Clients and Institutions," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 510-527, May.
  9. repec:feb:artefa:0087 is not listed on IDEAS
  10. Marianne Bertrand & Simeon Djankov & Rema Hanna & Sendhil Mullainathan, 2007. "Obtaining a Driver's License in India: An Experimental Approach to Studying Corruption," The Quarterly Journal of Economics, MIT Press, vol. 122(4), pages 1639-1676, November.
  11. de Mel, Suresh & McKenzie, David & Woodruff, Christopher, 2007. "Returns to capital in microenterprises : evidence from a field experiment," Policy Research Working Paper Series 4230, The World Bank.
  12. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502.
  13. Nava Ashraf & Dean S. Karlan & Wesley Yin, 2005. "Tying Odysseus to the Mast: Evidence from a Commitment Savings Product in the Philippines," Working Papers 917, Economic Growth Center, Yale University.
  14. Nava Ashraf & James Berry & Jesse M. Shapiro, 2010. "Can Higher Prices Stimulate Product Use? Evidence from a Field Experiment in Zambia," American Economic Review, American Economic Association, vol. 100(5), pages 2383-2413, December.
  15. Gustavo J. Bobonis & Edward Miguel & Charu Puri-Sharma, 2006. "Anemia and School Participation," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
  16. Abhijit Vinayak Banerjee & Alice H. Amsden & Robert H. Bates & Jagdish Bhagwati & Angus Deaton & Nicholas Stern, 2007. "Making Aid Work," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262026155, December.
  17. Gary Burtless, 1995. "The Case for Randomized Field Trials in Economic and Policy Research," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 63-84, Spring.
  18. Claudio Ferraz & Frederico Finan, 2008. "Exposing Corrupt Politicians: The Effects of Brazil's Publicly Released Audits on Electoral Outcomes," The Quarterly Journal of Economics, MIT Press, vol. 123(2), pages 703-745, 05.
  19. Erica Field & Rohini Pande, 2008. "Repayment Frequency and Default in Microfinance: Evidence From India," Journal of the European Economic Association, MIT Press, vol. 6(2-3), pages 501-509, 04-05.
  20. Martina Björkman & Jakob Svensson, 2009. "Power to the People: Evidence from a Randomized Field Experiment on Community-Based Monitoring in Uganda," The Quarterly Journal of Economics, MIT Press, vol. 124(2), pages 735-769, May.
  21. Michael Kremer, 2003. "Randomized Evaluations of Educational Programs in Developing Countries: Some Lessons," American Economic Review, American Economic Association, vol. 93(2), pages 102-106, May.
  22. Paul Glewwe & Albert Park & Meng Zhao, 2006. "The impact of eyeglasses on the academic performance of primary school students: Evidence from a randomized trial in rural china," Natural Field Experiments 00254, The Field Experiments Website.
  23. Skoufias, Emmanuel, 2005. "PROGRESA and its impacts on the welfare of rural households in Mexico:," Research reports 139, International Food Policy Research Institute (IFPRI).
Full references (including those not matched with items on IDEAS)

Citations

Blog mentions

As found by EconAcademics.org, the blog aggregator for Economics research:
  1. A pre-analysis plan checklist
    by David McKenzie in Development Impact on 2012-10-28 20:40:08
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:aea:aejapp:v:1:y:2009:i:4:p:200-232. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Voros) or (Michael P. Albert).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.