IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1912.01052.html
   My bibliography  Save this paper

Clustering and External Validity in Randomized Controlled Trials

Author

Listed:
  • Antoine Deeb
  • Cl'ement de Chaisemartin

Abstract

The randomization inference literature studying randomized controlled trials (RCTs) assumes that units' potential outcomes are deterministic. This assumption is unlikely to hold, as stochastic shocks may take place during the experiment. In this paper, we consider the case of an RCT with individual-level treatment assignment, and we allow for individual-level and cluster-level (e.g. village-level) shocks. We show that one can draw inference on the ATE conditional on the realizations of the cluster-level shocks, using heteroskedasticity-robust standard errors, or on the ATE netted out of those shocks, using cluster-robust standard errors.

Suggested Citation

  • Antoine Deeb & Cl'ement de Chaisemartin, 2019. "Clustering and External Validity in Randomized Controlled Trials," Papers 1912.01052, arXiv.org, revised Dec 2022.
    • Handle: RePEc:arx:papers:1912.01052
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1912.01052
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bo, Hao & Galiani, Sebastian, 2021. "Assessing external validity," Research in Economics, Elsevier, vol. 75(3), pages 274-285.
    2. Rajeev Dehejia & Cristian Pop-Eleches & Cyrus Samii, 2021. "From Local to Global: External Validity in a Fertility Natural Experiment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 217-243, January.
    3. Dean Karlan & Robert Osei & Isaac Osei-Akoto & Christopher Udry, 2014. "Agricultural Decisions after Relaxing Credit and Risk Constraints," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(2), pages 597-652.
    4. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    5. Shawn Cole & Xavier Gine & Jeremy Tobacman & Petia Topalova & Robert Townsend & James Vickery, 2013. "Barriers to Household Risk Management: Evidence from India," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 104-135, January.
    6. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    7. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    8. Xinran Li & Peng Ding, 2017. "General Forms of Finite Population Central Limit Theorems with Applications to Causal Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1759-1769, October.
    9. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    2. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    3. Fangzhou Su & Peng Ding, 2021. "Model‐assisted analyses of cluster‐randomized experiments," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(5), pages 994-1015, November.
    4. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
    5. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    6. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Testing for the appropriate level of clustering in linear regression models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
    7. Stoeffler, Quentin & Opuz, Gülce, 2022. "Price, information and product quality: Explaining index insurance demand in Burkina Faso," Food Policy, Elsevier, vol. 108(C).
    8. Berg, Erlend & Blake, Michael & Morsink, Karlijn, 2022. "Risk sharing and the demand for insurance: Theory and experimental evidence from Ethiopia," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 236-256.
    9. Sarah Janzen & Nicholas Magnan & Conner Mullally & Soye Shin & I. Bailey Palmer & Judith Oduol & Karl Hughes, 2021. "Can Experiential Games and Improved Risk Coverage Raise Demand for Index Insurance? Evidence from Kenya," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 338-361, January.
    10. Adjognon,Guigonan Serge & Nguyen Huy,Tung & Guthoff,Jonas Christoph & van Soest,Daan, 2022. "Incentivizing Social Learning for the Diffusion of Climate-Smart Agricultural Techniques," Policy Research Working Paper Series 10041, The World Bank.
    11. Iavor Bojinov & Ashesh Rambachan & Neil Shephard, 2021. "Panel experiments and dynamic causal effects: A finite population perspective," Quantitative Economics, Econometric Society, vol. 12(4), pages 1171-1196, November.
    12. Demont, Timothée, 2022. "Coping with shocks: How Self-Help Groups impact food security and seasonal migration," World Development, Elsevier, vol. 155(C).
    13. Leblois, A. & Le Cotty, T. & Maître d'Hôtel, E., 2020. "How Might Climate Change Influence farmers' Demand for Index-Based Insurance?," Ecological Economics, Elsevier, vol. 176(C).
    14. Boyd, Chris M. & Bellemare, Marc F., 2022. "Why not insure prices? Experimental evidence from Peru," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 580-631.
    15. Marc F. Bellemare & Yu Na Lee & David R. Just, 2020. "Producer Attitudes Toward Output Price Risk: Experimental Evidence from the Lab and from the Field," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(3), pages 806-825, May.
    16. Shin, Soye & Magnan, Nicholas & Mullally, Conner & Janzen, Sarah, 2022. "Demand for Weather Index Insurance among Smallholder Farmers under Prospect Theory," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 82-104.
    17. Kathryn Vasilaky & Sofía Martínez Sáenz & Radost Stanimirova & Daniel Osgood, 2020. "Perceptions of Farm Size Heterogeneity and Demand for Group Index Insurance," Games, MDPI, vol. 11(1), pages 1-21, March.
    18. Khushbu Mishra & Richard A. Gallenstein & Mario J. Miranda & Abdoul G. Sam & Patricia Toledo & Francis Mulangu, 2021. "Insured Loans and Credit Access: Evidence from a Randomized Field Experiment in Northern Ghana," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(3), pages 923-943, May.
    19. Dercon, Stefan & Orkin, Kate & Bernard, Tanguy & Taffesse, Alemayehu, 2014. "The Future in Mind: Aspirations and Forward-Looking Behaviour in Rural Ethiopia," CEPR Discussion Papers 10224, C.E.P.R. Discussion Papers.
    20. Jongmoo Jay Choi & Hoje Jo & Jimi Kim & Moo Sung Kim, 2018. "Business Groups and Corporate Social Responsibility," Journal of Business Ethics, Springer, vol. 153(4), pages 931-954, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1912.01052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.