IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1711.02745.html
   My bibliography  Save this paper

Identification and Estimation of Spillover Effects in Randomized Experiments

Author

Listed:
  • Gonzalo Vazquez-Bare

Abstract

I study identification, estimation and inference for spillover effects in experiments where units' outcomes may depend on the treatment assignments of other units within a group. I show that the commonly-used reduced-form linear-in-means regression identifies a weighted sum of spillover effects with some negative weights, and that the difference in means between treated and controls identifies a combination of direct and spillover effects entering with different signs. I propose nonparametric estimators for average direct and spillover effects that overcome these issues and are consistent and asymptotically normal under a precise relationship between the number of parameters of interest, the total sample size and the treatment assignment mechanism. These findings are illustrated using data from a conditional cash transfer program and with simulations. The empirical results reveal the potential pitfalls of failing to flexibly account for spillover effects in policy evaluation: the estimated difference in means and the reduced-form linear-in-means coefficients are all close to zero and statistically insignificant, whereas the nonparametric estimators I propose reveal large, nonlinear and significant spillover effects.

Suggested Citation

  • Gonzalo Vazquez-Bare, 2017. "Identification and Estimation of Spillover Effects in Randomized Experiments," Papers 1711.02745, arXiv.org, revised Jan 2022.
  • Handle: RePEc:arx:papers:1711.02745
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1711.02745
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Angrist, Joshua D., 2014. "The perils of peer effects," Labour Economics, Elsevier, vol. 30(C), pages 98-108.
    2. Eckles Dean & Karrer Brian & Ugander Johan, 2017. "Design and Analysis of Experiments in Networks: Reducing Bias from Interference," Journal of Causal Inference, De Gruyter, vol. 5(1), pages 1-23, March.
    3. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    4. Bryan S. Graham, 2008. "Identifying Social Interactions Through Conditional Variance Restrictions," Econometrica, Econometric Society, vol. 76(3), pages 643-660, May.
    5. David J. Zimmerman, 2003. "Peer Effects in Academic Outcomes: Evidence from a Natural Experiment," The Review of Economics and Statistics, MIT Press, vol. 85(1), pages 9-23, February.
    6. Hirano, Keisuke & Hahn, Jinyong, 2010. "Design of randomized experiments to measure social interaction effects," Economics Letters, Elsevier, vol. 106(1), pages 51-53, January.
    7. Lawrence E. Blume & William A. Brock & Steven N. Durlauf & Rajshri Jayaraman, 2015. "Linear Social Interactions Models," Journal of Political Economy, University of Chicago Press, vol. 123(2), pages 444-496.
    8. David Choi, 2017. "Estimation of Monotone Treatment Effects in Network Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1147-1155, July.
    9. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    10. Susan Athey & Dean Eckles & Guido W. Imbens, 2018. "Exact p-Values for Network Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 230-240, January.
    11. Charles F. Manski, 1993. "Identification of Endogenous Social Effects: The Reflection Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 531-542.
    12. Bramoullé, Yann & Djebbari, Habiba & Fortin, Bernard, 2009. "Identification of peer effects through social networks," Journal of Econometrics, Elsevier, vol. 150(1), pages 41-55, May.
    13. Sobel, Michael E., 2006. "What Do Randomized Studies of Housing Mobility Demonstrate?: Causal Inference in the Face of Interference," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1398-1407, December.
    14. Laurent Davezies & Xavier D'Haultfoeuille & Denis Fougère, 2009. "Identification of peer effects using group size variation," Econometrics Journal, Royal Economic Society, vol. 12(3), pages 397-413, November.
    15. Marc Ferracci & Gr�gory Jolivet & Gerard J. van den Berg, 2014. "Evidence of Treatment Spillovers Within Markets," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 812-823, December.
    16. Rokhaya Dieye & Habiba Djebbari & Felipe Barrera-Osorio, 2014. "Accounting for Peer Effects in Treatment Response," AMSE Working Papers 1435, Aix-Marseille School of Economics, France, revised Jul 2014.
    17. Paul Goldsmith-Pinkham & Guido W. Imbens, 2013. "Social Networks and the Identification of Peer Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 253-264, July.
    18. Rafael Lalive & M. Alejandra Cattaneo, 2009. "Social Interactions and Schooling Decisions," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 457-477, August.
    19. Scott E. Carrell & Richard L. Fullerton & James E. West, 2009. "Does Your Cohort Matter? Measuring Peer Effects in College Achievement," Journal of Labor Economics, University of Chicago Press, vol. 27(3), pages 439-464, July.
    20. Bruce Sacerdote, 2001. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 681-704.
    21. Yann Bramoullé & Andrea Galeotti & Brian Rogers, 2016. "The Oxford Handbook of the Economics of Networks," Post-Print hal-01447842, HAL.
    22. William A. Brock & Steven N. Durlauf, 2001. "Discrete Choice with Social Interactions," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 68(2), pages 235-260.
    23. Áureo de Paula, 2013. "Econometric Analysis of Games with Multiple Equilibria," Annual Review of Economics, Annual Reviews, vol. 5(1), pages 107-131, May.
    24. Betsy Sinclair & Margaret McConnell & Donald P. Green, 2012. "Detecting Spillover Effects: Design and Analysis of Multilevel Experiments," American Journal of Political Science, John Wiley & Sons, vol. 56(4), pages 1055-1069, October.
    25. Tomas Philipson, 1999. "External Treatment Effects and Program Implementation Bias," Working Papers 9929, Harris School of Public Policy Studies, University of Chicago.
    26. Kline, Patrick & Santos, Andres, 2012. "Higher order properties of the wild bootstrap under misspecification," Journal of Econometrics, Elsevier, vol. 171(1), pages 54-70.
    27. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    28. Giacomo De Giorgi & Michele Pellizzari & Silvia Redaelli, 2010. "Identification of Social Interactions through Partially Overlapping Peer Groups," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 241-275, April.
    29. Rosenbaum, Paul R., 2007. "Interference Between Units in Randomized Experiments," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 191-200, March.
    30. John Beshears & James J. Choi & David Laibson & Brigitte C. Madrian & Katherine L. Milkman, 2015. "The Effect of Providing Peer Information on Retirement Savings Decisions," Journal of Finance, American Finance Association, vol. 70(3), pages 1161-1201, June.
    31. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    32. Stinebrickner, Ralph & Stinebrickner, Todd R., 2006. "What can be learned about peer effects using college roommates? Evidence from new survey data and students from disadvantaged backgrounds," Journal of Public Economics, Elsevier, vol. 90(8-9), pages 1435-1454, September.
    33. Scott E. Carrell & Bruce I. Sacerdote & James E. West, 2013. "From Natural Variation to Optimal Policy? The Importance of Endogenous Peer Group Formation," Econometrica, Econometric Society, vol. 81(3), pages 855-882, May.
    34. Gustavo J. Bobonis & Frederico Finan, 2009. "Neighborhood Peer Effects in Secondary School Enrollment Decisions," The Review of Economics and Statistics, MIT Press, vol. 91(4), pages 695-716, November.
    35. Nicholas Christakis & James Fowler & Guido Imbens & Karthik Kalyanaraman, 2010. "An empirical model for strategic network formation," CeMMAP working papers CWP16/10, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    36. Yann Bramoullé & Andrea Galeotti & Brian Rogers, 2016. "The Oxford Handbook of the Economics of Networks," Post-Print hal-03572533, HAL.
    37. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    38. Rigdon, Joseph & Hudgens, Michael G., 2015. "Exact confidence intervals in the presence of interference," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 130-135.
    39. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    40. Lan Liu & Michael G. Hudgens, 2014. "Large Sample Randomization Inference of Causal Effects in the Presence of Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 288-301, March.
    41. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    42. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    43. Lee, Lung-fei, 2007. "Identification and estimation of econometric models with group interactions, contextual factors and fixed effects," Journal of Econometrics, Elsevier, vol. 140(2), pages 333-374, October.
    44. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    45. Graham, Bryan S. & Hahn, Jinyong, 2005. "Identification and estimation of the linear-in-means model of social interactions," Economics Letters, Elsevier, vol. 88(1), pages 1-6, July.
    46. Diether W. Beuermann & Julian Cristia & Santiago Cueto & Ofer Malamud & Yyannu Cruz-Aguayo, 2015. "One Laptop per Child at Home: Short-Term Impacts from a Randomized Experiment in Peru," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 53-80, April.
    47. David S. Lyle, 2007. "Estimating and Interpreting Peer and Role Model Effects from Randomly Assigned Social Groups at West Point," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 289-299, May.
    48. Natalia Lazzati, 2015. "Treatment response with social interactions: Partial identification via monotone comparative statics," Quantitative Economics, Econometric Society, vol. 6(1), pages 49-83, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tadao Hoshino & Takahide Yanagi, 2023. "Randomization Test for the Specification of Interference Structure," Papers 2301.05580, arXiv.org, revised Dec 2023.
    2. Jizhou Liu, 2023. "Inference for Two-stage Experiments under Covariate-Adaptive Randomization," Papers 2301.09016, arXiv.org, revised Oct 2023.
    3. Anish Agarwal & Sarah H. Cen & Devavrat Shah & Christina Lee Yu, 2022. "Network Synthetic Interventions: A Causal Framework for Panel Data Under Network Interference," Papers 2210.11355, arXiv.org, revised Oct 2023.
    4. Aibo Gong, 2021. "Bounds for Treatment Effects in the Presence of Anticipatory Behavior," Papers 2111.06573, arXiv.org, revised Dec 2022.
    5. Tadao Hoshino, 2023. "Causal Interpretation of Linear Social Interaction Models with Endogenous Networks," Papers 2308.04276, arXiv.org, revised Oct 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    2. Michael P. Leung, 2020. "Treatment and Spillover Effects Under Network Interference," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 368-380, May.
    3. Áureo de Paula, 2015. "Econometrics of network models," CeMMAP working papers CWP52/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    5. Arun Advani & Bansi Malde, 2018. "Methods to identify linear network models: a review," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 154(1), pages 1-16, December.
    6. Berlinski, Samuel & Busso, Matias & Giannola, Michele, 2023. "Helping struggling students and benefiting all: Peer effects in primary education," Journal of Public Economics, Elsevier, vol. 224(C).
    7. Arun Advani & Bansi Malde, 2014. "Empirical methods for networks data: social effects, network formation and measurement error," IFS Working Papers W14/34, Institute for Fiscal Studies.
    8. Kuersteiner, Guido M. & Prucha, Ingmar R. & Zeng, Ying, 2023. "Efficient peer effects estimators with group effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 2155-2194.
    9. Michael P. Leung, 2022. "Causal Inference Under Approximate Neighborhood Interference," Econometrica, Econometric Society, vol. 90(1), pages 267-293, January.
    10. Bryan S. Graham, 2019. "Network Data," Papers 1912.06346, arXiv.org.
    11. Boucher, Vincent & Fortin, Bernard, 2015. "Some Challenges in the Empirics of the Effects of Networks," IZA Discussion Papers 8896, Institute of Labor Economics (IZA).
    12. Yingyao Hu & Zhongjian Lin, 2018. "Misclassification and the hidden silent rivalry," CeMMAP working papers CWP12/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Jose-Alberto Guerra & Myra Mohnen, 2022. "Multinomial Choice with Social Interactions: Occupations in Victorian London," The Review of Economics and Statistics, MIT Press, vol. 104(4), pages 736-747, October.
    14. repec:hal:spmain:info:hdl:2441/1jgbspo1909q48svne93o55rca is not listed on IDEAS
    15. Alexis Le Chapelain, 2014. "Market for Education and Student Achievement," Sciences Po publications info:hdl:2441/1jgbspo1909, Sciences Po.
    16. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2017. "Optimal Design of Experiments in the Presence of Interference*, Second Version," PIER Working Paper Archive 16-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 30 Nov 2017.
    17. Patacchini, Eleonora & Hsieh, Chih-Sheng & Lin, Xu, 2019. "Social Interaction Methods," CEPR Discussion Papers 14141, C.E.P.R. Discussion Papers.
    18. Vincent Boucher & Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2014. "Do Peers Affect Student Achievement? Evidence From Canada Using Group Size Variation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 91-109, January.
    19. Davide Viviano, 2020. "Experimental Design under Network Interference," Papers 2003.08421, arXiv.org, revised Jul 2022.
    20. Susan Athey & Guido Imbens, 2016. "The Econometrics of Randomized Experiments," Papers 1607.00698, arXiv.org.
    21. Zhaonan Qu & Ruoxuan Xiong & Jizhou Liu & Guido Imbens, 2021. "Efficient Treatment Effect Estimation in Observational Studies under Heterogeneous Partial Interference," Papers 2107.12420, arXiv.org, revised Jun 2022.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1711.02745. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.