IDEAS home Printed from https://ideas.repec.org/p/pen/papers/15-021.html
   My bibliography  Save this paper

Designing Experiments to Measure Spillover Effects, Second Version

Author

Listed:
  • Sarah Baird

    (Department of Global Health, George Washington University)

  • Aislinn Bohren

    (Department of Economics, University of Pennsylvania)

  • Craig McIntosh

    (Department of Economics, UC San Diego)

  • Berk Ozler

    (The World Bank)

Abstract

This paper formalizes the design of experiments intended specifically to study spillover effects. By first randomizing the intensity of treatment within clusters and then randomly assigning individual treatment conditional on this cluster-level intensity, a novel set of treatment effects can be identified. We develop a formal framework for consistent estimation of these effects, and provide explicit expressions for power calculations. We show that the power to detect average treatment effects declines precisely with the quantity that identifies the novel treatment effects. A demonstration of the technique is provided using a cash transfer program in Malawi.

Suggested Citation

  • Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2015. "Designing Experiments to Measure Spillover Effects, Second Version," PIER Working Paper Archive 15-021, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 01 Jun 2015.
    • Handle: RePEc:pen:papers:15-021
    as

    Download full text from publisher

    File URL: https://economics.sas.upenn.edu/sites/default/files/filevault/15-021.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Matias Busso & Sebastian Galiani, 2019. "The Causal Effect of Competition on Prices and Quality: Evidence from a Field Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 33-56, January.
    2. repec:hal:pseose:halshs-00840901 is not listed on IDEAS
    3. Angelucci, Manuela & De Giorgi, Giacomo & Rangel, Marcos A. & Rasul, Imran, 2010. "Family networks and school enrolment: Evidence from a randomized social experiment," Journal of Public Economics, Elsevier, vol. 94(3-4), pages 197-221, April.
    4. Peter Kuhn & Peter Kooreman & Adriaan Soetevent & Arie Kapteyn, 2011. "The Effects of Lottery Prizes on Winners and Their Neighbors: Evidence from the Dutch Postcode Lottery," American Economic Review, American Economic Association, vol. 101(5), pages 2226-2247, August.
    5. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    6. Emily Oster & Rebecca Thornton, 2012. "Determinants Of Technology Adoption: Peer Effects In Menstrual Cup Take-Up," Journal of the European Economic Association, European Economic Association, vol. 10(6), pages 1263-1293, December.
    7. George A. Akerlof & Rachel E. Kranton, 2002. "Identity and Schooling: Some Lessons for the Economics of Education," Journal of Economic Literature, American Economic Association, vol. 40(4), pages 1167-1201, December.
    8. Esther Duflo & Emmanuel Saez, 2003. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 815-842.
    9. Manuela Angelucci & Giacomo De Giorgi, 2009. "Indirect Effects of an Aid Program: How Do Cash Transfers Affect Ineligibles' Consumption?," American Economic Review, American Economic Association, vol. 99(1), pages 486-508, March.
    10. Charles F. Manski, 2013. "Identification of treatment response with social interactions," Econometrics Journal, Royal Economic Society, vol. 16(1), pages 1-23, February.
    11. Duflo, Esther & Saez, Emmanuel, 2002. "Participation and investment decisions in a retirement plan: the influence of colleagues' choices," Journal of Public Economics, Elsevier, vol. 85(1), pages 121-148, July.
    12. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    13. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    14. Philip S. Babcock & John L. Hartman, 2010. "Networks and Workouts: Treatment Size and Status Specific Peer Effects in a Randomized Field Experiment," NBER Working Papers 16581, National Bureau of Economic Research, Inc.
    15. Timothy G. Conley & Christopher R. Udry, 2010. "Learning about a New Technology: Pineapple in Ghana," American Economic Review, American Economic Association, vol. 100(1), pages 35-69, March.
    16. Masanjala, Winford, 2007. "The poverty-HIV/AIDS nexus in Africa: A livelihood approach," Social Science & Medicine, Elsevier, vol. 64(5), pages 1032-1041, March.
    17. Hirano, Keisuke & Hahn, Jinyong, 2010. "Design of randomized experiments to measure social interaction effects," Economics Letters, Elsevier, vol. 106(1), pages 51-53, January.
    18. Peter M. Aronow, 2012. "A General Method for Detecting Interference Between Units in Randomized Experiments," Sociological Methods & Research, , vol. 41(1), pages 3-16, February.
    19. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    20. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    21. Banerjee, Abhijit & Duflo, Esther & , & Keniston, Daniel & Singh, Nina, 2012. "Can Institutions Be Reformed from Within? Evidence from a Randomized Experiment with the Rajasthan Police," CEPR Discussion Papers 8869, C.E.P.R. Discussion Papers.
    22. Lori A. Beaman, 2012. "Social Networks and the Dynamics of Labour Market Outcomes: Evidence from Refugees Resettled in the U.S," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 79(1), pages 128-161.
    23. Kaivan Munshi, 2003. "Networks in the Modern Economy: Mexican Migrants in the U. S. Labor Market," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(2), pages 549-599.
    24. Behrman, Jere R & Sengupta, Piyali & Todd, Petra, 2005. "Progressing through PROGRESA: An Impact Assessment of a School Subsidy Experiment in Rural Mexico," Economic Development and Cultural Change, University of Chicago Press, vol. 54(1), pages 237-275, October.
    25. Macours, Karen & Vakis, Renos, 2009. "Changing households'investments and aspirations through social interactions : evidence from a randomized transfer program," Policy Research Working Paper Series 5137, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jesse Rothstein & Till von Wachter, 2016. "Social Experiments in the Labor Market," NBER Working Papers 22585, National Bureau of Economic Research, Inc.
    2. Konstantin Büchel & Martina Jakob & Christoph Kühnhanss & Daniel Steffen & Aymo Brunetti, 2020. "The Relative Effectiveness of Teachers and Learning Software: Evidence from a Field Experiment in El Salvador," University of Bern Social Sciences Working Papers 36, University of Bern, Department of Social Sciences.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sarah Baird & Aislinn Bohren & Berk Ozler & Craig McIntosh, 2014. "Designing Experiments to Measure Spillover Effects," Working Papers 2014-11, The George Washington University, Institute for International Economic Policy.
    2. Sarah Baird & Aislinn Bohren & Craig McIntosh & Berk Ozler, 2017. "Optimal Design of Experiments in the Presence of Interference*, Second Version," PIER Working Paper Archive 16-025, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 30 Nov 2017.
    3. Manuela Angelucci & Silvia Prina & Heather Royer & Anya Samek, 2015. "When Incentives Backfire: Spillover Effects in Food Choice," NBER Working Papers 21481, National Bureau of Economic Research, Inc.
    4. DiTraglia, Francis J. & García-Jimeno, Camilo & O’Keeffe-O’Donovan, Rossa & Sánchez-Becerra, Alejandro, 2023. "Identifying causal effects in experiments with spillovers and non-compliance," Journal of Econometrics, Elsevier, vol. 235(2), pages 1589-1624.
    5. Francis J. DiTraglia & Camilo Garcia-Jimeno & Rossa O'Keeffe-O'Donovan & Alejandro Sanchez-Becerra, 2020. "Identifying Causal Effects in Experiments with Spillovers and Non-compliance," Papers 2011.07051, arXiv.org, revised Jan 2023.
    6. Baylis, Kathy & Ham, Andres, 2015. "How important is spatial correlation in randomized controlled trials?," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205586, Agricultural and Applied Economics Association.
    7. Matteo Bobba & Jérémie Gignoux, 2011. "Policy-induced Social Interactions and Schooling Decisions," PSE Working Papers halshs-00962478, HAL.
    8. Matteo Bobba & Jérémie Gignoux, 2019. "Neighborhood Effects in Integrated Social Policies," The World Bank Economic Review, World Bank, vol. 33(1), pages 116-139.
    9. Rafael P. Ribas, 2020. "Liquidity constraints, spillovers, and entrepreneurship: evidence from a cash transfer program," Small Business Economics, Springer, vol. 55(4), pages 1131-1158, December.
    10. Dario Tortarolo & Guillermo Cruces & Gonzalo Vazquez-Bare, 2023. "Design of partial population experiments with an application to spillovers in tax compliance," IFS Working Papers W23/17, Institute for Fiscal Studies.
    11. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    12. Lina Zhang, 2020. "Spillovers of Program Benefits with Missing Network Links," Papers 2009.09614, arXiv.org, revised Aug 2024.
    13. Matteo Bobba & Jérémie Gignoux, 2014. "Neighborhood effects and take-up of transfers in integrated social policies: Evidence from Progresa," PSE Working Papers halshs-00646590, HAL.
    14. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    15. Vazquez-Bare, Gonzalo, 2023. "Identification and estimation of spillover effects in randomized experiments," Journal of Econometrics, Elsevier, vol. 237(1).
    16. Heitzig, Chris & O’Keeffe-O’Donovan, Rossa, 2024. "Spillover Effects and Diffusion of Savings Groups," World Development, Elsevier, vol. 173(C).
    17. Michael P. Leung, 2020. "Treatment and Spillover Effects Under Network Interference," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 368-380, May.
    18. Gonzalo Vazquez-Bare, 2017. "Identification and Estimation of Spillover Effects in Randomized Experiments," Papers 1711.02745, arXiv.org, revised Jan 2022.
    19. Kate Ambler & Diego Aycinena & Dean Yang, 2015. "Channeling Remittances to Education: A Field Experiment among Migrants from El Salvador," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 207-232, April.
    20. Bonan, Jacopo & Battiston, Pietro & Bleck, Jaimie & LeMay-Boucher, Philippe & Pareglio, Stefano & Sarr, Bassirou & Tavoni, Massimo, 2021. "Social interaction and technology adoption: Experimental evidence from improved cookstoves in Mali," World Development, Elsevier, vol. 144(C).

    More about this item

    Keywords

    Experimental Design; Networks; Cash Transfers;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • O22 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Project Analysis
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pen:papers:15-021. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Administrator (email available below). General contact details of provider: https://edirc.repec.org/data/deupaus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.