IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2506.22989.html
   My bibliography  Save this paper

Design-Based and Network Sampling-Based Uncertainties in Network Experiments

Author

Listed:
  • Kensuke Sakamoto
  • Yuya Shimizu

Abstract

Ordinary least squares (OLS) estimators are widely used in network experiments to estimate spillover effects. We study the causal interpretation of, and inference for the OLS estimator under both design-based uncertainty from random treatment assignment and sampling-based uncertainty in network links. We show that correlations among regressors that capture the exposure to neighbors' treatments can induce contamination bias, preventing OLS from aggregating heterogeneous spillover effects for a clear causal interpretation. We derive the OLS estimator's asymptotic distribution and propose a network-robust variance estimator. Simulations and an empirical application demonstrate that contamination bias can be substantial, leading to inflated spillover estimates.

Suggested Citation

  • Kensuke Sakamoto & Yuya Shimizu, 2025. "Design-Based and Network Sampling-Based Uncertainties in Network Experiments," Papers 2506.22989, arXiv.org, revised Sep 2025.
  • Handle: RePEc:arx:papers:2506.22989
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2506.22989
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sule Alan & Gozde Corekcioglu & Matthias Sutter, 2023. "Improving Workplace Climate in Large Corporations: A Clustered Randomized Intervention," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 151-203.
    2. Abhijit Banerjee & Emily Brez & Arun G Chandrasekhar & Benjamin Golub, 2024. "When Less Is More: Experimental Evidence on Information Delivery During India’s Demonetisation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(4), pages 1884-1922.
    3. Di Falco, Salvatore & Feri, Francesco & Pin, Paolo & Vollenweider, Xavier, 2018. "Ties that bind: Network redistributive pressure and economic decisions in village economies," Journal of Development Economics, Elsevier, vol. 131(C), pages 123-131.
    4. Hernández-Agramonte, Juan Manuel & Namen, Olga & Näslund-Hadley, Emma & Biehl, Maria Loreto, 2024. "Supporting early childhood development remotely: Experimental evidence from SMS messages," Journal of Development Economics, Elsevier, vol. 166(C).
    5. Kojevnikov, Denis & Marmer, Vadim & Song, Kyungchul, 2021. "Limit theorems for network dependent random variables," Journal of Econometrics, Elsevier, vol. 222(2), pages 882-908.
    6. Arun G. Chandrasekhar & Cynthia Kinnan & Horacio Larreguy, 2018. "Social Networks as Contract Enforcement: Evidence from a Lab Experiment in the Field," American Economic Journal: Applied Economics, American Economic Association, vol. 10(4), pages 43-78, October.
    7. Lori Beaman & Ariel BenYishay & Jeremy Magruder & Ahmed Mushfiq Mobarak, 2021. "Can Network Theory-Based Targeting Increase Technology Adoption?," American Economic Review, American Economic Association, vol. 111(6), pages 1918-1943, June.
    8. Michael P. Leung, 2022. "Causal Inference Under Approximate Neighborhood Interference," Econometrica, Econometric Society, vol. 90(1), pages 267-293, January.
    9. Jing Cai & Adam Szeidl, 2018. "Interfirm Relationships and Business Performance," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(3), pages 1229-1282.
    10. Kandpal, Eeshani & Baylis, Kathy, 2019. "The social lives of married women: Peer effects in female autonomy and investments in children," Journal of Development Economics, Elsevier, vol. 140(C), pages 26-43.
    11. Michael Carter & Rachid Laajaj & Dean Yang, 2021. "Subsidies and the African Green Revolution: Direct Effects and Social Network Spillovers of Randomized Input Subsidies in Mozambique," American Economic Journal: Applied Economics, American Economic Association, vol. 13(2), pages 206-229, April.
    12. Sharon Barnhardt & Erica Field & Rohini Pande, 2017. "Moving to Opportunity or Isolation? Network Effects of a Randomized Housing Lottery in Urban India," American Economic Journal: Applied Economics, American Economic Association, vol. 9(1), pages 1-32, January.
    13. Judd B. Kessler, 2017. "Announcements of Support and Public Good Provision," American Economic Review, American Economic Association, vol. 107(12), pages 3760-3787, December.
    14. Afridi, Farzana & Dhillon, Amrita & Li, Sherry Xin & Sharma, Swati, 2020. "Using social connections and financial incentives to solve coordination failure: A quasi-field experiment in India's manufacturing sector," Journal of Development Economics, Elsevier, vol. 144(C).
    15. Michael Callen & James D. Long, 2015. "Institutional Corruption and Election Fraud: Evidence from a Field Experiment in Afghanistan," American Economic Review, American Economic Association, vol. 105(1), pages 354-381, January.
    16. Vivi Alatas & Abhijit Banerjee & Arun G. Chandrasekhar & Rema Hanna & Benjamin A. Olken, 2016. "Network Structure and the Aggregation of Information: Theory and Evidence from Indonesia," American Economic Review, American Economic Association, vol. 106(7), pages 1663-1704, July.
    17. Barsbai, Toman & Licuanan, Victoria & Steinmayr, Andreas & Tiongson, Erwin & Yang, Dean, 2024. "Information and immigrant settlement," Journal of Development Economics, Elsevier, vol. 170(C).
    18. Boltz, Marie & Marazyan, Karine & Villar, Paola, 2019. "Income hiding and informal redistribution: A lab-in-the-field experiment in Senegal," Journal of Development Economics, Elsevier, vol. 137(C), pages 78-92.
    19. Francesco Drago & Friederike Mengel & Christian Traxler, 2020. "Compliance Behavior in Networks: Evidence from a Field Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 12(2), pages 96-133, April.
    20. Björkegren, Daniel & Karaca, Burak Ceyhun, 2022. "Network adoption subsidies: A digital evaluation of a rural mobile phone program in Rwanda," Journal of Development Economics, Elsevier, vol. 154(C).
    21. Yulia Evsyukova & Felix Rusche & Wladislaw Mill, 2025. "LinkedOut? A Field Experiment on Discrimination in Job Network Formation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(1), pages 283-334.
    22. Emanuele Colonnelli & Bo Li & Ernest Liu, 2024. "Investing with the Government: A Field Experiment in China," Journal of Political Economy, University of Chicago Press, vol. 132(1), pages 248-294.
    23. Gustavo J. Bobonis & Paul J. Gertler & Marco Gonzalez-Navarro & Simeon Nichter, 2022. "Vulnerability and Clientelism," American Economic Review, American Economic Association, vol. 112(11), pages 3627-3659, November.
    24. Batista, Catia & Costa, David M. & Freitas, Pedro & Lima, Gonçalo & Reis, Ana B., 2025. "What matters for the decision to study abroad? A lab-in-the-field experiment in Cape Verde," Journal of Development Economics, Elsevier, vol. 173(C).
    25. Kirill Borusyak & Peter Hull, 2023. "Nonrandom Exposure to Exogenous Shocks," Econometrica, Econometric Society, vol. 91(6), pages 2155-2185, November.
    26. Nagavarapu, Sriniketh & Sekhri, Sheetal, 2016. "Informal monitoring and enforcement mechanisms in public service delivery: Evidence from the public distribution system in India," Journal of Development Economics, Elsevier, vol. 121(C), pages 63-78.
    27. Flory, Jeffrey A., 2018. "Formal finance and informal safety nets of the poor: Evidence from a savings field experiment," Journal of Development Economics, Elsevier, vol. 135(C), pages 517-533.
    28. Fafchamps, Marcel & Vicente, Pedro C., 2013. "Political violence and social networks: Experimental evidence from a Nigerian election," Journal of Development Economics, Elsevier, vol. 101(C), pages 27-48.
    29. BenYishay, Ariel & Jones, Maria & Kondylis, Florence & Mobarak, Ahmed Mushfiq, 2020. "Gender gaps in technology diffusion," Journal of Development Economics, Elsevier, vol. 143(C).
    30. Abhijit Banerjee & Arun G Chandrasekhar & Esther Duflo & Matthew O Jackson, 2019. "Using Gossips to Spread Information: Theory and Evidence from Two Randomized Controlled Trials," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(6), pages 2453-2490.
    31. A. Belloni & V. Chernozhukov & I. Fernández‐Val & C. Hansen, 2017. "Program Evaluation and Causal Inference With High‐Dimensional Data," Econometrica, Econometric Society, vol. 85, pages 233-298, January.
    32. Dhillon, Amrita & Afridi, Farzana & Li, Sherry Xin & Sharma, Swati, 2020. "Using Social Connections and Financial Incentives to Solve Coordination Failure: A Quasi-Field Experiment in India's Manufactur," CEPR Discussion Papers 14356, C.E.P.R. Discussion Papers.
    33. Godlonton, Susan & Thornton, Rebecca, 2012. "Peer effects in learning HIV results," Journal of Development Economics, Elsevier, vol. 97(1), pages 118-129.
    34. Soldani, Emilia & Hildebrandt, Nicole & Nyarko, Yaw & Romagnoli, Giorgia, 2023. "Price information, inter-village networks, and “bargaining spillovers”: Experimental evidence from Ghana," Journal of Development Economics, Elsevier, vol. 164(C).
    35. Jing Cai & Alain De Janvry & Elisabeth Sadoulet, 2015. "Social Networks and the Decision to Insure," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 81-108, April.
    36. Pamela Jakiela & Owen Ozier, 2016. "Does Africa Need a Rotten Kin Theorem? Experimental Evidence from Village Economies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(1), pages 231-268.
    37. Ariel BenYishay & A Mushfiq Mobarak, 2019. "Social Learning and Incentives for Experimentation and Communication," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(3), pages 976-1009.
    38. Jonathan Robinson, 2012. "Limited Insurance within the Household: Evidence from a Field Experiment in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 4(4), pages 140-164, October.
    39. Joshua W. Deutschmann & Molly Lipscomb & Laura Schechter & Jessica Zhu, 2024. "Spillovers without Social Interactions in Urban Sanitation," American Economic Journal: Applied Economics, American Economic Association, vol. 16(3), pages 482-515, July.
    40. Coutts, Alexander, 2022. "Identifying communication spillovers in lab-in-the-field experiments," Journal of Development Economics, Elsevier, vol. 157(C).
    41. Cesi Cruz & Julien Labonne & Pablo Querubín, 2017. "Politician Family Networks and Electoral Outcomes: Evidence from the Philippines," American Economic Review, American Economic Association, vol. 107(10), pages 3006-3037, October.
    42. Amanda Pallais & Emily Glassberg Sands, 2016. "Why the Referential Treatment? Evidence from Field Experiments on Referrals," Journal of Political Economy, University of Chicago Press, vol. 124(6), pages 1793-1828.
    43. Martin Abel & Rulof Burger & Patrizio Piraino, 2020. "The Value of Reference Letters: Experimental Evidence from South Africa," American Economic Journal: Applied Economics, American Economic Association, vol. 12(3), pages 40-71, July.
    44. Emily Breza & Arun G. Chandrasekhar, 2019. "Social Networks, Reputation, and Commitment: Evidence From a Savings Monitors Experiment," Econometrica, Econometric Society, vol. 87(1), pages 175-216, January.
    45. Chegere, Martin J. & Falco, Paolo & Menzel, Andreas, 2024. "Social ties at work and effort choice: Experimental evidence from Tanzania," Journal of Development Economics, Elsevier, vol. 171(C).
    46. Emily Breza & Arun G. Chandrasekhar & Tyler H. McCormick & Mengjie Pan, 2020. "Using Aggregated Relational Data to Feasibly Identify Network Structure without Network Data," American Economic Review, American Economic Association, vol. 110(8), pages 2454-2484, August.
    47. Xavier Giné & Ghazala Mansuri, 2018. "Together We Will: Experimental Evidence on Female Voting Behavior in Pakistan," American Economic Journal: Applied Economics, American Economic Association, vol. 10(1), pages 207-235, January.
    48. Levine, David & Polimeni, Rachel & Ramage, Ian, 2016. "Insuring health or insuring wealth? An experimental evaluation of health insurance in rural Cambodia," Journal of Development Economics, Elsevier, vol. 119(C), pages 1-15.
    49. Costas Meghir & A Mushfiq Mobarak & Corina Mommaerts & Melanie Morten, 2022. "Migration and Informal Insurance: Evidence from a Randomized Controlled Trial and a Structural Model," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(1), pages 452-480.
    50. Simon Heß & Dany Jaimovich & Matthias Schündeln, 2021. "Development Projects and Economic Networks: Lessons from Rural Gambia [Network Structure and the Aggregation of Information: Theory and Evidence from Indonesia]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1347-1384.
    51. Hardy, Morgan & McCasland, Jamie, 2021. "It takes two: Experimental evidence on the determinants of technology diffusion," Journal of Development Economics, Elsevier, vol. 149(C).
    52. Anne Karing, 2024. "Social Signaling and Childhood Immunization: A Field Experiment in Sierra Leone," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(4), pages 2083-2133.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raúl Duarte & Frederico Finan & Horacio Larreguy & Laura Schechter, 2019. "Brokering Votes With Information Spread Via Social Networks," NBER Working Papers 26241, National Bureau of Economic Research, Inc.
    2. Wenhao Cheng, 2024. "Naïve learning as a coordination device in social networks," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 26(3), June.
    3. Bonan, Jacopo & Battiston, Pietro & Bleck, Jaimie & LeMay-Boucher, Philippe & Pareglio, Stefano & Sarr, Bassirou & Tavoni, Massimo, 2021. "Social interaction and technology adoption: Experimental evidence from improved cookstoves in Mali," World Development, Elsevier, vol. 144(C).
    4. Anandi Mani & Emma Riley, 2019. "Social networks, role models, peer effects, and aspirations," WIDER Working Paper Series wp-2019-120, World Institute for Development Economic Research (UNU-WIDER).
    5. Abu Siddique & Michael Vlassopoulos & Yves Zenou, 2024. "Leveraging edutainment and social networks to foster interethnic harmony," IFS Working Papers W24/20, Institute for Fiscal Studies.
    6. Alejandro Sanchez-Becerra, 2022. "The Network Propensity Score: Spillovers, Homophily, and Selection into Treatment," Papers 2209.14391, arXiv.org.
    7. Cátia Batista & Marcel Fafchamps & Pedro C Vicente, 2022. "Keep It Simple: A Field Experiment on Information Sharing among Strangers [Changing Saving and Investment Behavior: The Impact of Financial Literacy Training and Reminders on Micro-Businesses]," The World Bank Economic Review, World Bank, vol. 36(4), pages 857-888.
    8. Alison Andrew & Orazio Attanasio & Britta Augsburg & Jere Behrman & Monimalika Day & Pamela Jervis & Costas Meghir & Angus Phimister, 2024. "Mothers’ Social Networks and Socioeconomic Gradients of Isolation," Economic Development and Cultural Change, University of Chicago Press, vol. 73(1), pages 487-522.
    9. Francesco Drago & Friederike Mengel & Christian Traxler, 2020. "Compliance Behavior in Networks: Evidence from a Field Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 12(2), pages 96-133, April.
    10. Lnu,Anukriti & Herrera-Almanza,Catalina & Karra,Mahesh Venkat, 2022. "Bring a Friend : Strengthening Women’s Social Networks and Reproductive Autonomy in India," Policy Research Working Paper Series 10107, The World Bank.
    11. Bramoullé, Yann & Genicot, Garance, 2024. "Diffusion and targeting centrality," Journal of Economic Theory, Elsevier, vol. 222(C).
    12. Stefano Caria & Simon Franklin & Marc Witte, 2023. "Searching with Friends," Journal of Labor Economics, University of Chicago Press, vol. 41(4), pages 887-922.
    13. Carattini, Stefano & Gosnell, Greer & Tavoni, Alessandro, 2020. "How developed countries can learn from developing countries to tackle climate change," World Development, Elsevier, vol. 127(C).
    14. Islam, Asadul & Ushchev, Philip & Zenou, Yves & Zhang, Xin, 2019. "The Value of Information in Technology Adoption," IZA Discussion Papers 12672, Institute of Labor Economics (IZA).
    15. Bora Kim, 2024. "Estimating Spillover Effects in the Presence of Isolated Nodes," Papers 2412.05919, arXiv.org.
    16. Chowdhury, Shyamal & Satish, Varun & Sulaiman, Munshi & Sun, Yi, 2022. "Sooner rather than later: Social networks and technology adoption," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 466-482.
    17. Bin Khaled, Muhammad Nahian & Maredia, Mywish K., 2024. "Long-term influence of social network and peers' characteristics on agricultural technology adoption: Evidence from Tanzania," 2024 Annual Meeting, July 28-30, New Orleans, LA 343777, Agricultural and Applied Economics Association.
    18. Mattea Stein, 2021. "Know-how and Know-who: Effects of a Randomized Training on Network Changes Among Small Urban Entrepreneurs," CSEF Working Papers 622, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    19. S Anukriti & Catalina Herrera‐Almanza & Praveen K. Pathak & Mahesh Karra, 2020. "Curse of the Mummy‐ji: The Influence of Mothers‐in‐Law on Women in India†," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(5), pages 1328-1351, October.
    20. Björkegren, Daniel & Karaca, Burak Ceyhun, 2022. "Network adoption subsidies: A digital evaluation of a rural mobile phone program in Rwanda," Journal of Development Economics, Elsevier, vol. 154(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2506.22989. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.