IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v157y2022ics0304387822000232.html
   My bibliography  Save this article

Identifying communication spillovers in lab-in-the-field experiments

Author

Listed:
  • Coutts, Alexander

Abstract

Use of lab-in-the-field experiments has steadily increased, given benefits of studying relevant populations and their preferences. In the field, researchers must often relinquish the control of a standard laboratory, raising the specter of communication from past to future participants. Little is known about the consequences of such spillovers, and recent literature indicates variation in how authors deal with them. I provide estimates of communication spillovers using existing data from public goods games in Rwanda, leveraging variation in planning the sequence of visiting 147 villages. The resulting order created opportunities for some villages to communicate with past participants. Using ex-post matching of villages with and without these opportunities I find that communication led to substantial increases in cooperation, suggesting that unanticipated spillovers can bias inference. I conclude with advice for creating protocols to deal with communication spillovers.

Suggested Citation

  • Coutts, Alexander, 2022. "Identifying communication spillovers in lab-in-the-field experiments," Journal of Development Economics, Elsevier, vol. 157(C).
  • Handle: RePEc:eee:deveco:v:157:y:2022:i:c:s0304387822000232
    DOI: 10.1016/j.jdeveco.2022.102845
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387822000232
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2022.102845?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Uri Gneezy & Andreas Leibbrandt & John A. List, 2016. "Ode to the Sea: Workplace Organizations and Norms of Cooperation," Economic Journal, Royal Economic Society, vol. 126(595), pages 1856-1883, September.
    2. Ananish Chaudhuri & Sara Graziano & Pushkar Maitra, 2006. "Social Learning and Norms in a Public Goods Experiment with Inter-Generational Advice -super-1," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(2), pages 357-380.
    3. Joseph Henrich, 2001. "In Search of Homo Economicus: Behavioral Experiments in 15 Small-Scale Societies," American Economic Review, American Economic Association, vol. 91(2), pages 73-78, May.
    4. Dufwenberg, Martin & Gächter, Simon & Hennig-Schmidt, Heike, 2011. "The framing of games and the psychology of play," Games and Economic Behavior, Elsevier, vol. 73(2), pages 459-478.
    5. Abhijit Banerjee & Rukmini Banerji & James Berry & Esther Duflo & Harini Kannan & Shobhini Mukerji & Marc Shotland & Michael Walton, 2017. "From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 73-102, Fall.
    6. Jeannette Brosig & Joachim Weimann & Axel Ockenfels, 2003. "The Effect of Communication Media on Cooperation," German Economic Review, Verein für Socialpolitik, vol. 4(2), pages 217-241, May.
    7. Jeffrey P. Carpenter & Glenn W. Harrison & John A. List, 2005. "Field Experiments In Economics: An Introduction," Research in Experimental Economics, in: Field Experiments in Economics, pages 1-15, Emerald Group Publishing Limited.
    8. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    9. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(2), pages 1-47, April.
    10. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    11. Avdeenko, Alexandra & Gilligan, Michael J., 2015. "International Interventions to Build Social Capital: Evidence from a Field Experiment in Sudan," American Political Science Review, Cambridge University Press, vol. 109(3), pages 427-449, August.
    12. Brosig Jeannette & Weimann Joachim, 2003. "The Effect of Communication Media on Cooperation," German Economic Review, De Gruyter, vol. 4(2), pages 217-241, May.
    13. Czura, Kristina, 2015. "Pay, peek, punish? Repayment, information acquisition and punishment in a microcredit lab-in-the-field experiment," Journal of Development Economics, Elsevier, vol. 117(C), pages 119-133.
    14. Crawford, Vincent, 1998. "A Survey of Experiments on Communication via Cheap Talk," Journal of Economic Theory, Elsevier, vol. 78(2), pages 286-298, February.
    15. Arechar, Antonio A. & Dreber, Anna & Fudenberg, Drew & Rand, David G., 2017. "“I'm just a soul whose intentions are good”: The role of communication in noisy repeated games," Games and Economic Behavior, Elsevier, vol. 104(C), pages 726-743.
    16. Isaac, R Mark & Walker, James M, 1988. "Communication and Free-Riding Behavior: The Voluntary Contribution Mechanism," Economic Inquiry, Western Economic Association International, vol. 26(4), pages 585-608, October.
    17. Bochet, Olivier & Putterman, Louis, 2009. "Not just babble: Opening the black box of communication in a voluntary contribution experiment," European Economic Review, Elsevier, vol. 53(3), pages 309-326, April.
    18. Bednar, Jenna & Chen, Yan & Liu, Tracy Xiao & Page, Scott, 2012. "Behavioral spillovers and cognitive load in multiple games: An experimental study," Games and Economic Behavior, Elsevier, vol. 74(1), pages 12-31.
    19. Guido W. Imbens, 2015. "Matching Methods in Practice: Three Examples," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 373-419.
    20. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    21. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    22. Vincent Somville & Lore Vandewalle, 2018. "Saving by Default: Evidence from a Field Experiment in Rural India," American Economic Journal: Applied Economics, American Economic Association, vol. 10(3), pages 39-66, July.
    23. Michal Bauer & Nathan Fiala & Ian Levely, 2018. "Trusting Former Rebels: An Experimental Approach to Understanding Reintegration after Civil War," Economic Journal, Royal Economic Society, vol. 128(613), pages 1786-1819, August.
    24. Viceisza, Angelino C.G., 2012. "Treating the field as a lab: A basic guide to conducting economics," Food security in practice technical guide series 7, International Food Policy Research Institute (IFPRI).
    25. Arun G. Chandrasekhar & Cynthia Kinnan & Horacio Larreguy, 2018. "Social Networks as Contract Enforcement: Evidence from a Lab Experiment in the Field," American Economic Journal: Applied Economics, American Economic Association, vol. 10(4), pages 43-78, October.
    26. Ananish Chaudhuri, 2011. "Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature," Experimental Economics, Springer;Economic Science Association, vol. 14(1), pages 47-83, March.
    27. David Sally, 1995. "Conversation and Cooperation in Social Dilemmas," Rationality and Society, , vol. 7(1), pages 58-92, January.
    28. Enos, Ryan D. & Gidron, Noam, 2018. "Exclusion and Cooperation in Diverse Societies: Experimental Evidence from Israel," American Political Science Review, Cambridge University Press, vol. 112(4), pages 742-757, November.
    29. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, January.
    30. Andrew Schotter, 2005. "Decision Making with Naïve Advice," Springer Books, in: Amnon Rapoport & Rami Zwick (ed.), Experimental Business Research, chapter 0, pages 223-248, Springer.
    31. Ben D'Exelle & Arjan Verschoor, 2015. "Investment Behaviour, Risk Sharing and Social Distance," Economic Journal, Royal Economic Society, vol. 0(584), pages 777-802, May.
    32. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    33. Michael Kosfeld & Devesh Rustagi, 2015. "Leader Punishment and Cooperation in Groups: Experimental Field Evidence from Commons Management in Ethiopia," American Economic Review, American Economic Association, vol. 105(2), pages 747-783, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fortuna Casoria & Arno Riedl & Peter Werner, 2020. "Behavioral Aspects of Communication in Organizations," Post-Print halshs-03024050, HAL.
    2. Feltovich, Nick & Grossman, Philip J., 2015. "How does the effect of pre-play suggestions vary with group size? Experimental evidence from a threshold public-good game," European Economic Review, Elsevier, vol. 79(C), pages 263-280.
    3. David M. McEvoy & Tobias Haller & Esther Blanco, 2022. "The Role of Non-Binding Pledges in Social Dilemmas with Mitigation and Adaptation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 81(4), pages 685-710, April.
    4. Bazart, Cécile & Lefebvre, Mathieu & Rosaz, Julie, 2022. "Promoting socially desirable behaviors through persuasion and commitment: Experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    5. Handberg, Øyvind Nystad & Angelsen, Arild, 2015. "Experimental tests of tropical forest conservation measures," Journal of Economic Behavior & Organization, Elsevier, vol. 118(C), pages 346-359.
    6. Koukoumelis, Anastasios & Levati, M. Vittoria & Weisser, Johannes, 2012. "Leading by words: A voluntary contribution experiment with one-way communication," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 379-390.
    7. Koessler, Ann-Kathrin, 2022. "Pledges and how social influence shapes their effectiveness," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    8. Barron, Kai & Nurminen, Tuomas, 2020. "Nudging cooperation in public goods provision," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 88, pages 1-1.
    9. Barron, Kai & Nurminen, Tuomas, 2018. "Nudging cooperation," Discussion Papers, Research Unit: Economics of Change SP II 2018-305, WZB Berlin Social Science Center.
    10. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    11. Therese Lindahl & Anne-Sophie Crépin & Caroline Schill, 2016. "Potential Disasters can Turn the Tragedy into Success," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(3), pages 657-676, November.
    12. Caleb A. Cox & Brock Stoddard, 2021. "Common-Value Public Goods and Informational Social Dilemmas," American Economic Journal: Microeconomics, American Economic Association, vol. 13(2), pages 343-369, May.
    13. Zakaria Babutsidze & Nobuyuki Hanaki & Adam Zylbersztejn, 2021. "Nonverbal content and trust: An experiment on digital communication," Economic Inquiry, Western Economic Association International, vol. 59(4), pages 1517-1532, October.
    14. Fehr, Dietmar & Sutter, Matthias, 2019. "Gossip and the efficiency of interactions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 448-460.
    15. Michalis Drouvelis & Brit Grosskopf, 2021. "The impact of smiling cues on social cooperation," Southern Economic Journal, John Wiley & Sons, vol. 87(4), pages 1390-1404, April.
    16. Dannenberg,Astrid & Martinsson,Peter, 2015. "The effect of nonbinding agreements on cooperation among forest user groups in Nepal and Ethiopia," Policy Research Working Paper Series 7325, The World Bank.
    17. Martinsson, Peter & Medhin, Haileselassie & Persson, Emil, 2016. "Framing and Minimum Levels in Public Good Provision," Working Papers in Economics 656, University of Gothenburg, Department of Economics.
    18. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    19. Fluet, Claude & Galbiati, Rpbertp, 2016. "Lois et normes : les enseignements de l'économie comportementale," L'Actualité Economique, Société Canadienne de Science Economique, vol. 92(1-2), pages 191-215, Mars-Juin.
    20. Beekman, Gonne & Bulte, Erwin & Nillesen, Eleonora, 2014. "Corruption, investments and contributions to public goods: Experimental evidence from rural Liberia," Journal of Public Economics, Elsevier, vol. 115(C), pages 37-47.

    More about this item

    Keywords

    Lab-in-the-field; Public goods games; Field experiments; Development; Rwanda; Communication; Spillovers; SUTVA; Social learning;
    All these keywords.

    JEL classification:

    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • H41 - Public Economics - - Publicly Provided Goods - - - Public Goods
    • O10 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - General
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:157:y:2022:i:c:s0304387822000232. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.