IDEAS home Printed from https://ideas.repec.org/a/bla/jorssa/v183y2020i3p1075-1096.html
   My bibliography  Save this article

A placebo design to detect spillovers from an education–entertainment experiment in Uganda

Author

Listed:
  • Anna M. Wilke
  • Donald P. Green
  • Jasper Cooper

Abstract

Education–entertainment refers to dramatizations designed to convey information and to change attitudes. Buoyed by observational studies suggesting that education–entertainment strongly influences beliefs, attitudes and behaviours, scholars have recently assessed education–entertainment by using rigorous experimental designs in field settings. Studies conducted in developing countries have repeatedly shown the effectiveness of radio and film dramatizations on outcomes ranging from health to group conflict. One important gap in the literature is estimation of social spillover effects from those exposed to the dramatizations to others in the audience members’ social network. In theory, the social diffusion of media effects could greatly amplify their policy impact. The current study uses a novel placebo‐controlled design that gauges both the direct effects of the treatment on audience members as well as the indirect effects of the treatment on others in their family and in the community. We implement this design in two large cluster‐randomized experiments set in rural Uganda using video dramatizations on the topics of violence against women, teacher absenteeism and abortion stigma. We find several instances of sizable and highly significant direct effects on the attitudes of audience members, but we find little evidence that these effects diffused to others in the villages where the videos were aired.

Suggested Citation

  • Anna M. Wilke & Donald P. Green & Jasper Cooper, 2020. "A placebo design to detect spillovers from an education–entertainment experiment in Uganda," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1075-1096, June.
  • Handle: RePEc:bla:jorssa:v:183:y:2020:i:3:p:1075-1096
    DOI: 10.1111/rssa.12571
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/rssa.12571
    Download Restriction: no

    File URL: https://libkey.io/10.1111/rssa.12571?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abhijit Banerjee & Sharon Barnhardt & Esther Duflo, 2015. "Movies, Margins, and Marketing: Encouraging the Adoption of Iron-Fortified Salt," NBER Chapters, in: Insights in the Economics of Aging, pages 285-306, National Bureau of Economic Research, Inc.
    2. Benjamin-Chung, Jade & Arnold, Benjamin F & Berger, David & Luby, Stephen P & Miguel, Edward & Colford, John M & Hubbard, Alan E, 2018. "Spillover effects in epidemiology: parameters, study designs and methodological considerations," Department of Economics, Working Paper Series qt1547q2zg, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    3. Brian L. Egleston & Daniel O. Scharfstein & Ellen MacKenzie, 2009. "On Estimation of the Survivor Average Causal Effect in Observational Studies When Important Confounders Are Missing Due to Death," Biometrics, The International Biometric Society, vol. 65(2), pages 497-504, June.
    4. Arthur Alik‐Lagrange & Martin Ravallion, 2019. "Estimating within‐cluster spillover effects using a cluster randomization with application to knowledge diffusion in rural India," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(1), pages 110-128, January.
    5. Paluck, Elizabeth Levy & Green, Donald P., 2009. "Deference, Dissent, and Dispute Resolution: An Experimental Intervention Using Mass Media to Change Norms and Behavior in Rwanda," American Political Science Review, Cambridge University Press, vol. 103(4), pages 622-644, November.
    6. Guido W. Imbens & Michal Kolesár, 2016. "Robust Standard Errors in Small Samples: Some Practical Advice," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 701-712, October.
    7. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    8. Eliana La Ferrara & Alberto Chong & Suzanne Duryea, 2012. "Soap Operas and Fertility: Evidence from Brazil," American Economic Journal: Applied Economics, American Economic Association, vol. 4(4), pages 1-31, October.
    9. Jason Fletcher & Ryne Marksteiner, 2017. "Causal Spousal Health Spillover Effects and Implications for Program Evaluation," American Economic Journal: Economic Policy, American Economic Association, vol. 9(4), pages 144-166, November.
    10. Constantine E. Frangakis & Donald B. Rubin & Ming-Wen An & Ellen MacKenzie, 2007. "Principal Stratification Designs to Estimate Input Data Missing Due to Death," Biometrics, The International Biometric Society, vol. 63(3), pages 641-649, September.
    11. Ricardo Perez-Truglia & Guillermo Cruces, 2017. "Partisan Interactions: Evidence from a Field Experiment in the United States," Journal of Political Economy, University of Chicago Press, vol. 125(4), pages 1208-1243.
    12. Felipe Barrera-Osorio & Marianne Bertrand & Leigh L. Linden & Francisco Perez-Calle, 2011. "Improving the Design of Conditional Transfer Programs: Evidence from a Randomized Education Experiment in Colombia," American Economic Journal: Applied Economics, American Economic Association, vol. 3(2), pages 167-195, April.
    13. World Bank, 2016. "World Development Indicators 2016," World Bank Publications - Books, The World Bank Group, number 23969, April.
    14. Betsy Sinclair & Margaret McConnell & Donald P. Green, 2012. "Detecting Spillover Effects: Design and Analysis of Multilevel Experiments," American Journal of Political Science, John Wiley & Sons, vol. 56(4), pages 1055-1069, October.
    15. Gerber, Alan S. & Green, Donald P. & Kaplan, Edward H. & Kern, Holger L., 2010. "Baseline, Placebo, and Treatment: Efficient Estimation for Three-Group Experiments," Political Analysis, Cambridge University Press, vol. 18(3), pages 297-315, July.
    16. David A. Wise, 2017. "Insights in the Economics of Aging," NBER Books, National Bureau of Economic Research, Inc, number wise-21, March.
    17. Galiani, Sebastian & Gertler, Paul & Orsola-Vidal, Alexandra, 2012. "Promoting handwashing behavior in Peru : the effect of large-scale mass-media and community level interventions," Policy Research Working Paper Series 6257, The World Bank.
    18. Nickerson, David W., 2008. "Is Voting Contagious? Evidence from Two Field Experiments," American Political Science Review, Cambridge University Press, vol. 102(1), pages 49-57, February.
    19. Kalla, Joshua L. & Broockman, David E., 2018. "The Minimal Persuasive Effects of Campaign Contact in General Elections: Evidence from 49 Field Experiments," American Political Science Review, Cambridge University Press, vol. 112(1), pages 148-166, February.
    20. Jack Cuzick & Peter Sasieni & Jonathan Myles & Jonathan Tyrer, 2007. "Estimating the effect of treatment in a proportional hazards model in the presence of non‐compliance and contamination," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 565-588, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. VanderWeele Tyler J, 2011. "Principal Stratification -- Uses and Limitations," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-14, July.
    2. Grady, Christopher & Iannantuoni, Alice & Winters, Matthew S., 2021. "Influencing the means but not the ends: The role of entertainment-education interventions in development," World Development, Elsevier, vol. 138(C).
    3. Kosuke Imai & Zhichao Jiang, 2020. "Identification and sensitivity analysis of contagion effects in randomized placebo‐controlled trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1637-1657, October.
    4. Alex Armand & Paul Atwell & Joseph F. Gomes & Yannik Schenk, 2023. "It’s a Bird, it’s a Plane, it’s Superman! Using Mass Media to fight Intolerance," LIDAM Discussion Papers IRES 2023012, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    5. Florian Foos & Eline A. de Rooij, 2017. "All in the Family: Partisan Disagreement and Electoral Mobilization in Intimate Networks—A Spillover Experiment," American Journal of Political Science, John Wiley & Sons, vol. 61(2), pages 289-304, April.
    6. Kjetil Bjorvatn & Alexander W. Cappelen & Linda Helgesson Sekei & Erik Ø. Sørensen & Bertil Tungodden, 2020. "Teaching Through Television: Experimental Evidence on Entrepreneurship Education in Tanzania," Management Science, INFORMS, vol. 66(6), pages 2308-2325, June.
    7. Leonardo Lucchetti & Renos Vakis & Jamele Rigolini, 2016. "Left Behind [Los olvidados : pobreza crónica en América Latina y el Caribe - resumen ejecutivo]," World Bank Publications - Books, The World Bank Group, number 21552, April.
    8. Yi He & Linzhi Zheng & Peng Luo, 2023. "Treatment Benefit and Treatment Harm Rates with Nonignorable Missing Covariate, Endpoint, or Treatment," Mathematics, MDPI, vol. 11(21), pages 1-18, October.
    9. Santiago Acerenza & Julian Martinez-Iriarte & Alejandro S'anchez-Becerra & Pietro Emilio Spini, 2025. "Bounds for within-household encouragement designs with interference," Papers 2503.14314, arXiv.org.
    10. Alberto Chong & Gianmarco León‐Ciliotta & Vivian Roza & Martín Valdivia & Gabriela Vega, 2019. "Urbanization Patterns, Information Diffusion, and Female Voting in Rural Paraguay," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 323-341, April.
    11. LeRoux Kelly & Langer Julie & Plotner Samantha, 2023. "Nonprofit Messaging and the 2020 Election: Findings from a Nonpartisan Get-Out-The-Vote (GOTV) Field Experiment," Nonprofit Policy Forum, De Gruyter, vol. 14(2), pages 157-183, April.
    12. Daniel Kling & Thomas Stratmann, 2016. "The Efficacy of Political Advertising: A Voter Participation Field Experiment with Multiple Robo Calls and Controls for Selection Effects," CESifo Working Paper Series 6195, CESifo.
    13. Legge, Stefan & Schmid, Lukas, 2016. "Media attention and betting markets," European Economic Review, Elsevier, vol. 87(C), pages 304-333.
    14. Maria Josefsson & Michael J. Daniels, 2021. "Bayesian semi‐parametric G‐computation for causal inference in a cohort study with MNAR dropout and death," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(2), pages 398-414, March.
    15. Renard Sexton, 2020. "Unpacking the Local Resource Curse: How Externalities and Governance Shape Social Conflict," Journal of Conflict Resolution, Peace Science Society (International), vol. 64(4), pages 640-673, April.
    16. Eliana La Ferrara, 2016. "Mass Media And Social Change: Can We Use Television To Fight Poverty?," Journal of the European Economic Association, European Economic Association, vol. 14(4), pages 791-827, August.
    17. Nikolaj Harmon & Raymond Fisman & Emir Kamenica, 2019. "Peer Effects in Legislative Voting," American Economic Journal: Applied Economics, American Economic Association, vol. 11(4), pages 156-180, October.
    18. Abhijit Banerjee & Sharon Barnhardt & Esther Duflo, 2015. "Movies, Margins, and Marketing: Encouraging the Adoption of Iron-Fortified Salt," NBER Chapters, in: Insights in the Economics of Aging, pages 285-306, National Bureau of Economic Research, Inc.
    19. Elisa Macchi, 2022. "Worth your weight: experimental evidence on the benefits of obesity in low-income countries," ECON - Working Papers 401, Department of Economics - University of Zurich.
    20. Leonardo Bursztyn & Ingar K. Haaland & Aakaash Rao & Christopher P. Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," NBER Working Papers 27288, National Bureau of Economic Research, Inc.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:jorssa:v:183:y:2020:i:3:p:1075-1096. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/rssssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.