IDEAS home Printed from https://ideas.repec.org/p/feb/natura/00754.html
   My bibliography  Save this paper

The Economics of Content Moderation: Theory and Experimental Evidence from Hate Speech on Twitter

Author

Listed:
  • Rafael Jimenez-Duran

Abstract

Social media platforms ban users and remove posts to moderate their content. This "speech policing" remains controversial because little is known about its consequences and the costs and benefits for different individuals. I conduct two field experiments on Twitter to examine the effect of moderating hate speech on user behavior and welfare. Randomly reporting posts for violating the rules against hateful conduct increases the likelihood that Twitter removes them. Reporting does not affect the activity on the platform of the posts' authors or their likelihood of reposting hate, but it does increase the activity of those attacked by the posts. These results are consistent with a model in which content moderation is a quality decision for platforms that increases user engagement and hence advertising revenue. The second experiment shows that changing users' perceived content removal does not change their willingness to pause using social media, a measure of consumer surplus. My results imply that content moderation does not necessarily moderate users, but it marginally increases advertising revenue. It can be consistent with both profit- and welfare-maximization if out-of-platform externalities are small

Suggested Citation

  • Rafael Jimenez-Duran, 2021. "The Economics of Content Moderation: Theory and Experimental Evidence from Hate Speech on Twitter," Natural Field Experiments 00754, The Field Experiments Website.
  • Handle: RePEc:feb:natura:00754
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00754.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Leonardo Bursztyn & Ingar Haaland & Aakaash Rao & Christopher Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," Working Papers 2020-73, Becker Friedman Institute for Research In Economics.
    2. Steven Berry & Amit Gandhi & Philip Haile, 2013. "Connected Substitutes and Invertibility of Demand," Econometrica, Econometric Society, vol. 81(5), pages 2087-2111, September.
    3. Gary S. Becker & Kevin M. Murphy, 1993. "A Simple Theory of Advertising as a Good or Bad," The Quarterly Journal of Economics, Oxford University Press, vol. 108(4), pages 941-964.
    4. Leonardo Bursztyn & Georgy Egorov & Ruben Enikolopov & Maria Petrova, 2019. "Social Media and Xenophobia: Evidence from Russia," NBER Working Papers 26567, National Bureau of Economic Research, Inc.
    5. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    6. Hobbs, William R. & Roberts, Margaret E., 2018. "How Sudden Censorship Can Increase Access to Information," American Political Science Review, Cambridge University Press, vol. 112(3), pages 621-636, August.
    7. Leonardo Bursztyn & David Y. Yang, 2021. "Misperceptions about Others," NBER Working Papers 29168, National Bureau of Economic Research, Inc.
    8. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," Review of Economic Studies, Oxford University Press, vol. 81(2), pages 608-650.
    9. Matthew Gentzkow, 2007. "Valuing New Goods in a Model with Complementarity: Online Newspapers," American Economic Review, American Economic Association, vol. 97(3), pages 713-744, June.
    10. Haaland, Ingar & Roth, Christopher & Wohlfart. Johannes, 2020. "Designing Information Provision Experiments," The Warwick Economics Research Paper Series (TWERPS) 1275, University of Warwick, Department of Economics.
    11. Munger, Kevin, 2021. "Don’t @ Me: Experimentally Reducing Partisan Incivility on Twitter," Journal of Experimental Political Science, Cambridge University Press, vol. 8(2), pages 102-116, July.
    12. Hunt Allcott & Judd B. Kessler, 2019. "The Welfare Effects of Nudges: A Case Study of Energy Use Social Comparisons," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 236-276, January.
    13. E. Glen Weyl, 2010. "A Price Theory of Multi-sided Platforms," American Economic Review, American Economic Association, vol. 100(4), pages 1642-1672, September.
    14. Matthew Gentzkow & Bryan Kelly & Matt Taddy, 2019. "Text as Data," Journal of Economic Literature, American Economic Association, vol. 57(3), pages 535-574, September.
    15. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    16. Joao Correia‐da‐Silva & Bruno Jullien & Yassine Lefouili & Joana Pinho, 2019. "Horizontal mergers between multisided platforms: Insights from Cournot competition," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 28(1), pages 109-124, January.
    17. Ruben Enikolopov & Alexey Makarin & Maria Petrova, 2020. "Social Media and Protest Participation: Evidence From Russia," Econometrica, Econometric Society, vol. 88(4), pages 1479-1514, July.
    18. Roberto Mosquera & Mofioluwasademi Odunowo & Trent McNamara & Xiongfei Guo & Ragan Petrie, 2020. "The economic effects of Facebook," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 575-602, June.
    19. Siegel, Alexandra A. & Badaan, Vivienne, 2020. "#No2Sectarianism: Experimental Approaches to Reducing Sectarian Hate Speech Online," American Political Science Review, Cambridge University Press, vol. 114(3), pages 837-855, August.
    20. Leonardo Bursztyn & Alessandra L. González & David Yanagizawa-Drott, 2020. "Misperceived Social Norms: Women Working Outside the Home in Saudi Arabia," American Economic Review, American Economic Association, vol. 110(10), pages 2997-3029, October.
    21. Hunt Allcott & Luca Braghieri & Sarah Eichmeyer & Matthew Gentzkow, 2020. "The Welfare Effects of Social Media," American Economic Review, American Economic Association, vol. 110(3), pages 629-676, March.
    22. Amalia Álvarez & Fabian Winter, 2018. "Normative change and culture of hate: An experiment in online environments," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2018_03, Max Planck Institute for Research on Collective Goods.
    23. Guofu Tan & Junjie Zhou, 2021. "The Effects of Competition and Entry in Multi-sided Markets," Review of Economic Studies, Oxford University Press, vol. 88(2), pages 1002-1030.
    24. Yuyu Chen & David Y. Yang, 2019. "The Impact of Media Censorship: 1984 or Brave New World?," American Economic Review, American Economic Association, vol. 109(6), pages 2294-2332, June.
    25. Ro'ee Levy, 2021. "Social Media, News Consumption, and Polarization: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 111(3), pages 831-870, March.
    26. A. Michael Spence, 1975. "Monopoly, Quality, and Regulation," Bell Journal of Economics, The RAND Corporation, vol. 6(2), pages 417-429, Autumn.
    27. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, December.
    28. José Luis Montiel Olea & Mikkel Plagborg‐Møller, 2019. "Simultaneous confidence bands: Theory, implementation, and an application to SVARs," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(1), pages 1-17, January.
    29. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiménez-Durán, Rafael, 2022. "The economics of content moderation: Theory and experimental evidence from hate speech on Twitter," Working Papers 324, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    2. Luca Braghieri & Ro'ee Levy & Alexey Makarin, 2022. "Social Media and Mental Health," American Economic Review, American Economic Association, vol. 112(11), pages 3660-3693, November.
    3. Geraci, Andrea & Nardotto, Mattia & Reggiani, Tommaso & Sabatini, Fabio, 2022. "Broadband Internet and social capital," Journal of Public Economics, Elsevier, vol. 206(C).
    4. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    5. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    6. Ekaterina Zhuravskaya & Maria Petrova & Ruben Enikolopov, 2020. "Political Effects of the Internet and Social Media," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 415-438, August.
    7. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    8. Nicolás Ajzenman & Bruno Ferman & Pedro C. Sant’Anna, 2023. "Rooting for the Same Team: On the Interplay between Political and Social Identities in the Formation of Social Ties," Working Papers 231, Red Nacional de Investigadores en Economía (RedNIE).
    9. Eugen Dimant, 2020. "Hate Trumps Love: The Impact of Political Polarization on Social Preferences," ECONtribute Discussion Papers Series 029, University of Bonn and University of Cologne, Germany.
    10. Leonardo Bursztyn & Ingar Haaland & Aakaash Rao & Christopher Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," Working Papers 2020-73, Becker Friedman Institute for Research In Economics.
    11. Rabah Arezki & Simeon Djankov & Ha Nguyen & Ivan Yotzov, 2022. "The Political Costs of Oil Price Shocks," CESifo Working Paper Series 9763, CESifo.
    12. Beknazar-Yuzbashev, George & Stalinski, Mateusz, 2022. "Do social media ads matter for political behavior? A field experiment," Journal of Public Economics, Elsevier, vol. 214(C).
    13. Eugen Dimant & Tobias Gesche, 2021. "Nudging Enforcers: How Norm Perceptions and Motives for Lying Shape Sanctions," CESifo Working Paper Series 9385, CESifo.
    14. Artís, Annalí Casanueva & Avetian, Vladimir & Sardoschau, Sulin & Saxena, Kavya, 2022. "Social Media and the Broadening of Social Movements: Evidence from Black Lives Matter," IZA Discussion Papers 15812, Institute of Labor Economics (IZA).
    15. Francesco Capozza & Ingar K. Haaland & Christopher Roth & Johannes Wohlfart, 2022. "Recent Advances in Studies of News Consumption," CESifo Working Paper Series 10021, CESifo.
    16. Ro'ee Levy, 2021. "Social Media, News Consumption, and Polarization: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 111(3), pages 831-870, March.
    17. Susan Athey & Guido W. Imbens & Stefan Wager, 2018. "Approximate residual balancing: debiased inference of average treatment effects in high dimensions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(4), pages 597-623, September.
    18. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2022. "Recent Advances in Studies of News Consumption," ECONtribute Discussion Papers Series 204, University of Bonn and University of Cologne, Germany.
    19. M. Amelia Gibbons & Martín A. Rossi, 2021. "When You Can'T Tube… Impact Of A Major Youtube Outage On Rapes," Economic Inquiry, Western Economic Association International, vol. 59(2), pages 762-775, April.
    20. Assenza, Tiziana, 2021. "The Ability to 'Distill the Truth'," TSE Working Papers 21-1280, Toulouse School of Economics (TSE), revised Mar 2022.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:natura:00754. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.fieldexperiments.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: David Franks (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.