IDEAS home Printed from https://ideas.repec.org/p/cge/wacage/701.html
   My bibliography  Save this paper

The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG

Author

Listed:
  • Jiménez Durán, Rafael

    (Universit`a Bocconi, Department of Economics, IGIER, Stigler Center)

  • Muller, Karsten

    (National University of Singapore, Department of Finance)

  • Schwarz, Carlo

    (Universit`a Bocconi, Department of Economics, IGIER, PERICLES, CEPR, CAGE)

Abstract

We study the online and offline effects of content moderation on social media using the introduction of Germany’s Network Enforcement Act (NetzDG), which fines social media platforms failing to remove hateful posts. We show that the law transformed social media discourse: posts became less hateful, refugee-related content less inflammatory, and the use of moderated platforms increased. The NetzDG also had offline effects by reducing anti-refugee hate crimes by 1% for every standard deviation in exposure to far-right social media use. The law reduced hate crimes partly by making it harder for perpetrators to coordinate, without changing attitudes towards refugees.

Suggested Citation

  • Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    • Handle: RePEc:cge:wacage:701
    as

    Download full text from publisher

    File URL: https://warwick.ac.uk/fac/soc/economics/research/centres/cage/manage/publications/wp701.2024.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stefano Della Vigna & Ruben Enikolopov & Vera Mironova & Maria Petrova & Ekaterina Zhuravskaya, 2014. "Cross-Border Media and Nationalism: Evidence from Serbian Radio in Croatia," American Economic Journal: Applied Economics, American Economic Association, vol. 6(3), pages 103-132, July.
    2. Cao, Andy & Lindo, Jason M. & Zhong, Jiee, 2023. "Can social media rhetoric incite hate incidents? Evidence from Trump's “Chinese Virus” tweets," Journal of Urban Economics, Elsevier, vol. 137(C).
    3. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    4. Leopoldo Fergusson & Carlos Molina, 2020. "Facebook Causes Protests," HiCN Working Papers 323, Households in Conflict Network.
    5. Stephen Hansen & Michael McMahon & Andrea Prat, 2018. "Transparency and Deliberation Within the FOMC: A Computational Linguistics Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 801-870.
    6. Manudeep Bhuller & Tarjei Havnes & Edwin Leuven & Magne Mogstad, 2013. "Broadband Internet: An Information Superhighway to Sex Crime?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(4), pages 1237-1266.
    7. Marco Manacorda & Andrea Tesei, 2020. "Liberation Technology: Mobile Phones and Political Mobilization in Africa," Econometrica, Econometric Society, vol. 88(2), pages 533-567, March.
    8. Ruben Enikolopov & Maria Petrova & Konstantin Sonin, 2018. "Social Media and Corruption," American Economic Journal: Applied Economics, American Economic Association, vol. 10(1), pages 150-174, January.
    9. Luca Braghieri & Ro'ee Levy & Alexey Makarin, 2022. "Social Media and Mental Health," American Economic Review, American Economic Association, vol. 112(11), pages 3660-3693, November.
    10. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," American Economic Journal: Economic Policy, American Economic Association, vol. 14(3), pages 55-86, August.
    11. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    12. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," NBER Working Papers 23089, National Bureau of Economic Research, Inc.
    13. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    14. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," PSE-Ecole d'économie de Paris (Postprint) halshs-03342759, HAL.
    15. Jason J Jones & Robert M Bond & Eytan Bakshy & Dean Eckles & James H Fowler, 2017. "Social influence and political mobilization: Further evidence from a randomized experiment in the 2012 U.S. presidential election," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-9, April.
    16. David Card & Gordon B. Dahl, 2011. "Family Violence and Football: The Effect of Unexpected Emotional Cues on Violent Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 103-143.
    17. Karsten Müller & Carlo Schwarz, 2021. "Fanning the Flames of Hate: Social Media and Hate Crime [Radio and the Rise of The Nazis in Prewar Germany]," Journal of the European Economic Association, European Economic Association, vol. 19(4), pages 2131-2167.
    18. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," Post-Print halshs-03342759, HAL.
    19. Gorwa, Robert, 2019. "The platform governance triangle: conceptualising the informal regulation of online content," SocArXiv tgnrj, Center for Open Science.
    20. Clément de Chaisemartin & Xavier D’Haultfœuille, 2023. "Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: a survey," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 1-30.
    21. Angela Ambrosino & Mario Cedrini & John B. Davis & Stefano Fiori & Marco Guerzoni & Massimiliano Nuccio, 2018. "What topic modeling could reveal about the evolution of economics," Journal of Economic Methodology, Taylor & Francis Journals, vol. 25(4), pages 329-348, October.
    22. Yi Liu & Pinar Yildirim & Z. John Zhang, 2021. "Social Media, Content Moderation, and Technology," Papers 2101.04618, arXiv.org, revised Jan 2021.
    23. Ruben Enikolopov & Alexey Makarin & Maria Petrova, 2020. "Social Media and Protest Participation: Evidence From Russia," Econometrica, Econometric Society, vol. 88(4), pages 1479-1514, July.
    24. Roberto Mosquera & Mofioluwasademi Odunowo & Trent McNamara & Xiongfei Guo & Ragan Petrie, 2020. "The economic effects of Facebook," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 575-602, June.
    25. Bei Qin & David Strömberg & Yanhui Wu, 2017. "Why Does China Allow Freer Social Media? Protests versus Surveillance and Propaganda," Journal of Economic Perspectives, American Economic Association, vol. 31(1), pages 117-140, Winter.
    26. Christopher Rauh & Laëtitia Renée, 2023. "How to measure parenting styles?," Review of Economics of the Household, Springer, vol. 21(3), pages 1063-1081, September.
    27. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    28. Karsten Müller & Carlo Schwarz, 2023. "From Hashtag to Hate Crime: Twitter and Antiminority Sentiment," American Economic Journal: Applied Economics, American Economic Association, vol. 15(3), pages 270-312, July.
    29. Gordon Dahl & Stefano DellaVigna, 2009. "Does Movie Violence Increase Violent Crime?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(2), pages 677-734.
    30. Andreas Olden & Jarle Møen, 2022. "The triple difference estimator [Semiparametric difference-in-differences estimators]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 531-553.
    31. Gorwa, Robert, 2019. "The platform governance triangle: conceptualising the informal regulation of online content," Internet Policy Review: Journal on Internet Regulation, Alexander von Humboldt Institute for Internet and Society (HIIG), Berlin, vol. 8(2), pages 1-22.
    32. Andres, Raphaela & Slivko, Olga, 2021. "Combating online hate speech: The impact of legislation on Twitter," ZEW Discussion Papers 21-103, ZEW - Leibniz Centre for European Economic Research.
    33. David Yanagizawa-Drott, 2014. "Propaganda and Conflict: Evidence from the Rwandan Genocide," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1947-1994.
    34. Xinming Du, 2023. "Symptom or Culprit? Social Media, Air Pollution, and Violence," CESifo Working Paper Series 10296, CESifo.
    35. Milena Djourelova, 2023. "Persuasion through Slanted Language: Evidence from the Media Coverage of Immigration," American Economic Review, American Economic Association, vol. 113(3), pages 800-835, March.
    36. Yuyu Chen & David Y. Yang, 2019. "The Impact of Media Censorship: 1984 or Brave New World?," American Economic Review, American Economic Association, vol. 109(6), pages 2294-2332, June.
    37. Leonardo Bursztyn & Georgy Egorov & Stefano Fiorin, 2020. "From Extreme to Mainstream: The Erosion of Social Norms," American Economic Review, American Economic Association, vol. 110(11), pages 3522-3548, November.
    38. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    39. Ro'ee Levy, 2021. "Social Media, News Consumption, and Polarization: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 111(3), pages 831-870, March.
    40. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 211-236, Spring.
    41. Carlo Schwarz, 2023. "Estimating text regressions using txtreg_train," Stata Journal, StataCorp LP, vol. 23(3), pages 799-812, September.
    42. repec:hal:pseose:halshs-01053370 is not listed on IDEAS
    43. Robert M. Bond & Christopher J. Fariss & Jason J. Jones & Adam D. I. Kramer & Cameron Marlow & Jaime E. Settle & James H. Fowler, 2012. "A 61-million-person experiment in social influence and political mobilization," Nature, Nature, vol. 489(7415), pages 295-298, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    2. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024. "The Effect of Social Media on Elections: Evidence from The United States," Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
    3. Leonardo Bursztyn & Georgy Egorov & Ruben Enikolopov & Maria Petrova, 2019. "Social Media and Xenophobia: Evidence from Russia," NBER Working Papers 26567, National Bureau of Economic Research, Inc.
    4. Cariolle, Joël & Elkhateeb, Yasmine & Maurel, Mathilde, 2024. "Misinformation technology: Internet use and political misperceptions in Africa," Journal of Comparative Economics, Elsevier, vol. 52(2), pages 400-433.
    5. Ekaterina Zhuravskaya & Maria Petrova & Ruben Enikolopov, 2020. "Political Effects of the Internet and Social Media," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 415-438, August.
    6. Aridor, Guy & Jiménez-Durán, Rafael & Levy, Ro'ee & Song, Lena, 2024. "The Economics of Social Media," CEPR Discussion Papers 18821, C.E.P.R. Discussion Papers.
    7. Geraci, Andrea & Nardotto, Mattia & Reggiani, Tommaso & Sabatini, Fabio, 2022. "Broadband Internet and social capital," Journal of Public Economics, Elsevier, vol. 206(C).
    8. Joël Cariolle & Yasmine Elkhateeb & Mathilde Maurel, 2022. "(Mis-)information technology: Internet use and perception of democracy in Africa," Documents de travail du Centre d'Economie de la Sorbonne 22010, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    9. Tähtinen, Tuuli, 2024. "When Facebook Is the Internet: The Role of Social Media in Ethnic Conflict," World Development, Elsevier, vol. 180(C).
    10. Donati, Dante, 2023. "Mobile Internet access and political outcomes: Evidence from South Africa," Journal of Development Economics, Elsevier, vol. 162(C).
    11. von Essen, Emma & Jansson, Joakim, 2020. "Misogynistic and Xenophobic Hate Language Online: A Matter of Anonymity," Working Paper Series 1350, Research Institute of Industrial Economics.
    12. Ruben Enikolopov & Maria Petrova & Gianluca Russo & David Yanagizawa-Drott, 2024. "Socializing Alone: How Online Homophily Has Underminded Social Cohesion in the US," CESifo Working Paper Series 11375, CESifo.
    13. Sabatini, Fabio, 2023. "The Behavioral, Economic, and Political Impact of the Internet and Social Media: Empirical Challenges and Approaches," IZA Discussion Papers 16703, Institute of Labor Economics (IZA).
    14. Karsten Müller & Carlo Schwarz, 2021. "Fanning the Flames of Hate: Social Media and Hate Crime [Radio and the Rise of The Nazis in Prewar Germany]," Journal of the European Economic Association, European Economic Association, vol. 19(4), pages 2131-2167.
    15. Ruben Enikolopov & Alexey Makarin & Maria Petrova, 2020. "Social Media and Protest Participation: Evidence From Russia," Econometrica, Econometric Society, vol. 88(4), pages 1479-1514, July.
    16. Gisli Gylfason, 2023. "From Tweets to the Streets: Twitter and Extremist Protests in the United States," PSE Working Papers halshs-04188189, HAL.
    17. Boyer, Pierre & Delemotte, Thomas & Gauthier, Germain & Rollet, Vincent & Schmutz, Benoit, 2020. "The Gilets jaunes: Offline and Online," CEPR Discussion Papers 14780, C.E.P.R. Discussion Papers.
    18. Pierre C. Boyer & Thomas Delemotte & Germain Gauthier & Vincent Rollet & Benoît Schmutz, 2020. "Social Media and the Dynamics of Protests," CESifo Working Paper Series 8326, CESifo.
    19. Leopoldo Fergusson & Carlos Molina, 2020. "Facebook Causes Protests," HiCN Working Papers 323, Households in Conflict Network.
    20. Ali, Ayesha & Qazi, Ihsan Ayyub, 2023. "Countering misinformation on social media through educational interventions: Evidence from a randomized experiment in Pakistan," Journal of Development Economics, Elsevier, vol. 163(C).

    More about this item

    Keywords

    Social Media; NetzDG; Content Moderation; Hate Crime; Refugees; Germany JEL Classification: L82; J15; O38;
    All these keywords.

    JEL classification:

    • L82 - Industrial Organization - - Industry Studies: Services - - - Entertainment; Media
    • J15 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Minorities, Races, Indigenous Peoples, and Immigrants; Non-labor Discrimination
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cge:wacage:701. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jane Snape (email available below). General contact details of provider: https://edirc.repec.org/data/dewaruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.