IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_12008.html
   My bibliography  Save this paper

Spiral of Silence: Polarizing Content Creation through Moderating Toxicity

Author

Listed:
  • Ying Bao
  • Jessie Liu

Abstract

This paper investigates how content moderation affects content creation in an ideologically diverse online environments. We develop a model in which users act as both creators and consumers, differing in their ideological affiliation and propensity to produce toxic content. Affective polarization - users’ aversion to ideologically opposed content - interacts with moderation in unintended ways. Even ideologically neutral moderation that targets only toxicity can suppress non-toxic content creation, particularly from ideological minorities. Our analysis reveals a content-level externality: when toxic content is removed, non-toxic posts gain exposure. While majority-group creators sometimes benefit from this exposure, they do not internalize the negative spillovers, i.e., increased out-group hostility toward minority creators. This discourages minority expression and polarizes the content supply, ultimately leaving minority users in a more ideologically imbalanced environment: a mechanism reminiscent of the “spiral of silence.” Modeling creation as a strategic response to moderation, we underscore the importance of eliciting whether user engagement reflects toxicity or ideological disagreement in guiding platform governance.

Suggested Citation

  • Ying Bao & Jessie Liu, 2025. "Spiral of Silence: Polarizing Content Creation through Moderating Toxicity," CESifo Working Paper Series 12008, CESifo.
  • Handle: RePEc:ces:ceswps:_12008
    as

    Download full text from publisher

    File URL: https://www.ifo.de/DocDL/cesifo1_wp12008.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Grossman, Sanford J & Stiglitz, Joseph E, 1980. "On the Impossibility of Informationally Efficient Markets," American Economic Review, American Economic Association, vol. 70(3), pages 393-408, June.
    2. Andres, Raphaela & Slivko, Olga, 2021. "Combating online hate speech: The impact of legislation on Twitter," ZEW Discussion Papers 21-103, ZEW - Leibniz Centre for European Economic Research.
    3. R. H. Coase, 2013. "The Problem of Social Cost," Journal of Law and Economics, University of Chicago Press, vol. 56(4), pages 837-877.
    4. Yi Liu & Pinar Yildirim & Z. John Zhang, 2022. "Implications of Revenue Models and Technology for Content Moderation Strategies," Marketing Science, INFORMS, vol. 41(4), pages 831-847, July.
    5. Karsten Müller & Carlo Schwarz, 2021. "Fanning the Flames of Hate: Social Media and Hate Crime [Radio and the Rise of The Nazis in Prewar Germany]," Journal of the European Economic Association, European Economic Association, vol. 19(4), pages 2131-2167.
    6. Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    7. Olivier Toubia & Andrew T. Stephen, 2013. "Intrinsic vs. Image-Related Utility in Social Media: Why Do People Contribute Content to Twitter?," Marketing Science, INFORMS, vol. 32(3), pages 368-392, May.
    8. Karsten Müller & Carlo Schwarz, 2023. "From Hashtag to Hate Crime: Twitter and Antiminority Sentiment," American Economic Journal: Applied Economics, American Economic Association, vol. 15(3), pages 270-312, July.
    9. Jūra Liaukonytė & Anna Tuchman & Xinrong Zhu, 2023. "Frontiers: Spilling the Beans on Political Consumerism: Do Social Media Boycotts and Buycotts Translate to Real Sales Impact?," Marketing Science, INFORMS, vol. 42(1), pages 11-25, January.
    10. Ro'ee Levy, 2021. "Social Media, News Consumption, and Polarization: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 111(3), pages 831-870, March.
    11. Yphtach Lelkes & Gaurav Sood & Shanto Iyengar, 2017. "The Hostile Audience: The Effect of Access to Broadband Internet on Partisan Affect," American Journal of Political Science, John Wiley & Sons, vol. 61(1), pages 5-20, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    2. Battisti, Michele & Kauppinen, Ilpo & Rude, Britta, 2024. "Breaking the silence: The effects of online social movements on gender-based violence," European Journal of Political Economy, Elsevier, vol. 85(C).
    3. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    4. Michael McRae, 2025. "Vertical Governance of Online Speech: Evidence from Google's Moderation Mandate," Trinity Economics Papers tep1425, Trinity College Dublin, Department of Economics.
    5. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024. "The Effect of Social Media on Elections: Evidence from The United States," Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
    6. Gisli Gylfason, 2023. "From Tweets to the Streets: Twitter and Extremist Protests in the United States," PSE Working Papers halshs-04188189, HAL.
    7. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    8. Garz, Marcel & Sörensen, Jil & Stone, Daniel F., 2020. "Partisan selective engagement: Evidence from Facebook," Journal of Economic Behavior & Organization, Elsevier, vol. 177(C), pages 91-108.
    9. Felix Chopra & Ingar Haaland & Fabian Roeben & Christopher Roth & Vanessa Sticher, 2025. "News Customization with AI," ECONtribute Discussion Papers Series 372, University of Bonn and University of Cologne, Germany.
    10. Maurizio Pugno, 2024. "Social media effects on well‐being: The hypothesis of addiction of a new variety," Kyklos, Wiley Blackwell, vol. 77(3), pages 690-704, August.
    11. Tähtinen, Tuuli, 2024. "When Facebook Is the Internet: The Role of Social Media in Ethnic Conflict," World Development, Elsevier, vol. 180(C).
    12. Alberto Alesina & Marco Tabellini, 2024. "The Political Effects of Immigration: Culture or Economics?," Journal of Economic Literature, American Economic Association, vol. 62(1), pages 5-46, March.
    13. Beknazar-Yuzbashev, George & Jiménez Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic content and user engagement on social media: Evidence from a field experiment," Working Papers 359, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    14. Baudry, Marc & Faure, Anouk & Quemin, Simon, 2021. "Emissions trading with transaction costs," Journal of Environmental Economics and Management, Elsevier, vol. 108(C).
    15. Giuberti Coutinho, Lorena, 2021. "Political polarization and the impact of internet and social media use in Brazil," MERIT Working Papers 2021-032, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    16. Marino, Maria & Iacono, Roberto & Mollerstrom, Johanna, 2024. "(Mis-)Perceptions, information, and political polarization: A survey and a systematic literature review," European Journal of Political Economy, Elsevier, vol. 85(C).
    17. Juan Imbet & J. Anthony Cookson & Corbin Fox & Christoph Schiller & Javier Gil-Bazo, 2024. "Social Media as a Bank Run Catalyst," Post-Print hal-04660083, HAL.
    18. Abigail Devereaux, 2025. "Costs of choice: reformulating price theory without heroic assumptions," Public Choice, Springer, vol. 202(3), pages 455-481, March.
    19. Eugen Dimant, 2020. "Hate Trumps Love: The Impact of Political Polarization on Social Preferences," ECONtribute Discussion Papers Series 029, University of Bonn and University of Cologne, Germany.
    20. Du, Rui & Mino, Ajkel & Wang, Jianghao & Zheng, Siqi, 2024. "Transboundary vegetation fire smoke and expressed sentiment: Evidence from Twitter," Journal of Environmental Economics and Management, Elsevier, vol. 124(C).

    More about this item

    Keywords

    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_12008. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.