IDEAS home Printed from https://ideas.repec.org/p/net/wpaper/2502.html

Excessive Content Moderation

Author

Listed:
  • Ivan Rendo

    (Toulouse School of Economics, University of Toulouse Capitole)

Abstract

Unregulated online platforms often host extreme and socially undesirable content. As mainstream platforms tighten moderation, some users shift to unmoderated alternatives, leading to a leakage of extreme content. I develop a duopoly model where an ad-funded mainstream platform competes with an unmoderated fringe. Heterogeneous users choose platforms and create content reflecting their views. The mainstream platform trades off attracting fringe users with making content safer for advertisers. With strong network effects, the socially optimal moderation is more lenient than the profit-maximizing one. Therefore, regulation mandating stricter moderation may backfire by increasing overall content unsafety.

Suggested Citation

  • Ivan Rendo, 2025. "Excessive Content Moderation," Working Papers 25-02, NET Institute.
  • Handle: RePEc:net:wpaper:2502
    as

    Download full text from publisher

    File URL: http://www.netinst.org/Rendo_25-02.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    2. Yassine Lefouili & Leonardo Madio, 2022. "The economics of platform liability," European Journal of Law and Economics, Springer, vol. 53(3), pages 319-351, June.
    3. Beknazar-Yuzbashev, George & Jiménez Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic content and user engagement on social media: Evidence from a field experiment," Working Papers 359, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    4. Karsten Müller & Carlo Schwarz, 2021. "Fanning the Flames of Hate: Social Media and Hate Crime [Radio and the Rise of The Nazis in Prewar Germany]," Journal of the European Economic Association, European Economic Association, vol. 19(4), pages 2131-2167.
    5. Cameron, Lisa & Erkal, Nisvan & Gangadharan, Lata & Zhang, Marina, 2015. "Cultural integration: Experimental evidence of convergence in immigrants’ preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 111(C), pages 38-58.
    6. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CAGE Online Working Paper Series 741, Competitive Advantage in the Global Economy (CAGE).
    7. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media : Evidence from a Field Experiment," The Warwick Economics Research Paper Series (TWERPS) 1543, University of Warwick, Department of Economics.
    8. Yi Liu & Pinar Yildirim & Z. John Zhang, 2022. "Implications of Revenue Models and Technology for Content Moderation Strategies," Marketing Science, INFORMS, vol. 41(4), pages 831-847, July.
    9. Jacques Simon Song & Georges Ngnouwal Eloundou & Fabrice Bitoto Ewolo & Blaise Ondoua Beyene, 2024. "Does Social Media Contribute to Economic Growth?," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 8349-8389, June.
    10. Leonardo Madio & Martin Quinn, 2024. "Content Moderation and Advertising in Social Media Platforms," CESifo Working Paper Series 11169, CESifo.
    11. George Beknazar-Yuzbashev & Rafael Jiménez-Durán & Jesse McCrosky & Mateusz Stalinski, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CESifo Working Paper Series 11644, CESifo.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & Simonov, Andrey & Stalinski, Mateusz, 2026. "Social Media Advertising Loads as Prices," CAGE Online Working Paper Series 792, Competitive Advantage in the Global Economy (CAGE).
    2. Felix Chopra & Ingar Haaland & Fabian Roeben & Christopher Roth & Vanessa Sticher, 2025. "News Customization with AI," ECONtribute Discussion Papers Series 372, University of Bonn and University of Cologne, Germany.
    3. Balbuzanov, Ivan & Gars, Jared & Stalinski, Mateusz & Tjernström, Emilia, 2025. "Incentivizing Engagement: Experimental Evidence on Journalist Performance Pay," CAGE Online Working Paper Series 763, Competitive Advantage in the Global Economy (CAGE).
    4. Ying Bao & Jessie Liu, 2025. "Spiral of Silence: How Neutral Moderation Polarizes Content Creation," Papers 2511.19680, arXiv.org.
    5. Balbuzanov, Ivan & Gars, Jared & Stalinski, Mateusz & Tjernstrom, Emilia, 2025. "Incentivizing Engagement : Experimental Evidence on Journalist Performance Pay," The Warwick Economics Research Paper Series (TWERPS) 1570, University of Warwick, Department of Economics.
    6. Sergei Guriev & Nikita Melnikov & Joana Escórcio Silva & Ekaterina Zhuravskaya, 2025. "Mobile Broadband Accountability, Populism, and Misinformation," EconPol Forum, CESifo, vol. 26(04), pages 21-25, October.
    7. Ying Bao & Jessie Liu, 2025. "Beyond Takedowns: How Moderation Shapes What Gets Created," EconPol Forum, CESifo, vol. 26(04), pages 47-51, October.
    8. Michael McRae, 2025. "Vertical Governance of Online Speech: Evidence from Google's Moderation Mandate," Trinity Economics Papers tep1425, Trinity College Dublin, Department of Economics.
    9. Andres Raphaela & Berger Lara Marie, 2025. "Digitale Medienmärkte: Was tun gegen Hassrede und Falschinformationen?," Wirtschaftsdienst, Sciendo, vol. 105(3), pages 161-166.
    10. Di Lizia, Adam & Shevchenko, Lily, 2026. "Can hate speech be banned online? The effects of shutting down toxic forums on Reddit," CAGE Online Working Paper Series 790, Competitive Advantage in the Global Economy (CAGE).
    11. Marina Rizzi & Mateusz Stalinski, 2025. "Toxic Content and Engagement," EconPol Forum, CESifo, vol. 26(04), pages 58-62, October.
    12. repec:bon:boncrc:crctr224_2025_698 is not listed on IDEAS
    13. Beknazar-Yuzbashev, George & Jiménez Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic content and user engagement on social media: Evidence from a field experiment," Working Papers 359, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    14. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media : Evidence from a Field Experiment," The Warwick Economics Research Paper Series (TWERPS) 1543, University of Warwick, Department of Economics.
    15. Karsten Müller & Carlo Rasmus Schwarz & Zekai Shen, 2026. "Social Media vs. Democracy: Evidence from the January 6th Insurrection," CESifo Working Paper Series 12485, CESifo.
    16. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CAGE Online Working Paper Series 741, Competitive Advantage in the Global Economy (CAGE).
    17. Mller, Karsten & Schwarz, Carlo & Shen, Zekai, 2026. "Social Media vs. Democracy: Evidence from the January 6th Insurrection," CAGE Online Working Paper Series 794, Competitive Advantage in the Global Economy (CAGE).
    18. Aarushi Kalra, 2025. "Hate in the Time of Algorithms: Evidence on Online Behavior from a Large-Scale Experiment," Papers 2503.06244, arXiv.org.
    19. Leonardo Madio & Matthew Mitchell & Martin Quinn & Carlo Reggiani, 2025. "Asymmetric Content Moderation in Search Markets: The Case of Adult Websites," CESifo Working Paper Series 11842, CESifo.
    20. Flückiger, Matthias & Ludwig, Markus, 2025. "The structure of online social networks and social movements: Evidence from the Black Lives Matter protests," Journal of Public Economics, Elsevier, vol. 246(C).
    21. George Beknazar-Yuzbashev & Rafael Jiménez-Durán & Jesse McCrosky & Mateusz Stalinski, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CESifo Working Paper Series 11644, CESifo.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software
    • L82 - Industrial Organization - - Industry Studies: Services - - - Entertainment; Media
    • L51 - Industrial Organization - - Regulation and Industrial Policy - - - Economics of Regulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:net:wpaper:2502. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Nicholas Economides (email available below). General contact details of provider: http://www.NETinst.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.