IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2503.06244.html
   My bibliography  Save this paper

Hate in the Time of Algorithms: Evidence on Online Behavior from a Large-Scale Experiment

Author

Listed:
  • Aarushi Kalra

Abstract

Social media algorithms are thought to amplify variation in user beliefs, thus contributing to radicalization. However, quantitative evidence on how algorithms and user preferences jointly shape harmful online engagement is limited. I conduct an individually randomized experiment with 8 million users of an Indian TikTok-like platform, replacing algorithmic ranking with random content delivery. Exposure to "toxic" posts decreases by 27%, mainly due to reduced platform usage by users with higher interest in such content. Strikingly, these users increase engagement with toxic posts they find. Survey evidence indicates shifts to other platforms. Model-based counterfactuals highlight the limitations of blanket algorithmic regulation.

Suggested Citation

  • Aarushi Kalra, 2025. "Hate in the Time of Algorithms: Evidence on Online Behavior from a Large-Scale Experiment," Papers 2503.06244, arXiv.org.
    • Handle: RePEc:arx:papers:2503.06244
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2503.06244
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marco Manacorda & Andrea Tesei, 2020. "Liberation Technology: Mobile Phones and Political Mobilization in Africa," Econometrica, Econometric Society, vol. 88(2), pages 533-567, March.
    2. Stefano DellaVigna & John A. List & Ulrike Malmendier, 2012. "Testing for Altruism and Social Pressure in Charitable Giving," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 1-56.
    3. Ashesh Rambachan & Jon Kleinberg & Sendhil Mullainathan & Jens Ludwig, 2020. "An Economic Approach to Regulating Algorithms," NBER Working Papers 27111, National Bureau of Economic Research, Inc.
    4. David Atkin & Eve Colson-Sihra & Moses Shayo, 2021. "How Do We Choose Our Identity? A Revealed Preference Approach Using Food Consumption," Journal of Political Economy, University of Chicago Press, vol. 129(4), pages 1193-1251.
    5. Maximilian Kasy, 2023. "Algorithmic bias and racial inequality: A critical review," Economics Series Working Papers 1015, University of Oxford, Department of Economics.
    6. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    7. Daron Acemoglu & David Autor & Jonathon Hazell & Pascual Restrepo, 2022. "Artificial Intelligence and Jobs: Evidence from Online Vacancies," Journal of Labor Economics, University of Chicago Press, vol. 40(S1), pages 293-340.
    8. Elliott Ash & Stephen Hansen, 2023. "Text Algorithms in Economics," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 659-688, September.
    9. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    10. Luca Braghieri & Ro'ee Levy & Alexey Makarin, 2022. "Social Media and Mental Health," American Economic Review, American Economic Association, vol. 112(11), pages 3660-3693, November.
    11. Hanming Fang & Glenn C. Loury, 2005. ""Dysfunctional Identities" Can Be Rational," American Economic Review, American Economic Association, vol. 95(2), pages 104-111, May.
    12. Luigi Butera & Robert Metcalfe & William Morrison & Dmitry Taubinsky, 2022. "Measuring the Welfare Effects of Shame and Pride," American Economic Review, American Economic Association, vol. 112(1), pages 122-168, January.
    13. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    14. Stefano DellaVigna & Ethan Kaplan, 2007. "The Fox News Effect: Media Bias and Voting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1187-1234.
    15. Matthew Gentzkow & Jesse M. Shapiro, 2011. "Ideological Segregation Online and Offline," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1799-1839.
    16. Susanne M. Schennach, 2016. "Recent Advances in the Measurement Error Literature," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 341-377, October.
    17. George A. Akerlof & Rachel E. Kranton, 2000. "Economics and Identity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 715-753.
    18. Leonardo Bursztyn & Davide Cantoni & David Y. Yang & Noam Yuchtman & Y. Jane Zhang, 2021. "Persistent Political Engagement: Social Interactions and the Dynamics of Protest Movements," American Economic Review: Insights, American Economic Association, vol. 3(2), pages 233-250, June.
    19. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," NBER Working Papers 23089, National Bureau of Economic Research, Inc.
    20. Karsten Müller & Carlo Schwarz, 2021. "Fanning the Flames of Hate: Social Media and Hate Crime [Radio and the Rise of The Nazis in Prewar Germany]," Journal of the European Economic Association, European Economic Association, vol. 19(4), pages 2131-2167.
    21. Leonardo Bursztyn & Benjamin R. Handel & Rafael Jimenez & Christopher Roth, 2023. "When Product Markets Become Collective Traps: The Case of Social Media," NBER Working Papers 31771, National Bureau of Economic Research, Inc.
    22. Hunt Allcott & Luca Braghieri & Sarah Eichmeyer & Matthew Gentzkow, 2020. "The Welfare Effects of Social Media," American Economic Review, American Economic Association, vol. 110(3), pages 629-676, March.
    23. Gregory J. Martin & Ali Yurukoglu, 2017. "Bias in Cable News: Persuasion and Polarization," American Economic Review, American Economic Association, vol. 107(9), pages 2565-2599, September.
    24. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 211-236, Spring.
    25. Gonzalez, Robert & Maffioli, Elisa M., 2024. "Is the phone mightier than the virus? Cellphone access and epidemic containment efforts," Journal of Development Economics, Elsevier, vol. 167(C).
    26. Leonardo Bursztyn, 2023. "When Product Markets Become Collective Traps: The Case of Social Media," ECONtribute Discussion Papers Series 260, University of Bonn and University of Cologne, Germany.
    27. Jacques Simon Song & Georges Ngnouwal Eloundou & Fabrice Bitoto Ewolo & Blaise Ondoua Beyene, 2024. "Does Social Media Contribute to Economic Growth?," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(2), pages 8349-8389, June.
    28. Brendan Nyhan & Jaime Settle & Emily Thorson & Magdalena Wojcieszak & Pablo Barberá & Annie Y. Chen & Hunt Allcott & Taylor Brown & Adriana Crespo-Tenorio & Drew Dimmery & Deen Freelon & Matthew Gentz, 2023. "Like-minded sources on Facebook are prevalent but not polarizing," Nature, Nature, vol. 620(7972), pages 137-144, August.
    29. Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    30. Maximilian Kasy, 2024. "Algorithmic bias and racial inequality: a critical review," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 40(3), pages 530-546.
    31. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    32. Jiafeng Chen & Jonathan Roth, 2024. "Logs with Zeros? Some Problems and Solutions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(2), pages 891-936.
    33. Brendan Nyhan & Jaime Settle & Emily Thorson & Magdalena Wojcieszak & Pablo Barberá & Annie Y. Chen & Hunt Allcott & Taylor Brown & Adriana Crespo-Tenorio & Drew Dimmery & Deen Freelon & Matthew Gentz, 2023. "Author Correction: Like-minded sources on Facebook are prevalent but not polarizing," Nature, Nature, vol. 623(7987), pages 9-9, November.
    34. Michele Avalle & Niccolò Marco & Gabriele Etta & Emanuele Sangiorgio & Shayan Alipour & Anita Bonetti & Lorenzo Alvisi & Antonio Scala & Andrea Baronchelli & Matteo Cinelli & Walter Quattrociocchi, 2024. "Persistent interaction patterns across social media platforms and over time," Nature, Nature, vol. 628(8008), pages 582-589, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media : Evidence from a Field Experiment," The Warwick Economics Research Paper Series (TWERPS) 1543, University of Warwick, Department of Economics.
    2. Beknazar-Yuzbashev, George & Jiménez-Durán, Rafael & McCrosky, Jesse & Stalinski, Mateusz, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CAGE Online Working Paper Series 741, Competitive Advantage in the Global Economy (CAGE).
    3. George Beknazar-Yuzbashev & Rafael Jiménez-Durán & Jesse McCrosky & Mateusz Stalinski, 2025. "Toxic Content and User Engagement on Social Media: Evidence from a Field Experiment," CESifo Working Paper Series 11644, CESifo.
    4. Maurizio Pugno, 2024. "Social media effects on well‐being: The hypothesis of addiction of a new variety," Kyklos, Wiley Blackwell, vol. 77(3), pages 690-704, August.
    5. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2021. "The Effect of Social Media on Elections: Evidence from the United States," NBER Working Papers 28849, National Bureau of Economic Research, Inc.
    6. Thomas Fujiwara & Karsten Müller & Carlo Schwarz, 2024. "The Effect of Social Media on Elections: Evidence from The United States," Journal of the European Economic Association, European Economic Association, vol. 22(3), pages 1495-1539.
    7. Roberto Mosquera & Mofioluwasademi Odunowo & Trent McNamara & Xiongfei Guo & Ragan Petrie, 2020. "The economic effects of Facebook," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 575-602, June.
    8. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    9. Armand, Alex & Augsburg, Britta & Bancalari, Antonella & Kameshwara, Kalyan Kumar, 2024. "Religious proximity and misinformation: Experimental evidence from a mobile phone-based campaign in India," Journal of Health Economics, Elsevier, vol. 96(C).
    10. Armand, Alex & Augsburg, Britta & Bancalari, Antonella & Kameshwara, Kalyan Kumar, 2022. "Social Proximity and Misinformation: Experimental Evidence from a Mobile Phone-Based Campaign in India," CEPR Discussion Papers 16492, C.E.P.R. Discussion Papers.
    11. Besley, Timothy & Fetzer, Thiemo & Mueller, Hannes, 2019. "Terror and Tourism: The Economic Consequences of Media Coverage," CAGE Online Working Paper Series 449, Competitive Advantage in the Global Economy (CAGE).
    12. Andrea Tesei & Filipe Campante & Ruben Durante, 2022. "Media and Social Capital," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 69-91, August.
    13. Martin Beraja & Noam Yuchtman, 2025. "Generalized Disruption: Society, Work, and Property Rights in the Age of AI," NBER Chapters, in: The Political Economy of Artificial Intelligence, National Bureau of Economic Research, Inc.
    14. Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    15. Leonardo Bursztyn & Georgy Egorov & Ruben Enikolopov & Maria Petrova, 2019. "Social Media and Xenophobia: Evidence from Russia," NBER Working Papers 26567, National Bureau of Economic Research, Inc.
    16. Junze Sun & Arthur Schram & Randolph Sloof, 2019. "A Theory on Media Bias and Elections," Tinbergen Institute Discussion Papers 19-048/I, Tinbergen Institute.
    17. Leopoldo Fergusson & Carlos Molina, 2020. "Facebook Causes Protests," HiCN Working Papers 323, Households in Conflict Network.
    18. McNamara, Trent & Mosquera, Roberto, 2024. "The political divide: The case of expectations and preferences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 110(C).
    19. Deena A. Isom & Hunter M. Boehme & Toniqua C. Mikell & Stephen Chicoine & Marion Renner, 2021. "Status Threat, Social Concerns, and Conservative Media: A Look at White America and the Alt-Right," Societies, MDPI, vol. 11(3), pages 1-20, July.
    20. Donati, Dante, 2023. "Mobile Internet access and political outcomes: Evidence from South Africa," Journal of Development Economics, Elsevier, vol. 162(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2503.06244. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.