IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v34y2023i2p487-507.html
   My bibliography  Save this article

Augmenting Social Bot Detection with Crowd-Generated Labels

Author

Listed:
  • Victor Benjamin

    (Department of Information Systems, Arizona State University, Tempe, Arizona 85287)

  • T. S. Raghu

    (Department of Information Systems, Arizona State University, Tempe, Arizona 85287)

Abstract

Social media platforms are facing increasing numbers of cyber-adversaries seeking to manipulate online discourse by using social bots (i.e., social media software robots) to help automate and scale their attacks. Likewise, some social media users can identify social bot activity at varying degrees of confidence. In this research, human reactions to social bot messages are used to augment existing social bot detection capabilities. Speech act theory is used to inspire a framework for assessing the credibility of instances where users identify potential bot activity, as not all user responses are of equal credibility for assisting with the bot detection task. The framework is then operationalized through deep learning methodologies to develop a computational system for identifying social bots. Real-world performance and practicality of the developed framework is demonstrated on a live, crowd-sourced data set collected from a real-world social media platform. Results show that consideration of crowd reactions to suspected bots can significantly improve bot detection performance. Furthermore, consideration of speech acts to evaluate crowd reactions can even further augment the system’s performance, although speech acts themselves are not necessary to observe performance boost through crowd intelligence. This study serves as a grounding point for future work that can explore an augmented model for detecting other forms of algorithmically generated content within social media platforms.

Suggested Citation

  • Victor Benjamin & T. S. Raghu, 2023. "Augmenting Social Bot Detection with Crowd-Generated Labels," Information Systems Research, INFORMS, vol. 34(2), pages 487-507, June.
    • Handle: RePEc:inm:orisre:v:34:y:2023:i:2:p:487-507
    DOI: 10.1287/isre.2022.1136
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2022.1136
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2022.1136?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ritu Agarwal & Vasant Dhar, 2014. "Editorial —Big Data, Data Science, and Analytics: The Opportunity and Challenge for IS Research," Information Systems Research, INFORMS, vol. 25(3), pages 443-448, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bram Klievink & Bart-Jan Romijn & Scott Cunningham & Hans Bruijn, 2017. "Big data in the public sector: Uncertainties and readiness," Information Systems Frontiers, Springer, vol. 19(2), pages 267-283, April.
    2. Yi Yang & Kunpeng Zhang & Yangyang Fan, 2023. "sDTM: A Supervised Bayesian Deep Topic Model for Text Analytics," Information Systems Research, INFORMS, vol. 34(1), pages 137-156, March.
    3. Anke Joubert & Matthias Murawski & Markus Bick, 2023. "Measuring the Big Data Readiness of Developing Countries – Index Development and its Application to Africa," Information Systems Frontiers, Springer, vol. 25(1), pages 327-350, February.
    4. Aleš Popovič & Ray Hackney & Rana Tassabehji & Mauro Castelli, 2018. "The impact of big data analytics on firms’ high value business performance," Information Systems Frontiers, Springer, vol. 20(2), pages 209-222, April.
    5. Sivarajah, Uthayasankar & Kamal, Muhammad Mustafa & Irani, Zahir & Weerakkody, Vishanth, 2017. "Critical analysis of Big Data challenges and analytical methods," Journal of Business Research, Elsevier, vol. 70(C), pages 263-286.
    6. Mazanec, Josef A., 2020. "Hidden theorizing in big data analytics: With a reference to tourism design research," Annals of Tourism Research, Elsevier, vol. 83(C).
    7. Raeesi, Ramin & Sahebjamnia, Navid & Mansouri, S. Afshin, 2023. "The synergistic effect of operational research and big data analytics in greening container terminal operations: A review and future directions," European Journal of Operational Research, Elsevier, vol. 310(3), pages 943-973.
    8. Yuan Li & William J. Kettinger, 2022. "Testing the Relationship Between Information and Knowledge in Computer-Aided Decision-Making," Information Systems Frontiers, Springer, vol. 24(6), pages 1827-1843, December.
    9. Jinyang Zheng & Zhengling Qi & Yifan Dou & Yong Tan, 2019. "How Mega Is the Mega? Exploring the Spillover Effects of WeChat Using Graphical Model," Information Systems Research, INFORMS, vol. 30(4), pages 1343-1362, December.
    10. Canhoto, Ana Isabel & Clear, Fintan, 2020. "Artificial intelligence and machine learning as business tools: A framework for diagnosing value destruction potential," Business Horizons, Elsevier, vol. 63(2), pages 183-193.
    11. Claudio Vitari & Elisabetta Raguseo, 2019. "Big data analytics business value and firm performance: Linking with environmental context," Post-Print hal-02293765, HAL.
    12. Giorgi Shuradze & Yevgen Bogodistov & Heinz-Theo Wagner, 2018. "The Role Of Marketing-Enabled Data Analytics Capability And Organisational Agility For Innovation: Empirical Evidence From German Firms," International Journal of Innovation Management (ijim), World Scientific Publishing Co. Pte. Ltd., vol. 22(04), pages 1-32, May.
    13. Pratyush Bharati & Abhijit Chaudhury, 2019. "Assimilation of Big Data Innovation: Investigating the Roles of IT, Social Media, and Relational Capital," Information Systems Frontiers, Springer, vol. 21(6), pages 1357-1368, December.
    14. Dubey, Rameshwar & Gunasekaran, Angappa & Childe, Stephen J. & Roubaud, David & Fosso Wamba, Samuel & Giannakis, Mihalis & Foropon, Cyril, 2019. "Big data analytics and organizational culture as complements to swift trust and collaborative performance in the humanitarian supply chain," International Journal of Production Economics, Elsevier, vol. 210(C), pages 120-136.
    15. Shahriar Akter & Samuel Fosso Wamba, 2019. "Big data and disaster management: a systematic review and agenda for future research," Annals of Operations Research, Springer, vol. 283(1), pages 939-959, December.
    16. Issam Laguir & Sachin Modgil & Indranil Bose & Shivam Gupta & Rebecca Stekelorum, 2023. "Performance effects of analytics capability, disruption orientation, and resilience in the supply chain under environmental uncertainty," Annals of Operations Research, Springer, vol. 324(1), pages 1269-1293, May.
    17. Hajer Kefi & Sitesh Indra & Talel Abdessalem, 2016. "Social media marketing analytics : a multicultural approach applied to the beauty & cosmetic sector," Post-Print hal-01456580, HAL.
    18. Ahmed Abbasi & Jingjing Li & Donald Adjeroh & Marie Abate & Wanhong Zheng, 2019. "Don’t Mention It? Analyzing User-Generated Content Signals for Early Adverse Event Warnings," Information Systems Research, INFORMS, vol. 30(3), pages 1007-1028, September.
    19. M. M. Malik & S. Abdallah & M. Ala’raj, 2018. "Data mining and predictive analytics applications for the delivery of healthcare services: a systematic literature review," Annals of Operations Research, Springer, vol. 270(1), pages 287-312, November.
    20. Soroosh Nalchigar & Eric Yu, 2020. "Designing Business Analytics Solutions," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 62(1), pages 61-75, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:34:y:2023:i:2:p:487-507. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.