IDEAS home Printed from https://ideas.repec.org/a/spr/nathaz/v111y2022i1d10.1007_s11069-021-05081-1.html
   My bibliography  Save this article

Early detection of emergency events from social media: a new text clustering approach

Author

Listed:
  • Lida Huang

    (Tsinghua University)

  • Panpan Shi

    (Gsafety Company)

  • Haichao Zhu

    (Gsafety Company)

  • Tao Chen

    (Tsinghua University)

Abstract

Emergency events require early detection, quick response, and accurate recovery. In the era of big data, social media users can be seen as social sensors to monitor real-time emergency events. This paper proposed an integrated approach to detect all four kinds of emergency events early, including natural disasters, man-made accidents, public health events, and social security events. First, the BERT-Att-BiLSTM model is used to detect emergency-related posts from massive and irrelevant data. Then, the 3 W attribute information (what, where, and when) of the emergency event is extracted. With the 3 W attribute information, we create an unsupervised dynamical event clustering algorithm based on text similarity and combine it with the supervised logistical regression model to cluster posts into different events. Experiments on Sina Weibo data demonstrate the superiority of the proposed framework. Case studies on some real emergency events show that the proposed framework has good performance and high timeliness. Practical applications of the framework are also discussed, followed by future directions for improvement.

Suggested Citation

  • Lida Huang & Panpan Shi & Haichao Zhu & Tao Chen, 2022. "Early detection of emergency events from social media: a new text clustering approach," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 111(1), pages 851-875, March.
  • Handle: RePEc:spr:nathaz:v:111:y:2022:i:1:d:10.1007_s11069-021-05081-1
    DOI: 10.1007/s11069-021-05081-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11069-021-05081-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11069-021-05081-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xiangyang Guan & Cynthia Chen, 2014. "Using social media data to understand and assess disasters," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 74(2), pages 837-850, November.
    2. Yu Xiao & Qunying Huang & Kai Wu, 2015. "Understanding social media data for disaster management," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 79(3), pages 1663-1679, December.
    3. Qing Deng & Yi Liu & Hui Zhang & Xiaolong Deng & Yefeng Ma, 2016. "A new crowdsourcing model to assess disaster using microblog data in typhoon Haiyan," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 84(2), pages 1241-1256, November.
    4. Hua Bai & Guang Yu, 2016. "A Weibo-based approach to disaster informatics: incidents monitor in post-disaster situation via Weibo text negative sentiment analysis," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 83(2), pages 1177-1196, September.
    5. Cynthia Chew & Gunther Eysenbach, 2010. "Pandemics in the Age of Twitter: Content Analysis of Tweets during the 2009 H1N1 Outbreak," PLOS ONE, Public Library of Science, vol. 5(11), pages 1-13, November.
    6. Martin Rosvall & Carl T Bergstrom, 2010. "Mapping Change in Large Networks," PLOS ONE, Public Library of Science, vol. 5(1), pages 1-7, January.
    7. Faxi Yuan & Rui Liu, 2018. "Crowdsourcing for forensic disaster investigations: Hurricane Harvey case study," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 93(3), pages 1529-1546, September.
    8. Kathryn C. Finch & Kassandra R. Snook & Carmen H. Duke & King-Wa Fu & Zion Tsz Ho Tse & Atin Adhikari & Isaac Chun-Hai Fung, 2016. "Public health implications of social media use during natural disasters, environmental disasters, and other environmental concerns," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 83(1), pages 729-760, August.
    9. Yandong Wang & Teng Wang & Xinyue Ye & Jianqi Zhu & Jay Lee, 2015. "Using Social Media for Emergency Response and Urban Sustainability: A Case Study of the 2012 Beijing Rainstorm," Sustainability, MDPI, vol. 8(1), pages 1-17, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Zaoli & Wu, Qingyang & Venkatachalam, K. & Li, Yuchen & Xu, Bing & Trojovský, Pavel, 2022. "Topic identification and sentiment trends in Weibo and WeChat content related to intellectual property in China," Technological Forecasting and Social Change, Elsevier, vol. 184(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gabrielle Turner-McGrievy & Amir Karami & Courtney Monroe & Heather M. Brandt, 2020. "Dietary pattern recognition on Twitter: a case example of before, during, and after four natural disasters," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(1), pages 1035-1049, August.
    2. Bevaola Kusumasari & Nias Phydra Aji Prabowo, 2020. "Scraping social media data for disaster communication: how the pattern of Twitter users affects disasters in Asia and the Pacific," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(3), pages 3415-3435, September.
    3. Rachel Samuels & John E. Taylor & Neda Mohammadi, 2020. "Silence of the Tweets: incorporating social media activity drop-offs into crisis detection," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(1), pages 1455-1477, August.
    4. Lian, Ying & Liu, Yijun & Dong, Xuefan, 2020. "Strategies for controlling false online information during natural disasters: The case of Typhoon Mangkhut in China," Technology in Society, Elsevier, vol. 62(C).
    5. Turgut Acikara & Bo Xia & Tan Yigitcanlar & Carol Hon, 2023. "Contribution of Social Media Analytics to Disaster Response Effectiveness: A Systematic Review of the Literature," Sustainability, MDPI, vol. 15(11), pages 1-50, May.
    6. Ji-Wan Lee & Chung-Gil Jung & Jee-Hun Chung & Seong-Joon Kim, 2019. "The relationship among meteorological, agricultural, and in situ news-generated big data on droughts," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 98(2), pages 765-781, September.
    7. Xiaoxue Cheng & Guifeng Han & Yifan Zhao & Lin Li, 2019. "Evaluating Social Media Response to Urban Flood Disaster: Case Study on an East Asian City (Wuhan, China)," Sustainability, MDPI, vol. 11(19), pages 1-18, September.
    8. Mingjun Ma & Qiang Gao & Zishuang Xiao & Xingshuai Hou & Beibei Hu & Lifei Jia & Wenfang Song, 2023. "Analysis of public emotion on flood disasters in southern China in 2020 based on social media data," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 118(2), pages 1013-1033, September.
    9. Elbanna, Amany & Bunker, Deborah & Levine, Linda & Sleigh, Anthony, 2019. "Emergency management in the changing world of social media: Framing the research agenda with the stakeholders through engaged scholarship," International Journal of Information Management, Elsevier, vol. 47(C), pages 112-120.
    10. Faxi Yuan & Rui Liu, 2018. "Crowdsourcing for forensic disaster investigations: Hurricane Harvey case study," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 93(3), pages 1529-1546, September.
    11. Yan Wang & John E. Taylor, 2018. "Coupling sentiment and human mobility in natural disasters: a Twitter-based study of the 2014 South Napa Earthquake," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 92(2), pages 907-925, June.
    12. Jedsada Phengsuwan & Tejal Shah & Nipun Balan Thekkummal & Zhenyu Wen & Rui Sun & Divya Pullarkatt & Hemalatha Thirugnanam & Maneesha Vinodini Ramesh & Graham Morgan & Philip James & Rajiv Ranjan, 2021. "Use of Social Media Data in Disaster Management: A Survey," Future Internet, MDPI, vol. 13(2), pages 1-24, February.
    13. Zheye Wang & Xinyue Ye & Ming-Hsiang Tsou, 2016. "Spatial, temporal, and content analysis of Twitter for wildfire hazards," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 83(1), pages 523-540, August.
    14. Jiyong Ding & Juefang Cai & Guangxiang Guo & Chen Chen, 2018. "An Emergency Decision-Making Method for Urban Rainstorm Water-Logging: A China Study," Sustainability, MDPI, vol. 10(10), pages 1-21, September.
    15. Xiaobing Yu & Hong Chen & Chenliang Li, 2019. "Evaluate Typhoon Disasters in 21st Century Maritime Silk Road by Super-Efficiency DEA," IJERPH, MDPI, vol. 16(9), pages 1-10, May.
    16. Shiji Chen & Clément Arsenault & Yves Gingras & Vincent Larivière, 2015. "Exploring the interdisciplinary evolution of a discipline: the case of Biochemistry and Molecular Biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1307-1323, February.
    17. Dionne Mitcham & Morgan Taylor & Curtis Harris, 2021. "Utilizing Social Media for Information Dispersal during Local Disasters: The Communication Hub Framework for Local Emergency Management," IJERPH, MDPI, vol. 18(20), pages 1-16, October.
    18. Nisar, Sobia & Shafiq, Muhammad, 2019. "Framework for efficient utilisation of social media in Pakistan's healthcare sector," Technology in Society, Elsevier, vol. 56(C), pages 31-43.
    19. Luis-Millán González & José Devís-Devís & Maite Pellicer-Chenoll & Miquel Pans & Alberto Pardo-Ibañez & Xavier García-Massó & Fernanda Peset & Fernanda Garzón-Farinós & Víctor Pérez-Samaniego, 2021. "The Impact of COVID-19 on Sport in Twitter: A Quantitative and Qualitative Content Analysis," IJERPH, MDPI, vol. 18(9), pages 1-20, April.
    20. Sandulika Abesinghe & Nayomi Kankanamge & Tan Yigitcanlar & Surabhi Pancholi, 2023. "Image of a City through Big Data Analytics: Colombo from the Lens of Geo-Coded Social Media Data," Future Internet, MDPI, vol. 15(1), pages 1-21, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:nathaz:v:111:y:2022:i:1:d:10.1007_s11069-021-05081-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.