IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i9p5536-d808754.html
   My bibliography  Save this article

A Multimodal Data Analysis Approach to Social Media during Natural Disasters

Author

Listed:
  • Mengna Zhang

    (School of Management, Guizhou University, Guiyang 550025, China
    Academic Affairs Office, Guizhou University of Finance and Economics, Guiyang 550025, China)

  • Qisong Huang

    (Guizhou Minzu University, Guiyang 550025, China)

  • Hua Liu

    (Faculty of Law, Guizhou University, Guiyang 550025, China)

Abstract

During natural disasters, social media can provide real time or rapid disaster, perception information to help government managers carry out disaster response efforts efficiently. Therefore, it is of great significance to mine social media information accurately. In contrast to previous studies, this study proposes a multimodal data classification model for mining social media information. Using the model, the study employs Late Dirichlet Allocation (LDA) to identify subject information from multimodal data, then, the multimodal data is analyzed by bidirectional encoder representation from transformers (Bert) and visual geometry group 16 (Vgg-16). Text and image data are classified separately, resulting in real mining of topic information during disasters. This study uses Weibo data during the 2021 Henan heavy storm as the research object. Comparing the data with previous experiment results, this study proposes a model that can classify natural disaster topics more accurately. The accuracy of this study is 0.93. Compared with a topic-based event classification model KGE-MMSLDA, the accuracy of this study is improved by 12%. This study results in a real-time understanding of different themed natural disasters to help make informed decisions.

Suggested Citation

  • Mengna Zhang & Qisong Huang & Hua Liu, 2022. "A Multimodal Data Analysis Approach to Social Media during Natural Disasters," Sustainability, MDPI, vol. 14(9), pages 1-21, May.
    • Handle: RePEc:gam:jsusta:v:14:y:2022:i:9:p:5536-:d:808754
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/9/5536/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/14/9/5536/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Pablo Aznar-Crespo & Antonio Aledo & Joaquín Melgarejo-Moreno & Arturo Vallejos-Romero, 2021. "Adapting Social Impact Assessment to Flood Risk Management," Sustainability, MDPI, vol. 13(6), pages 1-27, March.
    2. E. Piatyszek & G. Karagiannis, 2012. "A model-based approach for a systematic risk analysis of local flood emergency operation plans: a first step toward a decision support system," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 61(3), pages 1443-1462, April.
    3. Ragini, J. Rexiline & Anand, P.M. Rubesh & Bhaskar, Vidhyacharan, 2018. "Big data analytics for disaster response and recovery through sentiment analysis," International Journal of Information Management, Elsevier, vol. 42(C), pages 13-24.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. de Camargo Fiorini, Paula & Roman Pais Seles, Bruno Michel & Chiappetta Jabbour, Charbel Jose & Barberio Mariano, Enzo & de Sousa Jabbour, Ana Beatriz Lopes, 2018. "Management theory and big data literature: From a review to a research agenda," International Journal of Information Management, Elsevier, vol. 43(C), pages 112-129.
    2. Luigi Corvo & Lavinia Pastore & Arianna Manti & Daniel Iannaci, 2021. "Mapping Social Impact Assessment Models: A Literature Overview for a Future Research Agenda," Sustainability, MDPI, vol. 13(9), pages 1-16, April.
    3. Carlos Carrasco-Farré, 2022. "The fingerprints of misinformation: how deceptive content differs from reliable sources in terms of cognitive effort and appeal to emotions," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-18, December.
    4. Acharya, Abhilash & Singh, Sanjay Kumar & Pereira, Vijay & Singh, Poonam, 2018. "Big data, knowledge co-creation and decision making in fashion industry," International Journal of Information Management, Elsevier, vol. 42(C), pages 90-101.
    5. Umar Ali Bukar & Fatimah Sidi & Marzanah A. Jabar & Rozi Nor Haizan Nor & Salfarina Abdullah & Iskandar Ishak & Mustafa Alabadla & Ali Alkhalifah, 2022. "How Advanced Technological Approaches Are Reshaping Sustainable Social Media Crisis Management and Communication: A Systematic Review," Sustainability, MDPI, vol. 14(10), pages 1-26, May.
    6. Muhammad Ashraf Fauzi, 2023. "Social media in disaster management: review of the literature and future trends through bibliometric analysis," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 118(2), pages 953-975, September.
    7. Ismallianto Isia & Tony Hadibarata & Muhammad Noor Hazwan Jusoh & Rajib Kumar Bhattacharjya & Noor Fifinatasha Shahedan & Norma Latif Fitriyani & Muhammad Syafrudin, 2023. "Identifying Factors to Develop and Validate Social Vulnerability to Floods in Malaysia: A Systematic Review Study," Sustainability, MDPI, vol. 15(17), pages 1-21, August.
    8. Ni, Zi-jian & Rong, Lili & Wang, Ning & Cao, Shuo, 2019. "Knowledge model for emergency response based on contingency planning system of China," International Journal of Information Management, Elsevier, vol. 46(C), pages 10-22.
    9. Abhinav Kumar & Jyoti Prakash Singh & Yogesh K. Dwivedi & Nripendra P. Rana, 2022. "A deep multi-modal neural network for informative Twitter content classification during emergencies," Annals of Operations Research, Springer, vol. 319(1), pages 791-822, December.
    10. Turgut Acikara & Bo Xia & Tan Yigitcanlar & Carol Hon, 2023. "Contribution of Social Media Analytics to Disaster Response Effectiveness: A Systematic Review of the Literature," Sustainability, MDPI, vol. 15(11), pages 1-50, May.
    11. Zhou, Jianfeng & Reniers, Genserik & Khakzad, Nima, 2016. "Application of event sequence diagram to evaluate emergency response actions during fire-induced domino effects," Reliability Engineering and System Safety, Elsevier, vol. 150(C), pages 202-209.
    12. Claudia Paciarotti & Inna Valiakhmetova, 2021. "Evaluating Disaster Operations Management: An Outcome‐Process Integrated Approach," Production and Operations Management, Production and Operations Management Society, vol. 30(2), pages 543-562, February.
    13. Abhilash Kondraganti & Gopalakrishnan Narayanamurthy & Hossein Sharifi, 2024. "A systematic literature review on the use of big data analytics in humanitarian and disaster operations," Annals of Operations Research, Springer, vol. 335(3), pages 1015-1052, April.
    14. Harri Raisio & Alisa Puustinen & Juha Lindell, 2022. "#StrongTogether? Qualitative Sentiment Analysis of Social Media Reactions to Disaster Volunteering during a Forest Fire in Finland," Sustainability, MDPI, vol. 14(7), pages 1-18, March.
    15. Qiang Fu & Fanli Gong & Qiuxiang Jiang & Tianxiao Li & Kun Cheng & He Dong & Xiaosong Ma, 2014. "Risk assessment of the city water resources system based on Pansystems Observation-Control Model of Periphery," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 71(3), pages 1899-1912, April.
    16. Anvarifar, Fatemeh & Voorendt, Mark Z. & Zevenbergen, Chris & Thissen, Wil, 2017. "An application of the Functional Resonance Analysis Method (FRAM) to risk analysis of multifunctional flood defences in the Netherlands," Reliability Engineering and System Safety, Elsevier, vol. 158(C), pages 130-141.
    17. Gupta, Shivam & Kar, Arpan Kumar & Baabdullah, Abdullah & Al-Khowaiter, Wassan A.A., 2018. "Big data with cognitive computing: A review for the future," International Journal of Information Management, Elsevier, vol. 42(C), pages 78-89.
    18. Pablo M. Flores & Martin Hilbert, 2023. "Temporal communication dynamics in the aftermath of large-scale upheavals: do digital footprints reveal a stage model?," Journal of Computational Social Science, Springer, vol. 6(2), pages 973-999, October.
    19. Bo Yang & Yue Hu & Xusen Cheng & Ying Bao & Wenjing Chen, 2023. "Exploring the factors affecting content dissemination through WeChat official accounts: a heuristic-systematic model perspective," Electronic Commerce Research, Springer, vol. 23(4), pages 2713-2735, December.
    20. Paras Bhatt & Naga Vemprala & Rohit Valecha & Govind Hariharan & H. Raghav Rao, 2023. "User Privacy, Surveillance and Public Health during COVID-19 – An Examination of Twitterverse," Information Systems Frontiers, Springer, vol. 25(5), pages 1667-1682, October.

    More about this item

    Keywords

    multimodal data; LDA; Bert; VGG-16;
    All these keywords.

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:9:p:5536-:d:808754. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.