IDEAS home Printed from https://ideas.repec.org/a/spr/nathaz/v94y2018i2d10.1007_s11069-018-3427-4.html
   My bibliography  Save this article

Real-time identification of urban rainstorm waterlogging disasters based on Weibo big data

Author

Listed:
  • Yang Xiao

    (Nanjing University of Information Science and Technology)

  • Beiqun Li

    (Nanjing University of Information Science and Technology)

  • Zaiwu Gong

    (Nanjing University of Information Science and Technology)

Abstract

With the acceleration of urbanisation in China, preventing and reducing the economic losses and casualties caused by urban rainstorm waterlogging disasters have become a critical and difficult issue that the government is concerned about. As urban storms are sudden, clustered, continuous, and cause huge economic losses, it is difficult to conduct emergency management. Developing a more scientific method for real-time disaster identification will help prevent losses over time. Examining social media big data is a feasible method for obtaining on-site disaster data and carrying out disaster risk assessments. This paper presents a real-time identification method for urban-storm disasters using Weibo data. Taking the June 2016 heavy rainstorm in Nanjing as an example, the obtained Weibo data are divided into eight parts for the training data set and two parts for the testing data set. It then performs text pre-processing using the Jieba segmentation module for word segmentation. Then, the term frequency–inverse document frequency method is used to calculate the feature items weights and extract the features. Hashing algorithms are introduced for processing high-dimensional sparse vector matrices. Finally, the naive Bayes, support vector machine, and random forest text classification algorithms are used to train the model, and a test set sample is introduced for testing the model to select the optimal classification algorithm. The experiments showed that the naive Bayes algorithm had the highest macro-average accuracy.

Suggested Citation

  • Yang Xiao & Beiqun Li & Zaiwu Gong, 2018. "Real-time identification of urban rainstorm waterlogging disasters based on Weibo big data," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 94(2), pages 833-842, November.
  • Handle: RePEc:spr:nathaz:v:94:y:2018:i:2:d:10.1007_s11069-018-3427-4
    DOI: 10.1007/s11069-018-3427-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11069-018-3427-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11069-018-3427-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bernard J. Jansen & Mimi Zhang & Kate Sobel & Abdur Chowdury, 2009. "Twitter power: Tweets as electronic word of mouth," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(11), pages 2169-2188, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jingyi Gao & Osamu Murao & Xuanda Pei & Yitong Dong, 2022. "Identifying Evacuation Needs and Resources Based on Volunteered Geographic Information: A Case of the Rainstorm in July 2021, Zhengzhou, China," IJERPH, MDPI, vol. 19(23), pages 1-21, November.
    2. Wang, Xiaoxi & Zhang, Yaojun & Yu, Danlin & Qi, Jinghan & Li, Shujing, 2022. "Investigating the spatiotemporal pattern of urban vibrancy and its determinants: Spatial big data analyses in Beijing, China," Land Use Policy, Elsevier, vol. 119(C).
    3. Achraf Tounsi & Marouane Temimi, 2023. "A systematic review of natural language processing applications for hydrometeorological hazards assessment," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 116(3), pages 2819-2870, April.
    4. Wei Sun & Yufei Hou & Lanjiang Guo, 2021. "Big data revealed relationship between air pollution and manufacturing industry in China," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 107(3), pages 2533-2553, July.
    5. Cen Song & Sijia Zhou & Kyle Hunt & Jun Zhuang, 2022. "Comprehensive Evolution Analysis of Public Perceptions Related to Pediatric Care: A Sina Weibo Case Study (2013–2020)," SAGE Open, , vol. 12(1), pages 21582440221, March.
    6. Mo Wang & Xiaoping Fu & Dongqing Zhang & Furong Chen & Jin Su & Shiqi Zhou & Jianjun Li & Yongming Zhong & Soon Keat Tan, 2023. "Urban Flooding Risk Assessment in the Rural-Urban Fringe Based on a Bayesian Classifier," Sustainability, MDPI, vol. 15(7), pages 1-16, March.
    7. Wenjuan Sun & Paolo Bocchini & Brian D. Davison, 2020. "Applications of artificial intelligence for disaster management," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 103(3), pages 2631-2689, September.
    8. Qifeng Wan & Xuanhua Xu & Xiaohong Chen & Jun Zhuang, 2020. "A Two-Stage Optimization Model for Large-Scale Group Decision-Making in Disaster Management: Minimizing Group Conflict and Maximizing Individual Satisfaction," Group Decision and Negotiation, Springer, vol. 29(5), pages 901-921, October.
    9. Jiexiong Duan & Weixin Zhai & Chengqi Cheng, 2020. "Crowd Detection in Mass Gatherings Based on Social Media Data: A Case Study of the 2014 Shanghai New Year’s Eve Stampede," IJERPH, MDPI, vol. 17(22), pages 1-14, November.
    10. Yuye Zhou & Jiangang Xu & Maosen Yin & Jun Zeng & Haolin Ming & Yiwen Wang, 2022. "Spatial-Temporal Pattern Evolution of Public Sentiment Responses to the COVID-19 Pandemic in Small Cities of China: A Case Study Based on Social Media Data Analysis," IJERPH, MDPI, vol. 19(18), pages 1-18, September.
    11. Gaoshan Wang & Guangjin Yu & Xiaohong Shen, 2020. "The Effect of Online Investor Sentiment on Stock Movements: An LSTM Approach," Complexity, Hindawi, vol. 2020, pages 1-11, December.
    12. Jing Huang & Jinle Kang & Huimin Wang & Zhiqiang Wang & Tian Qiu, 2020. "A Novel Approach to Measuring Urban Waterlogging Depth from Images Based on Mask Region-Based Convolutional Neural Network," Sustainability, MDPI, vol. 12(5), pages 1-15, March.
    13. Jiale Zhao & Fuqiang Yang & Yong Guo & Xin Ren, 2022. "A CAST-Based Analysis of the Metro Accident That Was Triggered by the Zhengzhou Heavy Rainstorm Disaster," IJERPH, MDPI, vol. 19(17), pages 1-20, August.
    14. Türkay Dereli & Nazmiye Eligüzel & Cihan Çetinkaya, 2021. "Content analyses of the international federation of red cross and red crescent societies (ifrc) based on machine learning techniques through twitter," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 106(3), pages 2025-2045, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xuan Yang & Xiao Li & Daning Hu & Harry Jiannan Wang, 2021. "Differential impacts of social influence on initial and sustained participation in open source software projects," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(9), pages 1133-1147, September.
    2. Langley, David J. & Hoeve, Maarten C. & Ortt, J. Roland & Pals, Nico & van der Vecht, Bob, 2014. "Patterns of Herding and their Occurrence in an Online Setting," Journal of Interactive Marketing, Elsevier, vol. 28(1), pages 16-25.
    3. Li, Xin & Xie, Qianqian & Jiang, Jiaojiao & Zhou, Yuan & Huang, Lucheng, 2019. "Identifying and monitoring the development trends of emerging technologies using patent analysis and Twitter data mining: The case of perovskite solar cell technology," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 687-705.
    4. Shu-Hsun Ho & Yu-Ling Lin & Robert Carlson Patrick, 2015. "Participant Motivations In A Social Media Community Page," Global Journal of Business Research, The Institute for Business and Finance Research, vol. 9(4), pages 67-75.
    5. Pablo Gomez‐Carrasco & Giovanna Michelon, 2017. "The Power of Stakeholders' Voice: The Effects of Social Media Activism on Stock Markets," Business Strategy and the Environment, Wiley Blackwell, vol. 26(6), pages 855-872, September.
    6. Ko, J. & Kwon, H.W. & Kim, H.S. & Lee, K. & Choi, M.Y., 2014. "Model for Twitter dynamics: Public attention and time series of tweeting," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 404(C), pages 142-149.
    7. Alberto Lopez & Eva Guerra & Beatriz Gonzalez & Sergio Madero, 2020. "Consumer sentiments toward brands: the interaction effect between brand personality and sentiments on electronic word of mouth," Journal of Marketing Analytics, Palgrave Macmillan, vol. 8(4), pages 203-223, December.
    8. Rajković, Borislav & Đurić, Ivan & Zarić, Vlade & Glauben, Thomas, 2021. "Gaining trust in the digital age: The potential of social media for increasing the competitiveness of small and medium enterprises," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 13(4).
    9. Krishen, Anjala S. & Dwivedi, Yogesh K. & Bindu, N. & Kumar, K. Satheesh, 2021. "A broad overview of interactive digital marketing: A bibliometric network analysis," Journal of Business Research, Elsevier, vol. 131(C), pages 183-195.
    10. Tatiana David-Negre & Arminda Almedida-Santana & Juan M. Hernández & Sergio Moreno-Gil, 2018. "Understanding European tourists’ use of e-tourism platforms. Analysis of networks," Information Technology & Tourism, Springer, vol. 20(1), pages 131-152, December.
    11. Choi-Meng Leong & Alexa Min-Wei Loi & Steve Woon, 2022. "The influence of social media eWOM information on purchase intention," Journal of Marketing Analytics, Palgrave Macmillan, vol. 10(2), pages 145-157, June.
    12. Budzinski, Oliver & Gaenssle, Sophia, 2018. "The economics of social media stars: An empirical investigation of stardom, popularity, and success on YouTube," Ilmenau Economics Discussion Papers 112, Ilmenau University of Technology, Institute of Economics.
    13. Claussen, Jörg & Engelstätter, Benjamin & Ward, Michael R., 2014. "Susceptibility and influence in social media word-of-mouth," ZEW Discussion Papers 14-129, ZEW - Leibniz Centre for European Economic Research.
    14. Syed Sardar Muhammad & Bidit Lal Dey & Vishanth Weerakkody, 2018. "Analysis of Factors that Influence Customers’ Willingness to Leave Big Data Digital Footprints on Social Media: A Systematic Review of Literature," Information Systems Frontiers, Springer, vol. 20(3), pages 559-576, June.
    15. Martin Quinn & Theodore Lynn & Stephen Jollands & Binesh Nair, 2016. "Domestic Water Charges in Ireland - Issues and Challenges Conveyed through Social Media," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 30(10), pages 3577-3591, August.
    16. Duan, Huijue Kelly & Vasarhelyi, Miklos A. & Codesso, Mauricio & Alzamil, Zamil, 2023. "Enhancing the government accounting information systems using social media information: An application of text mining and machine learning," International Journal of Accounting Information Systems, Elsevier, vol. 48(C).
    17. Aladwani, Adel M., 2015. "Facilitators, characteristics, and impacts of Twitter use: Theoretical analysis and empirical illustration," International Journal of Information Management, Elsevier, vol. 35(1), pages 15-25.
    18. Zhan Liu & Jialu Shan & Nicole Glassey Balet & Gang Fang, 2017. "Semantic social media analysis of Chinese tourists in Switzerland," Information Technology & Tourism, Springer, vol. 17(2), pages 183-202, June.
    19. Liye Ma & Baohong Sun & Sunder Kekre, 2015. "The Squeaky Wheel Gets the Grease—An Empirical Analysis of Customer Voice and Firm Intervention on Twitter," Marketing Science, INFORMS, vol. 34(5), pages 627-645, September.
    20. Pookulangara, Sanjukta & Koesler, Kristian, 2011. "Cultural influence on consumers' usage of social networks and its' impact on online purchase intentions," Journal of Retailing and Consumer Services, Elsevier, vol. 18(4), pages 348-354.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:nathaz:v:94:y:2018:i:2:d:10.1007_s11069-018-3427-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.