IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v512y2018icp698-720.html
   My bibliography  Save this article

The structure of word co-occurrence network for microblogs

Author

Listed:
  • Garg, Muskan
  • Kumar, Mukesh

Abstract

The study of structure and dynamics of complex networks is seeking attention of academic researchers and practitioners in recent years. Although Word Co-occurrence Networks (WCN) have been studied for different languages, yet there is the need to study the structure of WCN for microblogs due to the presence of ill-formed and unstructured data. In this research article, existing WCN based applications have been explored and microblog WCN have been analysed for multiple key parameters to uncover the hidden patterns. The key parameters studied for microblogs WCN are scale-free property, small world feature, hierarchical organization, assortativity and spectral analysis. The twitter FSD dataset has been used for experimental results and evaluation. Different mathematical, statistical and graphical interpretations proved that the microblog WCN are different from the WCN of traditional well-formed text. The robustness of the key parameters of microblogs WCN have been explored for keyphrase extraction from domain specific set of microblogs. The baseline methods used for comparisons are TextRank, TopicRank, and NErank. Extensive experiments over standard public dataset proved that the proposed keyphrase extraction technique outperforms the existing techniques in terms of precision, recall, F-measure, and ROUGE scores.

Suggested Citation

  • Garg, Muskan & Kumar, Mukesh, 2018. "The structure of word co-occurrence network for microblogs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 512(C), pages 698-720.
  • Handle: RePEc:eee:phsmap:v:512:y:2018:i:c:p:698-720
    DOI: 10.1016/j.physa.2018.08.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437118309361
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bian, Tian & Hu, Jiantao & Deng, Yong, 2017. "Identifying influential nodes in complex networks based on AHP," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 422-436.
    2. Liang, Wei & Chen, Guanrong, 2016. "Spectral analysis of Chinese language: Co-occurrence networks from four literary genres," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 450(C), pages 49-56.
    3. Liang, Wei, 2017. "Spectra of English evolving word co-occurrence networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 468(C), pages 802-808.
    4. Slobodan Beliga & Ana MeÅ¡trović & Sanda MartinÄ ić-IpÅ¡ić, 2016. "Selectivity-Based Keyword Extraction Method," International Journal on Semantic Web and Information Systems (IJSWIS), IGI Global, vol. 12(3), pages 1-26, July.
    5. Liang, Wei & Wang, Yanli & Shi, Yuming & Chen, Guanrong, 2015. "Co-occurrence network analysis of modern Chinese poems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 420(C), pages 284-293.
    6. Liang, Wei & Shi, Yuming & Tse, Chi K. & Liu, Jing & Wang, Yanli & Cui, Xunqiang, 2009. "Comparison of co-occurrence networks of the Chinese and English languages," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(23), pages 4901-4909.
    7. Liang, Wei & Wang, Yanli & Shi, Yuming & Chen, Guanrong, 2015. "Co-occurrence network analysis of Chinese and English poems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 420(C), pages 315-323.
    8. Gao, Yuyang & Liang, Wei & Shi, Yuming & Huang, Qiuling, 2014. "Comparison of directed and weighted co-occurrence networks of six languages," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 393(C), pages 579-589.
    Full references (including those not matched with items on IDEAS)

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:512:y:2018:i:c:p:698-720. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.