IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v38y2023i2d10.1007_s00180-022-01246-z.html
   My bibliography  Save this article

Pseudo-document simulation for comparing LDA, GSDMM and GPM topic models on short and sparse text using Twitter data

Author

Listed:
  • Christoph Weisser

    (Georg-August-Universität Göttingen
    Campus-Institut Data Science (CIDAS))

  • Christoph Gerloff

    (Georg-August-Universität Göttingen)

  • Anton Thielmann

    (Georg-August-Universität Göttingen)

  • Andre Python

    (Zhejiang University)

  • Arik Reuter

    (Georg-August-Universität Göttingen)

  • Thomas Kneib

    (Georg-August-Universität Göttingen
    Campus-Institut Data Science (CIDAS))

  • Benjamin Säfken

    (Clausthal University of Technology)

Abstract

Topic models are a useful and popular method to find latent topics of documents. However, the short and sparse texts in social media micro-blogs such as Twitter are challenging for the most commonly used Latent Dirichlet Allocation (LDA) topic model. We compare the performance of the standard LDA topic model with the Gibbs Sampler Dirichlet Multinomial Model (GSDMM) and the Gamma Poisson Mixture Model (GPM), which are specifically designed for sparse data. To compare the performance of the three models, we propose the simulation of pseudo-documents as a novel evaluation method. In a case study with short and sparse text, the models are evaluated on tweets filtered by keywords relating to the Covid-19 pandemic. We find that standard coherence scores that are often used for the evaluation of topic models perform poorly as an evaluation metric. The results of our simulation-based approach suggest that the GSDMM and GPM topic models may generate better topics than the standard LDA model.

Suggested Citation

  • Christoph Weisser & Christoph Gerloff & Anton Thielmann & Andre Python & Arik Reuter & Thomas Kneib & Benjamin Säfken, 2023. "Pseudo-document simulation for comparing LDA, GSDMM and GPM topic models on short and sparse text using Twitter data," Computational Statistics, Springer, vol. 38(2), pages 647-674, June.
    • Handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01246-z
    DOI: 10.1007/s00180-022-01246-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-022-01246-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00180-022-01246-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jocelyn Mazarura & Alta de Waal & Pieter de Villiers, 2020. "A Gamma-Poisson Mixture Topic Model for Short Text," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-17, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.

      Corrections

      All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01246-z. See general information about how to correct material in RePEc.

      If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

      If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

      If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

      For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

      Please note that corrections may take a couple of weeks to filter through the various RePEc services.

      IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.