IDEAS home Printed from https://ideas.repec.org/a/spr/ijsaem/v16y2025i2d10.1007_s13198-024-02641-z.html
   My bibliography  Save this article

Efficient topic modeling for large-scale community question and answer websites

Author

Listed:
  • Sneh Prabha

    (Jaypee Institute of Information Technology)

  • Neetu Sardana

    (Jaypee Institute of Information Technology)

Abstract

Community Question and Answering (Q&A) websites hold a wealth of unstructured text. Analyzing this text using topic modeling can offer valuable insights into recent trends and technology within these communities. However, current topic modeling methods have limitations, as they often require default parameter tuning and struggle to handle large datasets effectively. We introduce a new topic modeling technique called LEFT (LDA Entropy TFIDF-based Fuzzy Modeling) to address these challenges. We evaluated LEFT using twenty-eight datasets from the Stack Exchange websites, including Artificial Intelligence (AI), Software Engineering (SE), Data Science (DS), Information Security (IS), and Quantum Computing (QC). In our study, we compared the performance of LEFT with two state-of-the-art techniques: Latent Dirichlet Allocation (LDA) (Blei et al., J Mach Learn Res 3:993–1022, 2003) and Fuzzy Latent Semantic Analysis (FLSA) (Karami et al., Int J Fuzzy Syst 20:1334–1345, 2018). Our findings indicate that LEFT outperforms existing techniques. It shows a 13.71% and 22.26% improvement in Silhouette score and CH score for large-scale datasets compared to the LDA model. Moreover, LEFT demonstrates significant improvements over FLSA and delivers comparable results to the LDA model for small-scale datasets.

Suggested Citation

  • Sneh Prabha & Neetu Sardana, 2025. "Efficient topic modeling for large-scale community question and answer websites," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 16(2), pages 685-710, February.
    • Handle: RePEc:spr:ijsaem:v:16:y:2025:i:2:d:10.1007_s13198-024-02641-z
    DOI: 10.1007/s13198-024-02641-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13198-024-02641-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s13198-024-02641-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Vamsi Vallurupalli & Indranil Bose, 2020. "Exploring thematic composition of online reviews: A topic modeling approach," Electronic Markets, Springer;IIM University of St. Gallen, vol. 30(4), pages 791-804, December.
    2. Yaniv Dover & Guy Kelman, 2018. "Emergence of online communities: Empirical evidence and theory," PLOS ONE, Public Library of Science, vol. 13(11), pages 1-17, November.
    3. W. G. Warren, 1971. "Correlation or Regression: Bias or Precision," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 20(2), pages 148-164, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sanz-Blas, Silvia & Buzova, Daniela & Pérez-Ruiz, Pilar, 2021. "Building relational worth in an online social community through virtual structural embeddedness and relational embeddedness," Technological Forecasting and Social Change, Elsevier, vol. 162(C).
    2. repec:jss:jstsof:23:i10 is not listed on IDEAS
    3. Hoon S. Choi & Michele Maasberg, 2022. "An empirical analysis of experienced reviewers in online communities: what, how, and why to review," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1293-1310, September.
    4. Weng Marc Lim & Gaurav Gupta & Baidyanath Biswas & Rohit Gupta, 2022. "Collaborative consumption continuance: a mixed-methods analysis of the service quality-loyalty relationship in ride-sharing services," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1463-1484, September.
    5. Mapanga, Arthur & Stofile, Regina, 2024. "Ethical Dimensions of Metaverse in Business Education in the Global South: A Thematic Content Analysis," Journal of Economic and Social Development, Clinical Journals Press, vol. 11(01), pages 01-15, March.
    6. Tim Kollmer & Andreas Eckhardt & Victoria Reibenspiess, 2022. "Explaining consumer suspicion: insights of a vignette study on online product reviews," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1221-1238, September.
    7. Andreas J. Steur & Fabian Fritzsche & Mischa Seiter, 2022. "It’s all about the text: An experimental investigation of inconsistent reviews on restaurant booking platforms," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1187-1220, September.
    8. Frank Kyei-Arthur, 2024. "Prevalence and predictors of internet use among Ghanaian older adults: evidence from the Ghana 2021 Population and Housing Census," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-9, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:ijsaem:v:16:y:2025:i:2:d:10.1007_s13198-024-02641-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.