IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i4p568-d1338448.html
   My bibliography  Save this article

Leveraging Chain-of-Thought to Enhance Stance Detection with Prompt-Tuning

Author

Listed:
  • Daijun Ding

    (College of Applied Science, Shenzhen University, Shenzhen 518052, China)

  • Xianghua Fu

    (College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China)

  • Xiaojiang Peng

    (College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China)

  • Xiaomao Fan

    (College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China)

  • Hu Huang

    (Shenzhen Graduate School, Peking University, Shenzhen 518055, China)

  • Bowen Zhang

    (College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China)

Abstract

Investigating public attitudes towards social media is crucial for opinion mining systems to gain valuable insights. Stance detection, which aims to discern the attitude expressed in an opinionated text towards a specific target, is a fundamental task in opinion mining. Conventional approaches mainly focus on sentence-level classification techniques. Recent research has shown that the integration of background knowledge can significantly improve stance detection performance. Despite the significant improvement achieved by knowledge-enhanced methods, applying these techniques in real-world scenarios remains challenging for several reasons. Firstly, existing methods often require the use of complex attention mechanisms to filter out noise and extract relevant background knowledge, which involves significant annotation efforts. Secondly, knowledge fusion mechanisms typically rely on fine-tuning, which can introduce a gap between the pre-training phase of pre-trained language models (PLMs) and the downstream stance detection tasks, leading to the poor prediction accuracy of the PLMs. To address these limitations, we propose a novel prompt-based stance detection method that leverages the knowledge acquired using the chain-of-thought method, which we refer to as PSDCOT. The proposed approach consists of two stages. The first stage is knowledge extraction, where instruction questions are constructed to elicit background knowledge from a VLPLM. The second stage is the multi-prompt learning network (M-PLN) for knowledge fusion, which learns model performance based on the background knowledge and the prompt learning framework. We evaluated the performance of PSDCOT on publicly available benchmark datasets to assess its effectiveness in improving stance detection performance. The results demonstrate that the proposed method achieves state-of-the-art results in in-domain, cross-target, and zero-shot learning settings.

Suggested Citation

  • Daijun Ding & Xianghua Fu & Xiaojiang Peng & Xiaomao Fan & Hu Huang & Bowen Zhang, 2024. "Leveraging Chain-of-Thought to Enhance Stance Detection with Prompt-Tuning," Mathematics, MDPI, vol. 12(4), pages 1-16, February.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:4:p:568-:d:1338448
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/4/568/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/4/568/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:4:p:568-:d:1338448. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.