IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v12y2024i10p1581-d1397293.html
   My bibliography  Save this article

A Negative Sample-Free Graph Contrastive Learning Algorithm

Author

Listed:
  • Dongming Chen

    (Software College, Northeastern University, Shenyang 110819, China)

  • Mingshuo Nie

    (Software College, Northeastern University, Shenyang 110819, China)

  • Zhen Wang

    (Software College, Northeastern University, Shenyang 110819, China)

  • Huilin Chen

    (College of Engineering, Computing and Cybernetics, Australian National University, Canberra, ACT 2601, Australia)

  • Dongqi Wang

    (Software College, Northeastern University, Shenyang 110819, China)

Abstract

Self-supervised learning is a new machine learning method that does not rely on manually labeled data, and learns from rich unlabeled data itself by designing agent tasks using the input data as supervision to obtain a more generalized representation for application in downstream tasks. However, the current self-supervised learning suffers from the problem of relying on the selection and number of negative samples and the problem of sample bias phenomenon after graph data augmentation. In this paper, we investigate the above problems and propose a corresponding solution, proposing a graph contrastive learning algorithm without negative samples. The model uses matrix sketching in the implicit space for feature augmentation to reduce sample bias and iteratively trains the mutual correlation matrix of two viewpoints by drawing closer to the distance of the constant matrix as the objective function. This method does not require techniques such as negative samples, gradient stopping, and momentum updating to prevent self-supervised model collapse. This method is compared with 10 graph representation learning algorithms on four datasets for node classification tasks, and the experimental results show that the algorithm proposed in this paper achieves good results.

Suggested Citation

  • Dongming Chen & Mingshuo Nie & Zhen Wang & Huilin Chen & Dongqi Wang, 2024. "A Negative Sample-Free Graph Contrastive Learning Algorithm," Mathematics, MDPI, vol. 12(10), pages 1-16, May.
  • Handle: RePEc:gam:jmathe:v:12:y:2024:i:10:p:1581-:d:1397293
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/12/10/1581/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/12/10/1581/
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:10:p:1581-:d:1397293. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.