IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i24p16414-d997074.html
   My bibliography  Save this article

Understanding User Preferences in Location-Based Social Networks via a Novel Self-Attention Mechanism

Author

Listed:
  • Lei Shi

    (State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China
    Institute of Scientific and Technical Information of China, Beijing 100038, China)

  • Jia Luo

    (College of Economics and Management, Beijing University of Technology, Beijing 100021, China
    LAAS-CNRS, Université de Toulouse, CNRS, 31031 Toulouse, France)

  • Peiying Zhang

    (College of Computer Science and Technology, China University of Petroleum (East China), Qingdao 266580, China)

  • Hongqi Han

    (Institute of Scientific and Technical Information of China, Beijing 100038, China)

  • Didier El Baz

    (LAAS-CNRS, Université de Toulouse, CNRS, 31031 Toulouse, France)

  • Gang Cheng

    (School of Computer Science, North China Institute of Science and Technology, Beijing 065201, China)

  • Zeyu Liang

    (School of Data Science and Intelligent Media, Communication University of China, Beijing 100024, China)

Abstract

The check-in behaviors of users are ubiquitous in location-based social networks in urban living. Understanding user preferences is critical to improving the recommendation services of social platforms. In addition, great quality of recommendation is also beneficial to sustainable urban living since the user can easily find the point of interest (POI) to visit, which avoids unnecessary consumption, such as a longer time taken for searching or driving. To capture user preferences from their check-in behaviors, advanced methods transform historical records into graph structure data and further leverage graph deep learning-based techniques to learn user preferences. Despite their effectiveness, existing graph deep learning-based methods are limited to the capture of the deep graph’s structural information due to inherent limitations, such as the over-smoothing problem in graph neural networks, further leading to suboptimal performance. To address the above issues, we propose a novel method built on Transformer architecture named spatiotemporal aware transformer (STAT) via a novel graphically aware attention mechanism. In addition, a new temporally aware sampling strategy is developed to reduce the computational cost and enable STAT to deal with large graphs. Extensive experiments on real-world datasets have demonstrated the superiority of the STAT compared to state-of-the-art POI recommendation methods.

Suggested Citation

  • Lei Shi & Jia Luo & Peiying Zhang & Hongqi Han & Didier El Baz & Gang Cheng & Zeyu Liang, 2022. "Understanding User Preferences in Location-Based Social Networks via a Novel Self-Attention Mechanism," Sustainability, MDPI, vol. 14(24), pages 1-14, December.
  • Handle: RePEc:gam:jsusta:v:14:y:2022:i:24:p:16414-:d:997074
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/24/16414/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/14/24/16414/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zhang, Jiusi & Jiang, Yuchen & Wu, Shimeng & Li, Xiang & Luo, Hao & Yin, Shen, 2022. "Prediction of remaining useful life based on bidirectional gated recurrent unit with temporal self-attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 221(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yuanfu & Chen, Yao & Hu, Zhenchao & Zhang, Huisheng, 2023. "Remaining useful life prediction of aero-engine enabled by fusing knowledge and deep learning models," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    2. Zhang, Jiusi & Jiang, Yuchen & Li, Xiang & Huo, Mingyi & Luo, Hao & Yin, Shen, 2022. "An adaptive remaining useful life prediction approach for single battery with unlabeled small sample data and parameter uncertainty," Reliability Engineering and System Safety, Elsevier, vol. 222(C).
    3. Fu, Song & Lin, Lin & Wang, Yue & Guo, Feng & Zhao, Minghang & Zhong, Baihong & Zhong, Shisheng, 2024. "MCA-DTCN: A novel dual-task temporal convolutional network with multi-channel attention for first prediction time detection and remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    4. Hao, Zhaojun & Di Maio, Francesco & Zio, Enrico, 2023. "A sequential decision problem formulation and deep reinforcement learning solution of the optimization of O&M of cyber-physical energy systems (CPESs) for reliable and safe power production and supply," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    5. Zhang, Yadong & Zhang, Chao & Wang, Shaoping & Dui, Hongyan & Chen, Rentong, 2024. "Health indicators for remaining useful life prediction of complex systems based on long short-term memory network and improved particle filter," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    6. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Luo, Hao & Yin, Shen, 2023. "An integrated multi-head dual sparse self-attention network for remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    7. Wang, Chu & Dou, Manfeng & Li, Zhongliang & Outbib, Rachid & Zhao, Dongdong & Zuo, Jian & Wang, Yuanlin & Liang, Bin & Wang, Peng, 2023. "Data-driven prognostics based on time-frequency analysis and symbolic recurrent neural network for fuel cells under dynamic load," Reliability Engineering and System Safety, Elsevier, vol. 233(C).
    8. Xu, Dan & Xiao, Xiaoqi & Liu, Jie & Sui, Shaobo, 2023. "Spatio-temporal degradation modeling and remaining useful life prediction under multiple operating conditions based on attention mechanism and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    9. Ding, Ning & Li, Hulin & Xin, Qi & Wu, Bo & Jiang, Dan, 2023. "Multi-source domain generalization for degradation monitoring of journal bearings under unseen conditions," Reliability Engineering and System Safety, Elsevier, vol. 230(C).
    10. Xiong, Jiawei & Zhou, Jian & Ma, Yizhong & Zhang, Fengxia & Lin, Chenglong, 2023. "Adaptive deep learning-based remaining useful life prediction framework for systems with multiple failure patterns," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    11. Dai, Le & Guo, Junyu & Wan, Jia-Lun & Wang, Jiang & Zan, Xueping, 2022. "A reliability evaluation model of rolling bearings based on WKN-BiGRU and Wiener process," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    12. Huang, Zhifu & Yang, Yang & Hu, Yawei & Ding, Xiang & Li, Xuanlin & Liu, Yongbin, 2023. "Attention-augmented recalibrated and compensatory network for machine remaining useful life prediction," Reliability Engineering and System Safety, Elsevier, vol. 235(C).
    13. Cheng, Han & Kong, Xianguang & Wang, Qibin & Ma, Hongbo & Yang, Shengkang & Xu, Kun, 2023. "Remaining useful life prediction combined dynamic model with transfer learning under insufficient degradation data," Reliability Engineering and System Safety, Elsevier, vol. 236(C).
    14. Zhuang, Jichao & Jia, Minping & Zhao, Xiaoli, 2022. "An adversarial transfer network with supervised metric for remaining useful life prediction of rolling bearing under multiple working conditions," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    15. Chen, Xi & Wang, Hui & Lu, Siliang & Xu, Jiawen & Yan, Ruqiang, 2023. "Remaining useful life prediction of turbofan engine using global health degradation representation in federated learning," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    16. Zhu, Rong & Chen, Yuan & Peng, Weiwen & Ye, Zhi-Sheng, 2022. "Bayesian deep-learning for RUL prediction: An active learning perspective," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    17. Zhou, Liang & Wang, Huawei & Xu, Shanshan, 2023. "Aero-engine prognosis strategy based on multi-scale feature fusion and multi-task parallel learning," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    18. Liu, Yulang & Chen, Jinglong & Wang, Tiantian & Li, Aimin & Pan, Tongyang, 2023. "A variational transformer for predicting turbopump bearing condition under diverse degradation processes," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    19. Zhang, Jiusi & Li, Xiang & Tian, Jilun & Jiang, Yuchen & Luo, Hao & Yin, Shen, 2023. "A variational local weighted deep sub-domain adaptation network for remaining useful life prediction facing cross-domain condition," Reliability Engineering and System Safety, Elsevier, vol. 231(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:24:p:16414-:d:997074. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.