Similitude Attentive Relation Network for Click-Through Rate Prediction

Hangyu Deng, Yulong Wang, Jia Luo, Jinglu Hu

研究成果: Conference contribution

2 被引用数 (Scopus)


In online advertising systems, having a good knowledge of user behavior is crucial for click-through rate (CTR) prediction. In recent years, many researchers turn to seek a better way of user representation by modeling the behavior sequences with recurrent neural network (RNN). However, recurrent layers implicitly adopt the assumption that elements with different orders are fundamentally different, which is inefficient in many practical scenarios with much uncertainty and complicated hidden states. In this paper, we follow the paradigm of Relation Network (RN), and propose a new model called Similitude Attentive Relation Network (SARN). The user behavior is modeled as a graph, where nodes correspond to the visited items and edges correspond to the relations. To capture the latent user interest better, the model concentrates on the relations between items, rather than the translation on the time series. More specifically, the model tries to learn the similarity between items in a semantic space through a learnable dot-product operation and blend both of the item representations and relational information together as the final relations. We define our user representation on an attentive pooling of the relations directly. To verify the effectiveness of our method, extensive experiments on two public datasets and one real-world online advertising dataset are conducted. Experimental results show that our methods achieve usually better performance than others. Besides, we explore the properties of our model by controlled experiments and show the learned relational knowledge by visualizing the inner states of SARN.

ホスト出版物のタイトル2020 International Joint Conference on Neural Networks, IJCNN 2020 - Proceedings
出版社Institute of Electrical and Electronics Engineers Inc.
出版ステータスPublished - 2020 7月
イベント2020 International Joint Conference on Neural Networks, IJCNN 2020 - Virtual, Glasgow, United Kingdom
継続期間: 2020 7月 192020 7月 24


名前Proceedings of the International Joint Conference on Neural Networks


Conference2020 International Joint Conference on Neural Networks, IJCNN 2020
国/地域United Kingdom
CityVirtual, Glasgow

ASJC Scopus subject areas

  • ソフトウェア
  • 人工知能


「Similitude Attentive Relation Network for Click-Through Rate Prediction」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。