Graph convolution machine for context-aware recommender system

Abstract

The latest advance in recommendation shows that better user and item representations can be learned via performing graph convolutions on the user-item interaction graph. However, such finding is mostly restricted to the collaborative filtering (CF) scenario, where the interaction contexts are not available. In this work, we extend the advantages of graph convolutions to context-aware recommender system (CARS, which represents a generic type of models that can handle various side information). We propose Graph Convolution Machine (GCM), an end-to-end framework that consists of three components: an encoder, graph convolution (GC) layers, and a decoder. The encoder projects users, items, and contexts into embedding vectors, which are passed to the GC layers that refine user and item embeddings with context-aware graph convolutions on the user-item graph. The decoder digests the refined embeddings to output the prediction score by considering the interactions among user, item, and context embeddings. We conduct experiments on three real-world datasets from Yelp and Amazon, validating the effectiveness of GCM and the benefits of performing graph convolutions for CARS.

Graphical abstract

Keywords

context-aware recommender systems / graph convolution

References

[1] He X, Liao L, Zhang H, Nie L, Hu X, Chua T S. Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web. 2017, 173– 182

[2] Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L. BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. 2009, 452– 461

[3] Wang X, He X, Wang M, Feng F, Chua T. Neural graph collaborative filtering. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2019, 165– 174

[4] Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks. In: Proceedings of the 5th International Conference on Learning Representations. 2017

[5] Veličković P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y. Graph attention networks. In: Proceedings of the 6th International Conference on Learning Representations. 2018

[6] Wei Y, Wang X, Nie L, He X, Hong R, Chua T. MMGCN: multi-modal graph convolution network for personalized recommendation of micro-video. In: Proceedings of the 27th ACM International Conference on Multimedia. 2019, 1437−1445

[7] Wu L, Sun P, Fu Y, Hong R, Wang X, Wang M. A neural influence diffusion model for social recommendation. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2019, 235– 244

[8] Zheng L, Lu C T, Jiang F, Zhang J, Yu P S. Spectral collaborative filtering. In: Proceedings of the 12th ACM Conference on Recommender Systems. 2018, 311– 319

[9] Shi Y , Larson M , Hanjalic A . Collaborative filtering beyond the user-item matrix: a survey of the state of the art and future challenges. ACM Computing Surveys, 2014, 47( 1): 1– 45

[10] Karatzoglou A, Amatriain X, Baltrunas L, Oliver N. Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering. In: Proceedings of the 2010 ACM Conference on Recommender Systems. 2010, 79– 86

[11] Rendle S. Factorization machines. In: Proceedings of the 10th IEEE International Conference on Data Mining. 2010, 995– 1000

[12] Cheng H T, Koc L, Harmsen J, Shaked T, Chandra T, Aradhye H, Anderson G, Corrado G, Chai W, Ispir M, et al. Wide & deep learning for recommender systems. In: Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. 2016, 7–10

[13] Shan Y, Hoens T R, Jiao J, Wang H, Yu D, Mao J. Deep crossing: web-scale modeling without manually crafted combinatorial features. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 255– 262

[14] He X, Chua T. Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2017, 355– 364

[15] Xiao J, Ye H, He X, Zhang H, Wu F, Chua T. Attentional factorization machines: learning the weight of feature interactions via attention networks. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2017, 3119−3125

[16] Lian J, Zhou X, Zhang F, Chen Z, Xie X, Sun G. xdeepfm: combining explicit and implicit feature interactions for recommender systems. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 1754−1763

[17] Xin X, Chen B, He X, Wang D, Ding Y, Jose J. CFM: convolutional factorization machines for context-aware recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 3926−3932

[18] Rendle S, Gantner Z, Freudenthaler C, Schmidt-Thieme L. Fast context-aware recommendations with factorization machines. In: Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2011, 635– 644

[19] Guo H, Tang R, Ye Y, Li Z, He X. Deepfm: a factorization-machine based neural network for CTR prediction. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2017, 1725-1731

[20] Wang R, Fu B, Fu G, Wang M. Deep & cross network for ad click predictions. In: Proceedings of the ADKDD’17. 2017, 1–7

[21] Juan Y, Zhuang Y, Chin W, Lin C. Field-aware factorization machines for CTR prediction. In: Proceedings of the 10th ACM Conference on Recommender Systems. 2016, 43– 50

[22] Liu B, Tang R, Chen Y, Yu J, Guo H, Zhang Y. Feature generation by convolutional neural network for clickthrough rate prediction. In: Proceedings of the Web Conference. 2019, 1119–1129

[23] Liu W, Tang R, Li J, Yu J, Guo H, He X, Zhang S. Fieldaware probabilistic embedding neural network for CTR prediction. In: Proceedings of the 12th ACM Conference on Recommender Systems. 2018, 412– 416

[24] Qu Y, Fang B, Zhang W, Tang R, Niu M, Guo H, Yu Y, He X. Product-based neural networks for user response prediction over multi-field categorical data. ACM Transactions on Information Systems, 2019, 37(1): 1– 35

[25] Hamilton W L, Ying R, Leskovec J. Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing. 2017

[26] Gong L, Cheng Q. Exploiting edge features for graph neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019, 9211−9219

[27] Zhang M, Chen Y. Link prediction based on graph neural networks. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. 2018, 5171−5181

[28] Xu K, Hu W, Leskovec J, Jegelka S. How powerful are graph neural networks? In: Proceedings of the 7th International Conference on Learning Representations. 2019

[29] Berg R, Kipf T N, Welling M. Graph convolutional matrix completion. 2017, arXiv preprint arXiv: 1706.02263

[30] Ying R, He R, Chen K, Eksombatchai P, Hamilton W L, Leskovec J. Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 974– 983

[31] Li Z, Cui Z, Wu S, Zhang X, Wang L. Fi-gnn: modeling feature interactions via graph neural networks for ctr prediction. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 539– 548

[32] Li F, Chen Z, Wang P, Ren Y, Zhang D, Zhu X. Graph intention network for click-through rate prediction in sponsored search. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2019, 961– 964

[33] Wang W, Zhang W, Liu S, Liu Q, Zhang B, Lin L, Zha H. Beyond clicks: modeling multi-relational item graph for session-based target behavior prediction. In: Proceedings of the Web Conference. 2020, 3056−3062

[34] Fan W, Ma Y, Li Q, He Y, Zhao Y E, Tang J, Yin D. Graph neural networks for social recommendation. In: Proceedings of the Web Conference. 2019, 417– 426

[35] Song W, Xiao Z, Wang Y, Charlin L, Zhang M, Tang J. Session-based social recommendation via dynamic graph attention networks. In: Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 2019, 555– 563

[36] Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T. Sessionbased recommendation with graph neural networks. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence. 2019, 346– 353

[37] Cao Y, Wang X, He X, Hu Z, Chua T. Unifying knowledge graph learning and recommendation: towards a better understanding of user preferences. In: Proceedings of the 2019 World Wide Web Conference. 2019, 151– 161

[38] Wang X, He X, Cao Y, Liu M, Chua T. KGAT: knowledge graph attention network for recommendation. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2019, 950– 958

[39] Mei L, Ren P, Chen Z, Nie L, Ma J, Nie J Y. An attentive interaction network for context-aware recommendations. In: Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 2018, 157– 166

[40] Wu C, Wu F, Qi T, Ge S, Huang Y, Xie X. Reviews meet graphs: enhancing user and item representations for recommendation with hierarchical attentive graph neural network. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 2019, 4886−4895

[41] Kingma D P, Ba J. Adam: a method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations. 2015

[42] Koren Y , Bell R , Volinsky C . Matrix factorization techniques for recommender systems. Computer, 2009, 42( 8): 30– 37

[43] He X, Deng K, Wang X, Li Y, Zhang Y, Wang M. Lightgcn: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020

[44] Rendle S, Krichene W, Zhang L, Anderson J R. Neural collaborative filtering vs. matrix factorization revisited. In: Proceedings of the 14th ACM Conference on Recommender Systems. 2020, 240– 248

[45] Beutel A, Covington P, Jain S, Xu C, Li J, Gatto V, Chi E H. Latent cross: making use of context in recurrent recommender systems. In: Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 2018, 46– 54

[46] Wang X, He X, Feng F, Nie L, Chua T S. Tem: treeenhanced embedding model for explainable recommendation. In: Proceedings of the 2018 World Wide Web Conference. 2018, 1543−1552

[47] Ma J, Cui P, Kuang K, Wang X, Zhu W. Disentangled graph convolutional networks. In: Proceedings of the 36th International Conference on Machine Learning. 2019, 4212-4221

Acknowledgements

This work was supported by the National Key Research and Development Program of China (2020AAA0106000) and the National Natural Science Foundation of China (Grant Nos. 61972372, U19A2079, 62121002).

RIGHTS & PERMISSIONS

2022 Higher Education Press