BGNN: Behavior-aware graph neural network for heterogeneous session-based recommendation

Abstract

Session-based recommendation (SBR) and multi-behavior recommendation (MBR) are both important problems and have attracted the attention of many researchers and practitioners. Different from SBR that solely uses one single type of behavior sequences and MBR that neglects sequential dynamics, heterogeneous SBR (HSBR) that exploits different types of behavioral information (e.g., examinations like clicks or browses, purchases, adds-to-carts and adds-to-favorites) in sequences is more consistent with real-world recommendation scenarios, but it is rarely studied. Early efforts towards HSBR focus on distinguishing different types of behaviors or exploiting homogeneous behavior transitions in a sequence with the same type of behaviors. However, all the existing solutions for HSBR do not exploit the rich heterogeneous behavior transitions in an explicit way and thus may fail to capture the semantic relations between different types of behaviors. However, all the existing solutions for HSBR do not model the rich heterogeneous behavior transitions in the form of graphs and thus may fail to capture the semantic relations between different types of behaviors. The limitation hinders the development of HSBR and results in unsatisfactory performance. As a response, we propose a novel behavior-aware graph neural network (BGNN) for HSBR. Our BGNN adopts a dual-channel learning strategy for differentiated modeling of two different types of behavior sequences in a session. Moreover, our BGNN integrates the information of both homogeneous behavior transitions and heterogeneous behavior transitions in a unified way. We then conduct extensive empirical studies on three real-world datasets, and find that our BGNN outperforms the best baseline by 21.87%, 18.49%, and 37.16% on average correspondingly. A series of further experiments and visualization studies demonstrate the rationality and effectiveness of our BGNN. An exploratory study on extending our BGNN to handle more than two types of behaviors show that our BGNN can easily and effectively be extended to multi-behavior scenarios.

Graphical abstract

Keywords

session-based recommendation / graph neural network / heterogeneous behaviors

References

[1] Hu Y, Koren Y, Volinsky C. Collaborative filtering for implicit feedback datasets. In: Proceedings of the 8th IEEE International Conference on Data Mining. 2008, 263–272

[2] He X, Liao L, Zhang H, Nie L, Hu X, Chua T S. Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web. 2017, 173–182

[3] Wang S, Cao L, Wang Y, Sheng Q Z, Orgun M A, Lian D . A survey on session-based recommender systems. ACM Computing Surveys, 2022, 54( 7): 154

[4] Chen W, Ren P, Cai F, Sun F, De Rijke M . Multi-interest diversification for end-to-end sequential recommendation. ACM Transactions on Information System, 2021, 40( 1): 20

[5] Meng W, Yang D, Xiao Y. Incorporating user micro-behaviors and item knowledge into multi-task learning for session-based recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 1091–1100

[6] Wen W, Zhang W, Liu S, Liu Q, Zhang B, Lin L, Zha H. Beyond clicks: modeling multi-relational item graph for session-based target behavior prediction. In: Proceedings of the Web Conference 2020. 2020, 3056–3062

[7] Wang J, Louca R, Hu D, Cellier C, Caverlee J, Hong L. Time to shop for valentine’s day: shopping occasions and sequential recommendation in E-commerce. In: Proceedings of the 13th International Conference on Web Search and Data Mining. 2020, 645–653

[8] Liu Q, Wu S, Wang L . Multi-behavioral sequential prediction with recurrent log-bilinear model. IEEE Transactions on Knowledge and Data Engineering, 2017, 29( 6): 1254–1267

[9] Li Z, Zhao H, Liu Q, Huang Z, Mei T, Chen E. Learning from history and present: next-item recommendation via discriminatively exploiting user behaviors. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 1734–1743

[10] Zhou M, Ding Z, Tang J, Yin D. Micro behaviors: a new perspective in E-commerce recommender systems. In: Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 2018, 727–735

[11] Gu Y, Ding Z, Wang S, Zou L, Liu Y, Yin D. Deep multifaceted transformers for multi-objective ranking in large-scale E-commerce recommender systems. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 2493–2500

[12] Xie R, Ling C, Wang Y, Wang R, Xia F, Lin L. Deep feedback network for recommendation. In: Proceedings of the 29th International Joint Conference on Artificial Intelligence. 2020, 2519–2525

[13] Sarwar B, Karypis G, Konstan J, Riedl J. Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th International Conference on World Wide Web. 2001, 285–295

[14] Jannach D, Ludewig M. When recurrent neural networks meet the neighborhood for session-based recommendation. In: Proceedings of the 11th ACM Conference on Recommender Systems. 2017, 306–310

[15] Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L. BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. 2009, 452–461

[16] Rendle S, Freudenthaler C, Schmidt-Thieme L. Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th International Conference on World Wide Web. 2010, 811–820

[17] He R, McAuley J. Fusing similarity models with Markov chains for sparse sequential recommendation. In: Proceedings of the 16th IEEE International Conference on Data Mining. 2016, 191–200

[18] Donkers T, Loepp B, Ziegler J. Sequential user-based recurrent neural network recommendations. In: Proceedings of the 11th ACM Conference on Recommender Systems. 2017, 152–160

[19] Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P. Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the 11th ACM Conference on Recommender Systems. 2017, 130–137

[20] Hidasi B, Karatzoglou A, Baltrunas L, Tikk D. Session-based recommendations with recurrent neural networks. In: Proceedings of the 4th International Conference on Learning Representations. 2016

[21] Yu F, Liu Q, Wu S, Wang L, Tan T. A dynamic recurrent model for next basket recommendation. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2016, 729–732

[22] Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J. Neural attentive session-based recommendation. In: Proceedings of 2017 ACM on Conference on Information and Knowledge Management. 2017, 1419–1428

[23] Liu Q, Zeng Y, Mokhosi R, Zhang H. STAMP: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 1831–1839

[24] Zhou G, Zhu X, Song C, Fan Y, Zhu H, Ma X, Yan Y, Jin J Li H, Gai K. Deep interest network for click-through rate prediction. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 1059–1068

[25] Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T. Session-based recommendation with graph neural networks. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence. 2019, 346–353

[26] Xu C, Zhao P, Liu Y, Sheng V S, Xu J, Zhuang F, Fang J, Zhou X. Graph contextualized self-attention network for session-based recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 3940–3946

[27] Qiu R, Li J, Huang Z, Yin H. Rethinking the item order in session-based recommendation with graph neural networks. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 579–588

[28] Xia X, Yin H, Yu J, Wang Q, Cui L, Zhang X. Self-supervised hypergraph convolutional networks for session-based recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 4503–4518

[29] Wang J, Ding K, Zhu Z, Caverlee J. Session-based recommendation with hypergraph attention networks. In: Proceedings of 2021 SIAM International Conference on Data Mining. 2021, 82–90

[30] Huang C, Chen J, Xia L, Xu Y, Dai P, Chen Y, Bo L, Zhao J, Huang J X. Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 4123–4130

[31] Wang Z, Wei W, Cong G, Li X L, Mao X L, Qiu M. Global context enhanced graph neural networks for session-based recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 169–178

[32] Tang J, Wang K. Personalized top-N sequential recommendation via convolutional sequence embedding. In: Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 2018, 565–573

[33] Yuan F, Karatzoglou A, Arapakis I, Jose J M, He X. A simple convolutional generative network for next item recommendation. In: Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 2019, 582–590

[34] Wang C K, McAuley J. Self-attentive sequential recommendation. In: Proceedings of 2018 IEEE International Conference on Data Mining. 2018, 197–206

[35] Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P. BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 1441–1450

[36] Zhou K, Wang H, Zhao W X, Zhu Y, Wang S, Zhang F, Wang Z, Wen J R. S3-Rec: self-supervised learning for sequential recommendation with mutual information maximization. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 1893–1902

[37] Ma C, Ma L, Zhang Y, Sun J, Liu X, Coates M. Memory augmented graph neural networks for sequential recommendation. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 5045–5052

[38] Chang J, Gao C, Zheng Y, Hui Y, Niu Y, Song Y, Jin D, Li Y. Sequential recommendation with graph neural networks. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2021, 378–387

[39] Chen X, Li L, Pan W, Ming Z . A survey on heterogeneous one-class collaborative filtering. ACM Transactions on Information Systems, 2020, 38( 4): 35

[40] Loni B, Pagano R, Larson M, Hanjalic A. Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM Conference on Recommender Systems. 2016, 361–364

[41] Gao C, He X, Gan D, Chen X, Feng F, Li Y, Chua T S, Jin D. Neural multi-task recommendation from multi-behavior data. In: Proceedings of the 35th IEEE International Conference on Data Engineering. 2019, 1554–1557

[42] Jin B, Gao C, He X, Jin D, Li Y. Multi-behavior recommendation with graph convolutional networks. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 659–668

[43] Xia L, Huang C, Xu Y, Dai P, Zhang B, Bo L. Multiplex behavioral relation learning for recommendation via memory augmented transformer network. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 2397–2406

[44] Chen C, Zhang M, Zhang Y, Ma W, Liu Y, Ma S. Efficient heterogeneous collaborative filtering without negative sampling for recommendation. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 19–26

[45] Xia L, Huang C, Xu Y, Dai P, Zhang X, Yang H, Pei J, Bo L. Knowledge-enhanced hierarchical graph transformer network for multi-behavior recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 4486–4493

[46] Chen C, Ma W, Zhang M, Wang Z, He X, Wang C, Liu Y, Ma S. Graph heterogeneous multi-relational recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 3958–3966

[47] Guo L, Hua L, Jia R, Zhao B, Wang X, Cui B. Buying or browsing?: predicting real-time purchasing intent using attention-based deep network with multiple behavior. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2019, 1984–1992

[48] Hamilton W L, Ying R, Leskovec J. Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017, 1025–1035

[49] Glorot X, Bengio Y. Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 2010, 249–256

[50] van der Maaten L, Hinton G . Visualizing data using t-SNE. Journal of Machine Learning Research, 2008, 9( 86): 2579–2605

[51] Wang C, Ma W, Zhang M, Chen C, Liu Y, Ma S . Toward dynamic user intention: temporal evolutionary effects of item relations in sequential recommendation. ACM Transactions on Information Systems, 2021, 39( 2): 16

RIGHTS & PERMISSIONS

Higher Education Press