A survey on sequential recommendation

Abstract

Different from most conventional recommendation problems, sequential recommendation (SR) focuses on learning users’ preferences by exploiting the internal order and dependency among the interacted items, which has received significant attention from both researchers and practitioners. In recent years, we have witnessed great progress and achievements in this field, necessitating a new survey. In this survey, we study the SR problem from a new perspective (i.e., the construction of an item’s properties), and summarize the most recent techniques used in sequential recommendation such as multi-modal SR, generative SR, LLM-powered SR, ultra-long SR, and data-augmented SR. Moreover, we introduce some frontier research topics in SR, e.g., open-domain SR, data-centric SR, cloud-edge collaborative SR, continuous SR, SR for good, and explainable SR. We believe that our survey could be served as a valuable roadmap for readers in this field.

Graphical abstract

Keywords

sequential recommendation / ID-based / side information / recent advancements / new problems

References

[1] Kang W C, McAuley J. Self-attentive sequential recommendation. In: Proceedings of 2018 IEEE International Conference on Data Mining. 2018, 197−206

[2] He R, Kang W C, McAuley J. Translation-based recommendation. In: Proceedings of the 11th ACM Conference on Recommender Systems. 2017, 161−169

[3] Yuan X, Duan D, Tong L, Shi L, Zhang C. ICAI-SR: item categorical attribute integrated sequential recommendation. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2021, 1687−1691

[4] Liu C, Li X, Cai G, Dong Z, Zhu H, Shang L. Noninvasive self-attention for side information fusion in sequential recommendation. In: Proceedings of the 35th AAAI Conference on Artificial intelligence. 2021, 4249–4256

[5] Devlin J, Chang M W, Lee K, Toutanova K. BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of 2019 Conference of the North American Chapter of the Association for Computational Linguistics. 2019, 4171−4186

[6] He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016, 770−778

[7] Yuan Z, Yuan F, Song Y, Li Y, Fu J, Yang F, Pan Y, Ni Y. Where to go next for recommender systems? ID-vs. Modality-based recommender models revisited. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023, 2639−2649

[8] Hou Y, Mu S, Zhao W X, Li Y, Ding B, Wen J R. Towards universal sequence representation learning for recommender systems. In: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2022, 585−593

[9] Ji J, Li Z, Xu S, Hua W, Ge Y, Tan J, Zhang Y. GenRec: large language model for generative recommendation. In: Proceedings of the 46th European Conference on Information Retrieval. 2024, 494−502

[10] Boz A, Zorgdrager W, Kotti Z, Harte J, Louridas P, Karakoidas V, Jannach D, Fragkoulis M. Improving sequential recommendations with LLMs. ACM Transactions on Recommender Systems, 2024, doi: 10.1145/3711667

[11] Pi Q, Zhou G, Zhang Y, Wang Z, Ren L, Fan Y, Zhu X, Gai K. Search-based user interest modeling with lifelong sequential behavior data for click-through rate prediction. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 2685−2692

[12] Xie X, Sun F, Liu Z, Wu S, Gao J, Zhang J, Ding B, Cui B. Contrastive learning for sequential recommendation. In: Proceedings of the 38th IEEE International Conference on Data Engineering. 2022, 1259−1273

[13] Wang S, Cao L, Wang Y, Sheng Q Z, Orgun M A, Lian D . A survey on session-based recommender systems. ACM Computing Surveys (CSUR), 2021, 54( 7): 154

[14] Li Z, Yang C, Chen Y, Wang X, Chen H, Xu G, Yao L, Sheng M . Graph and sequential neural networks in session-based recommendation: a survey. ACM Computing Surveys, 2024, 57( 2): 40

[15] Quadrana M, Cremonesi P, Jannach D . Sequence-aware recommender systems. ACM Computing Surveys (CSUR), 2018, 51( 4): 66

[16] Nasir M, Ezeife C I . A survey and taxonomy of sequential recommender systems for e-commerce product recommendation. SN Computer Science, 2023, 4( 6): 708

[17] Fang H, Zhang D, Shu Y, Guo G . Deep learning for sequential recommendation: algorithms, influential factors, and evaluations. ACM Transactions on Information Systems (TOIS), 2020, 39( 1): 10

[18] Boka T F, Niu Z, Neupane R B . A survey of sequential recommendation systems: techniques, evaluation, and future directions. Information Systems, 2024, 125: 102427

[19] Chen X, Li Z, Pan W, Ming Z. A survey on multi-behavior sequential recommendation, 2023. arXiv preprint arXiv: 2308. 15701

[20] Chen S, Xu Z, Pan W, Yang Q, Ming Z. A survey on cross-domain sequential recommendation. In: Proceedings of the 33rd International Joint Conference on Artificial Intelligence. 2024, 884

[21] Jing M, Zhu Y, Zang T, Wang K . Contrastive self-supervised learning in recommender systems: a survey. ACM Transactions on Information Systems, 2023, 42( 2): 59

[22] Lai R, Chen L, Chen R, Zhang C. A survey on data-centric recommender systems, 2024. arXiv preprint arXiv: 2401.17878

[23] Zhang X, Xu B, Li C, Zhou Y, Li L, Lin H. Side information-driven session-based recommendation: a survey, 2024. arXiv preprint arXiv: 2402.17129

[24] Hidasi B, Karatzoglou A, Baltrunas L, Tikk D. Session-based recommendations with recurrent neural networks. In: Proceedings of the 4th International Conference on Learning Representations. 2016

[25] Xie Y, Zhou P, Kim S. Decoupled side information fusion for sequential recommendation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022, 1611−1621

[26] Li Y, Ding Y, Chen B, Xin X, Wang Y, Shi Y, Tang R, Wang D. Extracting attentive social temporal excitation for sequential recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2021, 998−1007

[27] Hou Y, He Z, McAuley J, Zhao W X. Learning vector-quantized item representation for transferable sequential recommenders. In: Proceedings of ACM Web Conference 2023. 2023, 1162−1171

[28] Mobasher B, Dai H, Luo T, Nakagawa M. Using sequential and non-sequential patterns in predictive web usage mining tasks. In: Proceedings of 2002 IEEE International Conference on Data Mining. 2002, 669–672

[29] Rendle S, Freudenthaler C, Schmidt-Thieme L. Factorizing personalized Markov chains for next-basket recommendation. In: Proceedings of the 19th International Conference on World Wide Web. 2010, 811−820

[30] Hidasi B, Karatzoglou A. Recurrent neural networks with top-k gains for session-based recommendations. In: Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 2018, 843−852

[31] Lin X, Niu S, Wang Y, Li Y. K-plet recurrent neural networks for sequential recommendation. In: Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 2018, 1057−1060

[32] Niu S, Zhang R. Collaborative sequence prediction for sequential recommender. In: Proceedings of 2017 ACM on Conference on Information and Knowledge Management. 2017, 2239−2242

[33] Chen Q, Li G, Zhou Q, Shi S, Zou D . Double attention convolutional neural network for sequential recommendation. ACM Transactions on the Web, 2022, 16( 4): 19

[34] Tang J, Wang K. Personalized top-N sequential recommendation via convolutional sequence embedding. In: Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 2018, 565−573

[35] Yan A, Cheng S, Kang W C, Wan M, McAuley J. CosRec: 2D convolutional neural networks for sequential recommendation. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 2173−2176

[36] Sun F, Liu J, Wu J, Pei C, Lin X, Ou W, Jiang P. BERT4Rec: Sequential recommendation with bidirectional encoder representations from Transformer. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 1441−1450

[37] Petrov A, Macdonald C. A systematic review and replicability study of BERT4Rec for sequential recommendation. In: Proceedings of the 16th ACM Conference on Recommender Systems. 2022, 436−447

[38] Zhang Y, Wang X, Chen H, Zhu W. Adaptive disentangled transformer for sequential recommendation. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 3434−3445

[39] Zhou P, Ye Q, Xie Y, Gao J, Wang S, Kim J B, You C, Kim S. Attention calibration for Transformer-based sequential recommendation. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 3595−3605

[40] Liu Z, Liu S, Zhang Z, Cai Q, Zhao X, Zhao K, Hu L, Jiang P, Gai K. Sequential recommendation for optimizing both immediate feedback and long-term retention. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 1872−1882

[41] Fan Z, Liu Z, Wang Y, Wang A, Nazari Z, Zheng L, Peng H, Yu P S. Sequential recommendation via stochastic self-attention. In: Proceedings of ACM Web Conference 2022. 2022, 2036−2047

[42] Ren R, Liu Z, Li Y, Zhao W X, Wang H, Ding B, Wen J R. Sequential recommendation with self-attentive multi-adversarial network. In: Proceedings of the 43rd International ACM SIGIR conference on Research and Development in Information Retrieval. 2020, 89−98

[43] Wu L, Li S, Hsieh C J, Sharpnack J. SSE-PT: sequential recommendation via personalized transformer. In: Proceedings of the 14th ACM Conference on Recommender Systems. 2020, 328−337

[44] Li C, Wang Y, Liu Q, Zhao X, Wang W, Wang Y, Zou L, Fan W, Li Q. STRec: sparse transformer for sequential recommendations. In: Proceedings of the 17th ACM Conference on Recommender Systems. 2023, 101−111

[45] Cui Z, Cai Y, Wu S, Ma X, Wang L. Motif-aware sequential recommendation. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2021, 1738–1742

[46] Guo N, Liu X, Li S, Ma Q, Gao K, Han B, Zheng L, Guo S, Guo X . Poincaré heterogeneous graph neural networks for sequential recommendation. ACM Transactions on Information Systems, 2023, 41( 3): 1–26

[47] Du H, Shi H, Zhao P, Wang D, Sheng V S, Liu Y, Liu G, Zhao L. Contrastive learning with bidirectional transformers for sequential recommendation. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 396−405

[48] Yang Y, Huang C, Xia L, Huang C, Luo D, Lin K. Debiased contrastive learning for sequential recommendation. In: Proceedings of ACM Web Conference 2023. 2023, 1063−1073

[49] Lin G, Gao C, Zheng Y, Chang J, Niu Y, Song Y, Li Z, Jin D, Li Y. Dual-interest factorization-heads attention for sequential recommendation. In: Proceedings of ACM Web Conference 2023. 2023, 917−927

[50] Xu C, Xu J, Chen X, Dong Z, Wen J R. Dually enhanced propensity score estimation in sequential recommendation. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 2260−2269

[51] Ma M, Ren P, Chen Z, Ren Z, Liang H, Ma J, De Rijke M . Improving transformer-based sequential recommenders through preference editing. ACM Transactions on Information Systems, 2023, 41( 3): 71

[52] Xi X, Zhao Y, Liu Q, Ouyang L, Wu Y. Integrating offline reinforcement learning with transformers for sequential recommendation. In: Proceedings of the 17th ACM Conference on Recommender Systems. 2023, 1

[53] Fan Z, Liu Z, Wang S, Zheng L, Yu P S. Modeling sequences as distributions with uncertainty for sequential recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2021, 3019−3023

[54] de Souza Pereira Moreira G, Rabhi S, Lee J M, Ak R, Oldridge E. Transformers4Rec: Bridging the gap between NLP and sequential/session-based recommendation. In: Proceedings of the 15th ACM Conference on Recommender Systems. 2021, 143−153

[55] Zhu Y, Huang B, Jiang S, Yang M, Yang Y, Zhong W. Progressive self-attention network with unsymmetrical positional encoding for sequential recommendation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022, 2029−2033

[56] Lai V, Chen H, Yeh C C M, Xu M, Cai Y, Yang H. Enhancing transformers without self-supervised learning: a loss landscape perspective in sequential recommendation. In: Proceedings of the 17th ACM Conference on Recommender Systems. 2023, 791−797

[57] Liu Q, Yan F, Zhao X, Du Z, Guo H, Tang R, Tian F. Diffusion augmentation for sequential recommendation. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 1576−1586

[58] Li Z, Sun A, Li C . DiffuRec: a diffusion model for sequential recommendation. ACM Transactions on Information Systems, 2023, 42( 3): 66

[59] Wu Z, Wang X, Chen H, Li K, Han Y, Sun L, Zhu W. Diff4Rec: sequential recommendation with curriculum-scheduled diffusion augmentation. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 9329−9335

[60] Liu S, Liu J, Gu H, Li D, Lu T, Zhang P, Gu N. AutoSeqRec: autoencoder for efficient sequential recommendation. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 1493−1502

[61] Chen X, Li Q. Causality-driven user modeling for sequential recommendations over time. In: Companion Proceedings of ACM Web Conference 2024. 2024, 1400−1406

[62] Ding Y, Ma Y, Wong W K, Chua T S. Leveraging two types of global graph for sequential fashion recommendation. In: Proceedings of 2021 International Conference on Multimedia Retrieval. 2021, 73−81

[63] Peng B, Chen Z, Parthasarathy S, Ning X . Modeling sequences as star graphs to address over-smoothing in self-attentive sequential recommendation. ACM Transactions on Knowledge Discovery from Data, 2023, 18( 8): 207

[64] Zhou K, Yu H, Zhao W X, Wen J R. Filter-enhanced MLP is all you need for sequential recommendation. In: Proceedings of ACM Web Conference 2022. 2022, 2388−2399

[65] Jiang Y, Xu Y, Yang Y, Yang F, Wang P, Li C, Zhuang F, Xiong H . TRIMLP: a foundational MLP-like architecture for sequential recommendation. ACM Transactions on Information Systems, 2024, 42( 6): 157

[66] Long C, Yuan H, Fang J, Xian X, Liu G, Sheng V S, Zhao P . Learning global and multi-granularity local representation with MLP for sequential recommendation. ACM Transactions on Knowledge Discovery from Data, 2024, 18( 4): 87

[67] Sachdeva N, Manco G, Ritacco E, Pudi V. Sequential variational autoencoders for collaborative filtering. In: Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 2019, 600−608

[68] You J, Wang Y, Pal A, Eksombatchai P, Rosenburg C, Leskovec J. Hierarchical temporal convolutional networks for dynamic recommender systems. In: Proceedings of World Wide Web Conference. 2019, 2236−2246

[69] Zhang Q, Wu B, Sun Z, Ye Y . Gating augmented capsule network for sequential recommendation. Knowledge-Based Systems, 2022, 247: 108817

[70] Wang Z, Shen Y. Time-aware multi-interest capsule network for sequential recommendation. In: Proceedings of 2022 SIAM International Conference on Data Mining. 2022, 558−566

[71] Zhao X, Zhang L, Xia L, Ding Z, Yin D, Tang J. Deep reinforcement learning for list-wise recommendations, 2019. arXiv preprint arXiv: 1801.00209

[72] Antaris S, Rafailidis D. Sequence adaptation via reinforcement learning in recommender systems. In: Proceedings of the 15th ACM Conference on Recommender Systems. 2021, 714−718

[73] Jiang J, Zhang P, Luo Y, Li C, Kim J B, Zhang K, Wang S, Xie X, Kim S. AdaMCT: adaptive mixture of CNN-Transformer for sequential recommendation. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 976−986

[74] Wang J, Liu Q, Liu Z, Wu S. Towards accurate and interpretable sequential prediction: a CNN & attention-based feature extractor. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 1703−1712

[75] Huang X, Sang J, Yu J, Xu C . Learning to learn a cold-start sequential recommender. ACM Transactions on Information Systems (TOIS), 2022, 40( 2): 30

[76] Chen H, Huang B, Wang X, Zhou Y, Zhu W. Global-local graphformer: towards better understanding of user intentions in sequential recommendation. In: Proceedings of the 5th ACM International Conference on Multimedia in Asia. 2024, 8

[77] Ye Y, Xia L, Huang C. Graph masked autoencoder for sequential recommendation. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023, 321−330

[78] Zhang W, Chen Z, Zha H, Wang J . Learning from substitutable and complementary relations for graph-based sequential product recommendation. ACM Transactions on Information Systems (TOIS), 2021, 40( 2): 26

[79] Yin M, Wang H, Xu X, Wu L, Zhao S, Guo W, Liu Y, Tang R, Lian D, Chen E. APGL4SR: a generic framework with adaptive and personalized global collaborative information in sequential recommendation. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 3009−3019

[80] Baikalov V, Frolov E. End-to-end graph-sequential representation learning for accurate recommendations. In: Companion Proceedings of ACM Web Conference 2024. 2024, 501−504

[81] Tan L, Xu J, Gong D, Liu F. Recurrent attentive neural networks for sequential recommendation. In: Proceedings of 2023 International Conference on Communication Network and Machine Learning. 2024, 356−360

[82] Xu C, Zhao P, Liu Y, Xu J, Sheng V S S S, Cui Z, Zhou X, Xiong H. Recurrent convolutional neural network for sequential recommendation. In: Proceedings of World Wide Web Conference. 2019, 3398−3404

[83] Yu M, Zhu K, Zhao M, Yu J, Xu T, Jin D, Li X, Yu R . Learning neighbor user intention on user–item interaction graphs for better sequential recommendation. ACM Transactions on the Web, 2024, 18( 2): 21

[84] Tang J, Belletti F, Jain S, Chen M, Beutel A, Xu C, Chi E H. Towards neural mixture recommender for long range dependent user sequences. In: Proceedings of World Wide Web Conference. 2019, 1782−1793

[85] Alharbi N, Caragea D. Cross-domain self-attentive sequential recommendations. In: Saraswat M, Roy S, Chowdhury C, Gandomi A H, eds. Proceedings of International Conference on Data Science and Applications. Singapore: Springer, 2022, 601−614

[86] Ma H, Xie R, Meng L, Chen X, Zhang X, Lin L, Zhou J . Triple sequence learning for cross-domain recommendation. ACM Transactions on Information Systems, 2024, 42( 4): 91

[87] Cao J, Cong X, Sheng J, Liu T, Wang B. Contrastive cross-domain sequential recommendation. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 138−147

[88] Li J, Wang Y, McAuley J. Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th International Conference on Web Search and Data Mining. 2020, 322−330

[89] Cho J, Hyun D, Kang S, Yu H. Learning heterogeneous temporal patterns of user preference for timely recommendation. In: Proceedings of Web Conference 2021. 2021, 1274−1283

[90] Yuan E, Guo W, He Z, Guo H, Liu C, Tang R. Multi-behavior sequential transformer recommender. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022, 1642−1652

[91] Su J, Chen C, Lin Z, Li X, Liu W, Zheng X. Personalized behavior-aware transformer for multi-behavior sequential recommendation. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 6321−6331

[92] Li X, Chen H, Yu J, Zhao M, Xu T, Zhang W, Yu M. Global heterogeneous graph and target interest denoising for multi-behavior sequential recommendation. In: Proceedings of the 17th ACM International Conference on Web Search and Data Mining. 2024, 387−395

[93] Chen Z, Zhang W, Yan J, Wang G, Wang J. Learning dual dynamic representations on time-sliced user-item interaction graphs for sequential recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2021, 231−240

[94] Tran V A, Salha-Galvan G, Sguerra B, Hennequin R. Attention mixtures for time-aware sequential recommendation. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023, 1821−1826

[95] Fan Z, Liu Z, Zhang J, Xiong Y, Zheng L, Yu P S. Continuous-time sequential recommendation with temporal graph collaborative transformer. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2021, 433−442

[96] Chen Z, Wang W. Time interval-aware graph with self-attention for sequential recommendation. In: Proceedings of 2022 5th International Conference on Algorithms, Computing and Artificial Intelligence. 2023, 71

[97] Du X, Li X. Moving forward together: a multi-user pattern extraction neural model for sequential recommendations. In: Proceedings of 2023 6th International Conference on Artificial Intelligence and Pattern Recognition. 2024, 1355−1361

[98] Wang J, Ding K, Hong L, Liu H, Caverlee J. Next-item recommendation with sequential hypergraphs. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 1101−1110

[99] Huang L, Ma Y, Liu Y, Danny Du B, Wang S, Li D . Position-enhanced and time-aware graph convolutional network for sequential recommendations. ACM Transactions on Information Systems, 2023, 41( 1): 6

[100] Zhang Y, He Y, Wang J, Caverlee J. Adaptive hierarchical translation-based sequential recommendation. In: Proceedings of the Web Conference 2020. 2020, 2984−2990

[101] Huang C, Wang S, Wang X, Yao L. Dual contrastive transformer for hierarchical preference modeling in sequential recommendation. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023, 99−109

[102] Li M, Zhang Z, Zhao X, Wang W, Zhao M, Wu R, Guo R. AutoMLP: automated MLP for sequential recommendations. In: Proceedings of ACM Web Conference 2023. 2023, 1190−1198

[103] Xu Z, Pan W, Ming Z. A multi-view graph contrastive learning framework for cross-domain sequential recommendation. In: Proceedings of the 17th ACM Conference on Recommender Systems. 2023, 491−501

[104] Zheng X, Su J, Liu W, Chen C. DDGHM: dual dynamic graph with hybrid metric training for cross-domain sequential recommendation. In: Proceedings of the 30th ACM International Conference on Multimedia. 2022, 471−481

[105] Li Y, Li Q, Meng S, Hou J. Transformer-based rating-aware sequential recommendation. In: Proceedings of the 21st International Conference on Algorithms and Architectures for Parallel Processing. 2021, 759−774

[106] Zhang X, Xu B, Yang L, Li C, Ma F, Liu H, Lin H. Price DOES matter!: modeling price and interest preferences in session-based recommendation. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022, 1684−1693

[107] Huang X, Fang Q, Qian S, Sang J, Li Y, Xu C. Explainable interaction-driven user modeling over knowledge graph for sequential recommendation. In: Proceedings of the 27th ACM International Conference on Multimedia. 2019, 548−556

[108] Huang J, Zhao W X, Dou H, Wen J R, Chang E Y. Improving sequential recommendation with knowledge-enhanced memory networks. In: Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 2018, 505−514

[109] Zhai J, Zheng X, Wang C D, Li H, Tian Y. Knowledge prompt-tuning for sequential recommendation. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 6451−6461

[110] Wang P, Fan Y, Xia L, Zhao W X, Niu S, Huang J. KERL: a knowledge-guided reinforcement learning model for sequential recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 209−218

[111] Hu H, Guo W, Liu X, Liu Y, Tang R, Zhang R, Kan M Y. User behavior enriched temporal knowledge graphs for sequential recommendation. In: Proceedings of the 17th ACM International Conference on Web Search and Data Mining. 2024, 266−275

[112] Chen J, Cao Y, Zhang F, Sun P, Wei K. Sequential intention-aware recommender based on user interaction graph. In: Proceedings of 2022 International Conference on Multimedia Retrieval. 2022, 118−126

[113] Chen T, Wong R C W. An efficient and effective framework for session-based social recommendation. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 2021, 400−408

[114] Li C, Niu X, Luo X, Chen Z, Quan C. A review-driven neural model for sequential recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 2866−2872

[115] Zhang J, Mu X, Zhao P, Kang K, Ma C . Improving current interest with item and review sequential patterns for sequential recommendation. Engineering Applications of Artificial Intelligence, 2021, 104: 104348

[116] Huang B, Luo J, Du W, Pan W, Ming Z. Cascaded cross attention for review-based sequential recommendation. In: Proceedings of 2023 IEEE International Conference on Data Mining. 2023, 170−179

[117] Li M, Zhao X, Lyu C, Zhao M, Wu R, Guo R. MLP4Rec: a pure MLP architecture for sequential recommendations. In: Proceedings of the 31st International Joint Conference on Artificial Intelligence. 2022, 2138−2144

[118] Gao J, Zhao X, Li M, Zhao M, Wu R, Guo R, Liu Y, Yin D . SMLP4Rec: an efficient all-MLP architecture for sequential recommendations. ACM Transactions on Information Systems, 2024, 42( 3): 86

[119] Hsu C, Li C T. RetaGNN: relational temporal attentive graph neural networks for holistic sequential recommendation. In: Proceedings of Web Conference 2021. 2021, 2968−2979

[120] Zhou K, Wang H, Zhao W X, Zhu Y, Wang S, Zhang F, Wang Z, Wen J R. S3-Rec: Self-supervised learning for sequential recommendation with mutual information maximization. In: Proceedings of the 29th ACM international Conference on Information & Knowledge Management. 2020, 1893−1902

[121] Zhang T, Zhao P, Liu Y, Sheng V S, Xu J, Wang D, Liu G, Zhou X. Feature-level deeper self-attention network for sequential recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 4320−4326

[122] Hu H, Guo W, Liu Y, Kan M Y. Adaptive multi-modalities fusion in sequential recommendation systems. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 843−853

[123] Wang S, Shen B, Min X, He Y, Zhang X, Zhang L, Zhou J, Mo L. Aligned side information fusion method for sequential recommendation. In: Companion Proceedings of ACM Web Conference 2024. 2024, 112−120

[124] Zhou X, Lumbantoruan R, Ren Y, Chen L, Yang X, Shao J . Dynamic bi-layer graph learning for context-aware sequential recommendation. ACM Transactions on Recommender Systems, 2024, 2( 2): 14

[125] Smirnova E, Vasile F. Contextual sequence modeling for recommendation with recurrent neural networks. In: Proceedings of the 2nd Workshop on Deep Learning for Recommender Systems. 2017, 2−9

[126] Rakkappan L, Rajan V. Context-aware sequential recommendations withstacked recurrent neural networks. In: Proceedings of World Wide Web Conference. 2019, 3172−3178

[127] Zhang J, Lin F, Yang C, Jiang W. A new sequential prediction framework with spatial-temporal embedding. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022, 2282−2286

[128] Xue L, Yang D, Zhai S, Li Y, Xiao Y . Learning dual-view user representations for enhanced sequential recommendation. ACM Transactions on Information Systems, 2023, 41( 4): 86

[129] Zheng L, Chai H, Chen X, Jin J, Zhang W, Yu Y, Guo X, Ge C, Feng Z . Search-based time-aware graph-enhanced recommendation with sequential behavior data. ACM Transactions on Recommender Systems, 2024, 2( 4): 26

[130] Li H, Yu L, Niu X, Leng Y, Du Q . Sequential and graphical cross-domain recommendations with a multi-view hierarchical transfer gate. ACM Transactions on Knowledge Discovery from Data, 2023, 18( 1): 8

[131] Ji W, Liu X, Zhang A, Wei Y, Ni Y, Wang X. Online distillation-enhanced multi-modal Transformer for sequential recommendation. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 955−965

[132] Zhang J, Cheng Y, Ni Y, Pan Y, Yuan Z, Fu J, Li Y, Wang J, Yuan F. NineRec: a benchmark dataset suite for evaluating transferable recommendation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, doi: 10.1109/TPAMI.2024.3373868

[133] Mu S, Hou Y, Zhao W X, Li Y, Ding B. ID-agnostic user behavior pre-training for sequential recommendation. In: Proceedings of the 28th China Conference on Information Retrieval. 2022, 16−27

[134] Ni Y, Cheng Y, Liu X, Fu J, Li Y, He X, Zhang Y, Yuan F. A content-driven micro-video recommendation dataset at scale, 2023. arXiv preprint arXiv: 2309.15379

[135] Qu Z, Xie R, Xiao C, Kang Z, Sun X. The elephant in the room: rethinking the usage of pre-trained language model in sequential recommendation. In: Proceedings of the 18th ACM Conference on Recommender Systems. 2024, 53−62

[136] Zivic P, Vazquez H, Sánchez J. Scaling sequential recommendation models with transformers. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 1567−1577

[137] Li J, Wang M, Li J, Fu J, Shen X, Shang J, McAuley J. Text is all you need: learning language representations for sequential recommendation. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 1258−1267

[138] Wang J, Zeng Z, Wang Y, Wang Y, Lu X, Li T, Yuan J, Zhang R, Zheng H T, Xia S T. MISSRec: Pre-training and transferring multi-modal interest-aware sequence representation for recommendation. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 6548−6557

[139] Liang J, Zhao X, Li M, Zhang Z, Wang W, Liu H, Liu Z. MMMLP: multi-modal multilayer perceptron for sequential recommendations. In: Proceedings of ACM Web Conference 2023. 2023, 1109−1117

[140] Hidasi B, Quadrana M, Karatzoglou A, Tikk D. Parallel recurrent neural network architectures for feature-rich session-based recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems. 2016, 241−248

[141] Rajput S, Mehta N, Singh A, Keshavan R, Vu T, Heidt L, Hong L, Tay Y, Tran V Q, Samost J, Kula M, Chi E H. Recommender systems with generative retrieval. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 452

[142] Liu Z, Hou Y, McAuley J. Multi-behavior generative recommendation. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 1575−1585

[143] Wang W, Bao H, Lin X, Zhang J, Li Y, Feng F, Ng S K, Chua T S. Learnable item tokenization for generative recommendation. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 2400−2409

[144] Wang Y, Xun J, Hong M, Zhu J, Jin T, Lin W, Li H, Li L, Xia Y, Zhao Z, Dong Z. EAGER: two-stream generative recommender with behavior-semantic collaboration. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 3245–3254

[145] Zhu J, Jin M, Liu Q, Qiu Z, Dong Z, Li X. CoST: contrastive quantization based semantic tokenization for generative recommendation. In: Proceedings of the 18th ACM Conference on Recommender Systems. 2024, 969−974

[146] Liu H, Wei Y, Song X, Guan W, Li Y F, Nie L. MMGRec: multimodal generative recommendation with transformer model, 2024. arXiv preprint arXiv: 2404.16555

[147] Ding Y, Hou Y, Li J, McAuley J. Inductive generative recommendation via retrieval-based speculation, 2024. arXiv preprint arXiv: 2410.02939

[148] Geng S, Liu S, Fu Z, Ge Y, Zhang Y. Recommendation as language processing (RLP): a unified pretrain, personalized prompt & predict paradigm (P5). In: Proceedings of the 16th ACM Conference on Recommender Systems. 2022, 299−315

[149] Wang H, Liu X, Fan W, Zhao X, Kini V, Yadav D, Wang F, Wen Z, Tang J, Liu H. Rethinking large language model architectures for sequential recommendations, 2024. arXiv preprint arXiv: 2402.09543

[150] Li L, Zhang Y, Chen L. Prompt distillation for efficient LLM-based recommendation. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 1348−1357

[151] Wang Y, Tian C, Hu B, Yu Y, Liu Z, Zhang Z, Zhou J, Pang L, Wang X. Can small language models be good reasoners for sequential recommendation? In: Proceedings of ACM Web Conference 2024. 2024, 3876−3887

[152] Zheng Z, Chao W, Qiu Z, Zhu H, Xiong H. Harnessing large language models for text-rich sequential recommendation. In: Proceedings of ACM Web Conference 2024. 2024, 3207−3216

[153] Yang Z, Wu J, Luo Y, Zhang J, Yuan Y, Zhang A, Wang X, He X. Large language model can interpret latent space of sequential recommender, 2023. arXiv preprint arXiv: 2310.20487

[154] Bao K, Zhang J, Zhang Y, Wang W, Feng F, He X. TALLRec: an effective and efficient tuning framework to align large language model with recommendation. In: Proceedings of the 17th ACM Conference on Recommender Systems. 2023, 1007−1014

[155] Cui Y, Liu F, Wang P, Wang B, Tang H, Wan Y, Wang J, Chen J. Distillation matters: empowering sequential recommenders to match the performance of large language models. In: Proceedings of the 18th ACM Conference on Recommender Systems. 2024, 507−517

[156] Li X, Chen C, Zhao X, Zhang Y, Xing C. E4SRec: an elegant effective efficient extensible solution of large language models for sequential recommendation, 2023. arXiv preprint arXiv: 2312.02443

[157] Shen T, Wang H, Zhang J, Zhao S, Li L, Chen Z, Lian D, Chen E. Exploring user retrieval integration towards large language models for cross-domain sequential recommendation, 2024. arXiv preprint arXiv: 2406.03085

[158] Ren Y, Chen Z, Yang X, Li L, Jiang C, Cheng L, Zhang B, Mo L, Zhou J. Enhancing sequential recommenders with augmented knowledge from aligned large language models. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 345−354

[159] Hu J, Xia W, Zhang X, Fu C, Wu W, Huan Z, Li A, Tang Z, Zhou J. Enhancing sequential recommendation via LLM-based semantic embedding learning. In: Companion Proceedings of ACM Web Conference 2024. 2024, 103−111

[160] Wang B, Liu F, Zhang C, Chen J, Wu Y, Zhou S, Lou X, Wang J, Feng Y, Chen C, Wang C. LLM4DSR: leveraing large language model for denoising sequential recommendation, 2024. arXiv preprint arXiv: 2408.08208

[161] Xu W, Wu Q, Liang Z, Han J, Ning X, Shi Y, Lin W, Zhang Y. SLMRec: distilling large language models into small for sequential recommendation, 2024. arXiv preprint arXiv: 2405.17890

[162] Liu Q, Wu X, Wang W, Wang Y, Zhu Y, Zhao X, Tian F, Zheng Y. LLMEmb: large language model can be a good embedding generator for sequential recommendation, 2024. arXiv preprint arXiv: 2409.19925

[163] Zheng B, Lin Z, Liu E, Yang C, Bai E, Ling C, Zhao W X, Wen J R. A large language model enhanced sequential recommender for joint video and comment recommendation, 2024. arXiv preprint arXiv: 2403.13574

[164] Liu Q, Wu X, Zhao X, Wang Y, Zhang Z, Tian F, Zheng Y. Large language models enhanced sequential recommendation for long-tail user and item, 2024. arXiv preprint arXiv: 2405.20646v1

[165] Zhang X, Xu B, Wu Y, Zhong Y, Lin H, Ma F. FineRec: exploring fine-grained sequential recommendation. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 1599−1608

[166] Yang S, Ma W, Sun P, Ai Q, Liu Y, Cai M, Zhang M. Sequential recommendation with latent relations based on large language model. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 335−344

[167] Lin J, Shan R, Zhu C, Du K, Chen B, Quan S, Tang R, Yu Y, Zhang W. ReLLa: retrieval-enhanced large language models for lifelong sequential behavior comprehension in recommendation. In: Proceedings of ACM Web Conference 2024. 2024, 3497−3508

[168] Zhu J, Lin J, Dai X, Chen B, Shan R, Zhu J, Tang R, Yu Y, Zhang W. Lifelong personalized low-rank adaptation of large language models for recommendation, 2024. arXiv preprint arXiv: 2408.03533

[169] Geng B, Huan Z, Zhang X, He Y, Zhang L, Yuan F, Zhou J, Mo L. Breaking the length barrier: LLM-enhanced CTR prediction in long textual user behaviors. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 2311−2315

[170] Xin H, Sun Y, Wang C, Xiong H. LLMCDSR: enhancing cross-domain sequential recommendation with large language models. ACM Transactions on Information Systems, 2025, doi: 10.1145/3715099

[171] Qin J, Zhang W, Wu X, Jin J, Fang Y, Yu Y. User behavior retrieval for click-through rate prediction. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 2347−2356

[172] Chen Q, Xu Y, Pei C, Lv S, Zhuang T, Ge J. Efficient long sequential user data modeling for click-through rate prediction, 2022. arXiv preprint arXiv: 2209.12212

[173] Dong J, Sun F, Wu T, Wu X, Zhang W, Wang S . A hierarchical network with user memory matrix for long sequence recommendation. Wireless Communications and Mobile Computing, 2022, 2022( 1): 5457044

[174] Chang J, Zhang C, Fu Z, Zang X, Guan L, Lu J, Hui Y, Leng D, Niu Y, Song Y, Gai K. TWIN: two-stage interest network for lifelong user behavior modeling in CTR prediction at KuaiShou. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 3785−3794

[175] Si Z, Guan L, Sun Z, Zang X, Lu J, Hui Y, Cao X, Yang Z, Zheng Y, Leng D, Zheng K, Zhang C, Niu Y, Song Y, Gai K. TWIN V2: scaling ultra-long user behavior sequence modeling for enhanced CTR prediction at KuaiShou. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 4890–4897

[176] Gan M, Xiao K . R-RNN: extracting user recent behavior sequence for click-through rate prediction. IEEE Access, 2019, 7: 111767–111777

[177] Lin Q, Zhou W J, Wang Y, Da Q, Chen Q G, Wang B. Sparse attentive memory network for click-through rate prediction with long sequences. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 3312−3321

[178] Pi Q, Bian W, Zhou G, Zhu X, Gai K. Practice on long sequential user behavior modeling for click-through rate prediction. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2019, 2671−2679

[179] Zhang Y, Chen E, Jin B, Wang H, Hou M, Huang W, Yu R. Clustering based behavior sampling with long sequential data for CTR prediction. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022, 2195−2200

[180] Feng Z, Xie J, Li K, Qin Y, Wang P, Li Q, Yin B, Li X, Lin W, Wang S. Context-based fast recommendation strategy for long user behavior sequence in Meituan Waimai. In: Companion Proceedings of ACM Web Conference 2024. 2024, 355−363

[181] Hou R, Yang Z, Ming Y, Lu H, Zheng Z, Chen Y, Zeng Q, Chen M. Cross-domain lifelong sequential modeling for online click-through rate prediction. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 5116–5125

[182] Yue Z, Wang Y, He Z, Zeng H, McAuley J, Wang D. Linear recurrent units for sequential recommendation. In: Proceedings of the 17th ACM International Conference on Web Search and Data Mining. 2024, 930−938

[183] Liu L, Cai L, Zhang C, Zhao X, Gao J, Wang W, Lv Y, Fan W, Wang Y, He M, Liu Z, Li Q. LinRec: linear attention mechanism for long-term sequential recommender systems. In: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023, 289−299

[184] Guo T, Li X, Yang H, Liang X, Yuan Y, Hou J, Ke B, Zhang C, He J, Zhang S, Yu E, Ou W. Query-dominant user interest network for large-scale search ranking. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 629−638

[185] Cao Y, Zhou X, Feng J, Huang P, Xiao Y, Chen D, Chen S. Sampling is all you need on modeling long-term user behaviors for CTR prediction. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 2974−2983

[186] Shen K, Ding X, Zheng Z, Gong Y, Li Q, Liu Z, Zhang G. SEMINAR: search enhanced multi-modal interest network and approximate retrieval for lifelong sequential recommendation, 2024. arXiv preprint arXiv: 2407.10714

[187] Ren K, Qin J, Fang Y, Zhang W, Zheng L, Bian W, Zhou G, Xu J, Yu Y, Zhu X, Gai K. Lifelong sequential modeling with personalized memorization for user response prediction. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2019, 565−574

[188] Dang Y, Yang E, Guo G, Jiang L, Wang X, Xu X, Sun Q, Liu H. Uniform sequence better: time interval aware data augmentation for sequential recommendation. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence. 2023, 4225−4232

[189] Zhang S, Chen L, Wang C, Li S, Xiong H. Temporal graph contrastive learning for sequential recommendation. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 9359−9367

[190] Yin M, Wang H, Guo W, Liu Y, Zhang S, Zhao S, Lian D, Chen E. Dataset regeneration for sequential recommendation. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 3954−3965

[191] Fan Z, Liu Z, Peng H, Yu P S. Mutual Wasserstein discrepancy minimization for sequential recommendation. In: Proceedings of ACM Web Conference 2023. 2023, 1375−1385

[192] Xiao J, Pan W, Ming Z. A generic behavior-aware data augmentation framework for sequential recommendation. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 1578−1588

[193] Qiu R, Huang Z, Yin H, Wang Z. Contrastive learning for representation degeneration problem in sequential recommendation. In: Proceedings of the 15th ACM International Conference on Web Search and Data Mining. 2022, 813−823

[194] Han Y, Wang H, Wang K, Wu L, Li Z, Guo W, Liu Y, Lian D, Chen E. Efficient noise-decoupling for multi-behavior sequential recommendation. In: Proceedings of ACM Web Conference 2024. 2024, 3297–3306

[195] Liu Z, Fan Z, Wang Y, Yu P S. Augmenting sequential recommendation with pseudo-prior items via reversely pre-training transformer. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2021, 1608–1612

[196] Klenitskiy A, Volodkevich A, Pembek A, Vasilev A. Does it look sequential? An analysis of datasets for evaluation of sequential recommendations. In: Proceedings of the 18th ACM Conference on Recommender Systems. 2024, 1067−1072

[197] Sun A. On challenges of evaluating recommender systems in an offline setting. In: Proceedings of the 17th ACM Conference on Recommender Systems. 2023, 1284−1285

RIGHTS & PERMISSIONS

The Author(s) 2025. This article is published with open access at link.springer.com and journal.hep.com.cn