NEXT: a neural network framework for next POI recommendation

Abstract

The task of next POI recommendations has been studied extensively in recent years. However, developing a unified recommendation framework to incorporate multiple factors associated with both POIs and users remains challenging, because of the heterogeneity nature of these information. Further, effective mechanisms to smoothly handle cold-start cases are also a difficult topic. Inspired by the recent success of neural networks in many areas, in this paper, we propose a simple yet effective neural network framework, named NEXT, for next POI recommendations. NEXT is a unified framework to learn the hidden intent regarding user’s next move, by incorporating different factors in a unified manner. Specifically, in NEXT, we incorporatemeta-data information, e.g., user friendship and textual descriptions of POIs, and two kinds of temporal contexts (i.e., time interval and visit time). To leverage sequential relations and geographical influence, we propose to adopt DeepWalk, a network representation learning technique, to encode such knowledge. We evaluate the effectiveness of NEXT against other state-of-the-art alternatives and neural networks based solutions. Experimental results on three publicly available datasets demonstrate that NEXT significantly outperforms baselines in real-time next POI recommendations. Further experiments show inherent ability of NEXT in handling cold-start.

Keywords

POI / neural networks / POI recommendation

References

[1] He X, Liao L, Zhang H, Nie L, Hu X, Chua T S. Neural collaborative filtering. In: Proceedings of International Conference on World Wide Web. 2017, 173–182

[2] Cheng C, Yang H, Lyu M R, King I. Where you like to go next: successive point-of-interest recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2013, 2605–2611

[3] Feng S, Li X, Zeng Y, Cong G, Chee Y M, Yuan Q. Personalized ranking metric embedding for next new POI recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2069–2075

[4] Ye M, Yin P, Lee W C, Lee D L. Exploiting geographical influence for collaborative point-of-interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2011, 325–334

[5] Li X, Cong G, Li X L, Pham T A N, Krishnaswamy S. Rank-GeoFM: a ranking based geographical factorization method for point of interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 433–442

[6] Ye M, Yin P, Lee W C. Location recommendation for location-based social networks. In: Proceedings of SIGSPATIAL International Conference on Advances in Geographic Information Systems. 2010, 458–461

[7] Xiong L, Chen X, Huang T K, Schneider J G, Carbonell J G. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: Proceedings of SIAM International Conference on Data Mining. 2010, 211–222

[8] Yuan Q, Cong G, Ma Z, Sun A, Thalmann N M. Time-aware point-ofinterest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2013, 363–372

[9] Xie M, Yin H, Wang H, Xu F, Chen W, Wang S. Learning graphbased POI embedding for location-based recommendation. In: Proceedings of ACMInternational Conference on Information and Knowledge Management. 2016, 15–24

[10] Zhang W, Wang J. Location and time aware social collaborative retrieval for new successive point-of-interest recommendation. In: Proceedings of ACMInternational Conference on Information and Knowledge Management. 2015, 1221–1230

[11] Yin H, Cui B, Zhou X, Wang W, Huang Z, Sadiq S. Joint modeling of user check-in behaviors for real-time point-of-interest recommendation. ACM Transaction on Information Systems, 2016, 35(2): 11

[12] Cheng C, Yang H, King I, Lyu M R. Fused matrix factorization with geographical and social influence in location-based social networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2012, 17–23

[13] Liu B, Fu Y, Yao Z, Xiong H. Learning geographical preferences for point-of-interest recommendation. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2013, 1043–1051

[14] Liu B, Xiong H, Papadimitriou S, Fu Y, Yao Z. A general geographical probabilistic factor model for point of interest recommendation. IEEE Transactions on Knowledge and Data Engineering, 2015, 27(5): 1167–1179

[15] Gao H, Tang J, Liu H. gSCorr: modeling geo-social correlations for new check-ins on location-based social networks. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2012, 1582–1586

[16] He J, Li X, Liao L, Song D, Cheung W K. Inferring a personalized next point-of-interest recommendation model with latent behavior patterns. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 137–143

[17] Zhao S, Zhao T, Yang H, Lyu M R, King I. STELLAR: spatialtemporal latent ranking for successive point-of-interest recommendation. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 315–322

[18] Mikolov T, Karafiát M, Burget L, Černocký J, Khudanpur S. Recurrent neural network based language model. In: Proceedings of Annual Conference of the International Speech Communication Association. 2010, 1045–1048

[19] Mikolov T, Chen K, Corrada G, Dean J. Efficient estimation of word representations in vector space. 2013, arXiv preprint arXiv: 1301.3781

[20] Cho K, Merrienboer B V, Gülçehre Ç, Bahdanau D, Bougares F, Schwenk H, Bengio Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014, 1724–1734

[21] Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. In: Proceedings of International Conference on Learning Representations. 2015

[22] Wang B, Liu K, Zhao J. Inner attention based recurrent neural networks for answer selection. In: Proceedings of Annual Meeting of the Association for Computational Linguistics. 2016, 1288–1297

[23] Allamanis M, Peng H, Sutton C. A convolutional attention network for extreme summarization of source code. In: Proceedings of International Conference on Machine Learning. 2016, 2091–2100

[24] Rumelhart D E, Hinton G E, Williams R J. Learning internal representations by error propagation. Technical Report, DTIC Document, 1985

[25] Werbos P J. Generalization of backpropagation with application to a recurrent gas market model. Neural Networks, 1988, 1(4): 339–356

[26] Bishop C M. Neural Networks for Pattern Recognition. Oxford: Oxford University Press, 1995

[27] Hornik K, Stinchcombe M B, White H. Multilayer feedforward networks are universal approximators. Neural Networks, 1989, 2(5): 359–366

[28] Covington P, Adams J, Sargin E. Deep neural networks for youtube recommendations. In: Proceedings of ACMConference on Recommender Systems. 2016, 191–198

[29] Kim D H, Park C, Oh J, Lee S, Yu H. Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of ACM Conference on Recommender Systems. 2016, 233–240

[30] Liu Q, Wu S, Wang L, Tan T. Predicting the next location: a recurrent model with spatial and temporal contexts. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 194–200

[31] Zheng L, Noroozi V, Philip S Y. Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of ACM International Conference on Web Search and Data Mining. 2017, 425–434

[32] Rendle S. Factorization machines with libFM. ACM Transactions Intelligent Systems and Technology, 2012, 3(3): 57

[33] Elman J L. Finding structure in time. Cognitive Science, 1990, 14(2): 179–211

[34] Yan R. i, poet: automatic poetry composition through recurrent neural networks with iterative polishing schema. In: Proceedings of International Joint Conference on Artificial Intelligence. 2016, 2238–2244

[35] Zhang Y, Dai H, Xu C, Feng J, Wang T, Bian J, Wang B, Liu T Y. Sequential click prediction for sponsored search with recurrent neural networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2014, 1369–1375

[36] Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation, 1997, 9(8): 1735–1780

[37] Chen X, Qiu X, Zhu C, Liu P, Huang X. Long short-term memory neural networks for Chinese word segmentation. In: Proceedings of Conference on Empirical Methods in Natural Language Processing. 2015, 1197–1206

[38] Rocktäschel T, Grefenstette E, Hermann K M, Kociský T, Blunsom P. Reasoning about entailment with neural attention. In: Proceedings of International Conference on Learning Representations. 2016

[39] Chung J, Gülçehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. In: Proceedings of 2014 Workshop on Deep Learning. 2014

[40] Manotumruksa J, Macdonald C, Ounis I. A deep recurrent collaborative filtering framework for venue recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2017, 1429–1438

[41] Feng J, Li Y, Zhang C, Sun F, Meng F, Guo A, Jin D. Deepmove: predicting human mobility with attentional recurrent networks. In: Proceedings of International Conference onWorldWideWeb. 2018, 1459–1468

[42] Perozzi B, Rami A R, Skiena S. Deepwalk: online learning of social representations. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710

[43] Cho E, Myers S A, Leskovec J. Friendship and mobility: user movement in location-based social networks. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2011, 1082–1090

[44] Zhang J D, Chow C Y. Geosoca: exploiting geographical, social and categorical correlations for point-of-interest recommendations. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 443–452

[45] Yang C, Liu Z, Zhao D, Sun M, Chang E Y. Network representation learning with rich text information. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2111–2117

[46] Chen J, Zhang Q, Huang X. Incorporate group information to enhance network embedding. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2016, 1901–1904

[47] Salakhutdinov R, Mnih A. Probabilistic matrix factorization. In: Proceedings of International Conference on Neural Information Processing Systems. 2007, 1257–1264

[48] Hu Y, Koren Y, Volinsky C. Collaborative filtering for implicit feedback datasets. In: Proceedings of IEEE International Conference on Data Mining. 2008, 263–272

[49] Srivastava N, Salakhutdinov R. Multimodal learning with deep boltzmannmachines. In: Proceedings of International Conference on Neural Information Processing Systems. 2012, 2231–2239

[50] Glorot X, Bordes A, Bengio Y. Deep sparse rectifier neural networks. In: Proceedings of International Conference on Artificial Intelligence and Statistics. 2011, 315–323

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag GmbH Germany, part of Springer Nature