A correlative denoising autoencoder to model social influence for top-N recommender system

Abstract

In recent years, there are numerous works been proposed to leverage the techniques of deep learning to improve social-aware recommendation performance. In most cases, it requires a larger number of data to train a robust deep learning model, which contains a lot of parameters to fit training data. However, both data of user ratings and social networks are facing critical sparse problem, which makes it not easy to train a robust deep neural networkmodel. Towards this problem, we propose a novel correlative denoising autoencoder (CoDAE) method by taking correlations between users with multiple roles into account to learn robust representations from sparse inputs of ratings and social networks for recommendation. We develop the CoDAE model by utilizing three separated autoencoders to learn user featureswith roles of rater, truster and trustee, respectively. Especially, on account of that each input unit of user vectors with roles of truster and trustee is corresponding to a particular user, we propose to utilize shared parameters to learn common information of the units that corresponding to same users. Moreover, we propose a related regularization term to learn correlations between user features that learnt by the three subnetworks of CoDAE model. We further conduct a series of experiments to evaluate the proposed method on two public datasets for Top-N recommendation task. The experimental results demonstrate that the proposed model outperforms state-of-the-art algorithms on rank-sensitive metrics of MAP and NDCG.

Keywords

social network / recommender system / denoising autoencoder / neural network

References

[1] Leng J W, Jiang P Y. A deep learning approach for relationship extraction from interaction context in social manufacturing paradigm. Knowledge-Based Systems, 2016, 100: 188–199

[2] Wu Y Q, He F Z, Zhang D J, Li X X. Service-oriented feature-based data exchange for cloud-based design and manufacturing. IEEE Transactions on Services Computing, 2018, 11: 341–353

[3] Ma H, Yang H X, Lyu M R, King I. Sorec: social recommendation using probabilistic matrix factorization. In: Proceedings of the 17th ACM Conference on Information and Knowledge Management. 2008, 931–940

[4] Jamali M, Ester M. A matrix factorization technique with trust propagation for recommendation in social networks. In: Proceedings of the 4th ACM Conference on Recommender Systems. 2010, 135–142

[5] Ma H, Zhou T C, Lyu M R, King I. Improving recommender systems by incorporating social contextual information. ACM Transactions on Information Systems (TOIS), 2011, 29: 9

[6] Yang B, Lei Y, Liu D Y, Liu J M. Social collaborative filtering by trust. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence. 2013, 2747–2753

[7] Yao W L, He J, Huang G G, Zhang Y C. Modeling dual role preferences for trust-aware recommendation. In: Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval. 2014, 975–978

[8] Jiang M, Cui P, Liu R, Yang Q, Wang F, Zhu W W, Yang S Q. Social contextual recommendation. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management. 2012, 45–54

[9] Guo G B, Zhang J, Yorke-Smith N. Trustsvd: collaborative filtering with both the explicit and implicit influence of user trust and of item ratings. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2015, 123–129

[10] Krizhevsky A, Sutskever I, Hinton G E. Imagenet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems. 2012, 1097–1105

[11] He K M, Zhang X Y, Ren S Q, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016, 770–778

[12] Kalchbrenner N, Grefenstette E, Blunsom P. A convolutional neural network for modelling sentences. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. 2014, 655–665

[13] Bansal T, Belanger D, McCallum A. Ask the GRU: multi-task learning for deep text recommendations. In: Proceedings of the 10th ACM Conference on Recommender Systems. 2016, 107–114

[14] Zhang S D, He F Z, Ren W Q, Yao J. Joint learning of image detail and transmission map for single image dehazing. The Visual Computer, 2018,

[15] Hofmann T, Schölkopf B, Smola A J. Kernel methods in machine learning. The Annals of Statistics, 2008, 36: 1171–1220

[16] Li K, He F Z, Yu H P, Chen X. A correlative classifiers approach based on particle filter and sample set for tracking occluded target. Applied Mathematics-A Journal of Chinese Universities, 2017, 32: 294–312

[17] Li K, He F Z, Yu H P, Chen X. A parallel and robust object tracking approach synthesizing adaptive bayesian learning and improved incremental subspace learning. Frontiers of Computer Science, 2019, 13(5):1116–1135

[18] Li K, He F Z, Yu H P. Robust visual tracking based on convolutional features with illumination and occlusion handing. Journal of Computer Science and Technology, 2018, 33: 223–236

[19] Yu H P, He F Z, Pan Y T. A novel segmentation model for medical images with intensity inhomogeneity based on adaptive perturbation. Multimedia Tools and Applications, 2019, 78(9): 11779–11798

[20] Yu H P, He F Z, Pan Y T. A novel region-based active contour model via local patch similarity measure for image segmentation. Multimedia Tools and Applications, 2018, 77: 24097–24119

[21] Chen X, He F Z, Yu H P. A matting method based on full feature coverage. Multimedia Tools and Applications, 2019, 78(9): 11173–11201

[22] Li H R, He F Z, Yan X H. IBEA-SVM: an indicator-based evolutionary algorithm based on pre-selection with classification guided by SVM. Applied Mathematics—A Journal of Chinese Universities, 2019, 34: 1–26

[23] Sedhain S, Menon A K, Sanner S, Xie L X. Autorec: autoencoders meet collaborative filtering. In: Proceedings of the 24th International Conference on World Wide Web. 2015, 111–112

[24] Wang H, Wang N Y, Yeung D Y. Collaborative deep learning for recommender systems. In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2015, 1235–1244

[25] Wang H, Shi X J, Yeung D Y. Relational stacked denoising autoencoder for tag recommendation. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2015, 3052–3058

[26] He R N, Lin C B, Wang J G, McAuley J L. Sherlock: sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016, 3740–3746

[27] Wu Y, DuBois C, Zheng A X, Ester M. Collaborative denoising autoencoders for top-N recommender systems. In: Proceedings of the 9th ACMInternational Conference onWeb Search and DataMining. 2016, 153–162

[28] Deng S, Huang L, Xu G, Wu X, Wu Z. On deep learning for trust-aware recommendations in social networks. IEEE Transactions on Neural Networks and Learning Systems, 2017, 28: 1164–1177

[29] Vincent P, Larochelle H, Bengio Y, Manzagol P A. Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th International Conference on Machine Learning. 2008, 1096–1103

[30] Koren Y, Bell R, Volinsky C. Matrix factorization techniques for recommender systems. Computer, 2009, 42: 30–37

[31] Wang Z J, Yang Y, Hu Q M, He L. An empirical study of personal factors and social effects on rating prediction. In: Proceedings of Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2015, 747–758

[32] Guo L, Wen Y F, Wang X H. Exploiting pre-trained network embeddings for recommendations in social networks. Journal of Computer Science and Technology, 2018, 33: 682–696

[33] Wang M Q, Wu Z Y, Sun X X, Feng G Z, Zhang B Z. Trust-aware collaborative filtering with a denoising autoencoder. Neural Processing Letters, 2019, 49(2): 835–849

[34] Wu Z M, Aggarwal C C, Sun J M. The troll-trust model for ranking in signed networks. In: Proceedings of the 9th ACM International Conference on Web Search and Data Mining. 2016, 447–456

[35] Pan Y T, He F Z, Yu H P. A novel enhanced collaborative autoencoder with knowledge distillation for top-N recommender systems. Neurocomputing, 2019, 332: 137–148

[36] Rendle S, Balby Marinho L, Nanopoulos A, Schmidt-Thieme L. Learning optimal ranking with tensor factorization for tag recommendation. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2009, 727–736

[37] Zhang Y F, Ai Q Y, Chen X, Croft W B. Joint representation learning for top-N recommendation with heterogeneous information sources. In: Proceedings of the 2017 ACM Conference on Information and Knowledge Management. 2017, 1449–1458

[38] Tang J L, Gao H J, Liu H, Das Sarma A. Etrust: understanding trust evolution in an online world. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2012, 253–261

[39] Liu N N, Yang Q. Eigenrank: a ranking-oriented approach to collaborative filtering. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 2008, 83–90

[40] Rafailidis D, Crestani F. Collaborative ranking with social relationships for top-N recommendations. In: Proceedings of the 39th International ACMSIGIR Conference on Research and Development in Information Retrieval. 2016, 785–788

[41] Koren Y. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2008, 426–434

[42] Guo L, Ma J, Jiang H R, Chen Z M, Xing C M. Social trust aware item recommendation for implicit feedback. Journal of Computer Science and Technology, 2015, 30: 1039–1053

[43] Pan W K, Chen L. GBPR: group preference based bayesian personalized ranking for one-class collaborative filtering. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence. 2013, 2691–2697

[44] Zhao T, McAuley J L, King I. Leveraging social connections to improve personalized ranking for collaborative filtering. In: Proceedings of the 23rd ACM International Conference on Information and Knowledge Management. 2014, 261–270

[45] Zhou Y, He F Z, Qiu Y M. Dynamic strategy based parallel ant colony optimization on GPUs for TSPs. Science China Information Sciences, 2017, 60: 068102

[46] Zhou Y, He F Z, Hou N, Qiu Y M. Parallel ant colony optimization on multi-core SIMD CPUs. Future Generation Computer Systems, 2018, 79: 473–487

[47] Zhang D J, He F Z, Han S H, Li X X. Quantitative optimization of interoperability during feature-based data exchange. Integrated Computer-Aided Engineering, 2016, 23: 31–50

[48] Chen Y L, He F Z, Wu Y Q, Hou N. A local start search algorithm to compute exact hausdorff distance for arbitrary point sets. Pattern Recognition, 2017, 67: 139–148

[49] Lv X, He F Z, Cheng Y, Wu Y Q. A novel crdt-based synchronization method for real-time collaborative cad systems. Advanced Engineering Informatics, 2018, 38: 381–391

[50] Lv X, He F Z, Cai WW, Cheng Y. Supporting selective undo of stringwise operations for collaborative editing systems. Future Generation Computer Systems, 2018, 28: 41–62

[51] Yan X H, He F Z, Chen Y L. A novel hardware/software partitioning method based on position disturbed particle swarm optimization with invasive weed optimization. Journal of Computer Science and Technology, 2017, 32: 340–355

[52] Yan X H, He F Z, Hou N, Ai H J. An efficient particle swarm optimization for large-scale hardware/software co-design system. International Journal of Cooperative Information Systems, 2018, 27: 1741001

RIGHTS & PERMISSIONS

2019 Higher Education Press and Springer-Verlag GmbH Germany, part of Springer Nature