Digital twin driven and intelligence enabled content delivery in end-edge-cloud collaborative 5G networks

Abstract

The rapid development of 5G/6G and AI enables an environment of Internet of Everything (IoE) which can support millions of connected mobile devices and applications to operate smoothly at high speed and low delay. However, these massive devices will lead to explosive traffic growth, which in turn cause great burden for the data transmission and content delivery. This challenge can be eased by sinking some critical content from cloud to edge. In this case, how to determine the critical content, where to sink and how to access the content correctly and efficiently become new challenges. This work focuses on establishing a highly efficient content delivery framework in the IoE environment. In particular, the IoE environment is re-constructed as an end-edge-cloud collaborative system, in which the concept of digital twin is applied to promote the collaboration. Based on the digital asset obtained by digital twin from end users, a content popularity prediction scheme is firstly proposed to decide the critical content by using the Temporal Pattern Attention (TPA) enabled Long Short-Term Memory (LSTM) model. Then, the prediction results are input for the proposed caching scheme to decide where to sink the critical content by using the Reinforce Learning (RL) technology. Finally, a collaborative routing scheme is proposed to determine the way to access the content with the objective of minimizing overhead. The experimental results indicate that the proposed schemes outperform the state-of-the-art benchmarks in terms of the caching hit rate, the average throughput, the successful content delivery rate and the average routing overhead.

Keywords

Digital twin / IoE / Content delivery / Caching / Routing

References

[1] C. Zhang, Y. Ueng, C. Studer, A. Burg, Artificial intelligence for 5G and beyond 5G: implementations, algorithms, and optimizations, IEEE J. Emerging Selected Topics Circuits Syst. 10 (2) (2020) 149-163.

[2] International Data Corporation, Smartphone growth to reach its highest level, 05, Available online: www. idc.com, 2021.

[3] D. Jiang, L. Huo, H. Song, Rethinking behaviors and activities of base stations in mobile cellular networks based on big data analysis, IEEE Transact. Network Sci. Eng. 7 (1) (2020) 80-90.

[4] X. Wang, Y. Han, V.C.M. Leung, D. Niyato, X. Yan, X. Chen, Convergence of edge computing and deep learning: a comprehensive survey, IEEE Commun. Surveys Tutorials 22 (2) (2020) 869-904.

[5] K. Zhang, S. Leng, Y. He, et al., Cooperative content caching in 5G networks with mobile edge computing, IEEE Wireless Commun. 25 (3) (2018) 80-87.

[6] T. Hou, G. Feng, S. Qin, W. Jiang, Proactive Content Caching by Exploiting Transfer Learning for Mobile Edge Computing, IEEE Global Communications Conference, Singapore, 2018, pp. 1-6.

[7] P. Yang, N. Zhang, S. Zhang, et al., Content popularity prediction towards location-aware mobile edge caching, IEEE Trans. Multimed. 21 (4) (2018) 915-929.

[8] D. Lee, J. Choi, J.H. Kim, et al., On the existence of a spectrum of policies that subsumes the least recently used and least frequently used policies, SIGMETRICS 99 (1999) 1-4.

[9] X. Zhou, M. Zhao, M. Wu,An in-network caching scheme based on betweenness and content popularity prediction in content centric networking, in: IEEE International Symposium on Personal, Indoor, and Mobile Radio Communications, 2016, pp. 1-6. Valencia, Spain.

[10] E. Batug, M. Bennis, M. Debbah, A Transfer Learning Approach for Cache-Enabled Wireless Networks, International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks, WiOpt, Mumbai, India, 2015, pp. 161-166.

[11] J. Song, M. Sheng, T.Q.S. Quek, C. Xu, X. Wang, Learningbased content caching and sharing for wireless networks, IEEE Trans. Commun. 65 (10) (2017) 4309-4324.

[12] H. Song, S. Chae, W. Shin, et al., Predictive caching via learning temporal distribution of content requests, IEEE Commun. Lett. 23 (12) (2019) 2335-2339.

[13] W. Jiang, G. Feng, S. Qin, et al., Multi-agent reinforcement learning based cooperative content caching for mobile edge networks, IEEE Access (7) (2019) 61856-61867.

[14] Y. Zhang, B. Feng, W. Quan, et al., Cooperative edge caching: a multi-agent deep learning based approach, IEEE Access (8) (2020) 133212-133224.

[15] C. Zhong, M. Gursoy, S. Velipasalar, Deep multi-agent reinforcement learning based cooperative edge caching in wireless networks, IEEE Int. Conf. Commun. (2019) 1-6.

[16] L. Ma, S. Cheng, Y. Shi, Enhancing learning efficiency of brain storm optimization via orthogonal learning design, IEEE Transact. Syst. Man Cybernetics: Systems (2020) 1-20.

[17] T. Rashid, M. Samvelyan, C.S. Witt, et al., QMIX: monotonic value function factorisation for deep multi-agent reinforcement learning,in: Proceedings of the 35th International Conference on Machine Learning, 2018, pp. 1-14. Stockholm, Sweden.

[18] M. Asadi-Aghbolaghi, A. Clapes, M. Bellantonio, et al., A survey on deep learning based approaches for action and gesture recognition in image sequences, in: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition, FG 2017, 2017, pp. 476-483.

[19] B. Yi, X. Wang, M. Huang, et al., Fairness-aware VNF sharing and rate coordination for high efficient service scheduling, IEEE Trans. Parallel Distr. Syst. (2022) 1-14, 01.

[20] P. Sunehag, G. Lever, Audre, et al., Value-Decomposition Networks for Cooperative Multi-Agent Learning Based on Team Reward, 2018, pp. 2085-2087.

[21] P. Hernandez-Leal, B. Kartal, M.E. Taylor, A survey and critique of multiagent deep reinforcement learning, Aut. Agents Multi-Agent Syst. 33 (6) (2019) 750-797.

[22] F. Marini, B. Walczak, Particle swarm optimization PSO. A tutorial, Chemometr. Intell. Lab. Syst. 149 (2015) 153-165.

[23] S. Katoch, S. Chauhan, V. Kumar, A review on genetic algorithm: past, present and future, Multimed. Tool. Appl. 80 (5) (2021) 8091-8126.