Towards parallel Metaverse: Symbiosis of physical and virtual worlds based on Cybertwin-enabled 6G^☆

Abstract

Metaverse, envisioned as the next evolution of the Internet, is expected to evolve into an innovative medium advancing information civilization. Its core characteristics, including ubiquity, seamlessness, immersion, interoperability and metaspatiotemporality, are catalyzing the development of multiple technologies and fostering a convergence between the physical and virtual worlds. Despite its potential, the critical concept of symbiosis, which involves the synchronous generation and management of virtuality from reality and serves as the cornerstone of this convergence, is often overlooked. Additionally, cumbersome service designs, stemming from the intricate interplay of various technologies and inefficient resource utilization, are impeding an ideal Metaverse ecosystem. To address these challenges, we propose a bi-model Parallel Symbiotic Metaverse (PSM) system, engineered with a Cybertwin-enabled 6G framework where Cybertwins mirror Sensing Devices (SDs) and serve a bridging role as autonomous agents. Based on this framework, the system is structured into two models. In the queue model, SDs capture environmental data that Cybertwins then coordinate and schedule. In the service model, Cybertwins manage service requests and collaborate with SDs to make responsive decisions. We incorporate two algorithms to address resource scheduling and virtual service responses, showcasing the synergistic role of Cybertwins. Moreover, our PSM system advocates for the participation of SDs from collaborators, enhancing performance while reducing operational costs for Virtual Service Operator (VSO). Finally, we comparatively analyze the efficiency and complexity of the proposed algorithms, and demonstrate the efficacy of the PSM system across multiple performance indicators. The results indicate our system can be deployed cost-effectively with Cybertwin-enabled 6G.

Keywords

Metaverse / Cybertwin-enabled 6G / Internet of Things (IoT) / Multiple-access Edge Computing (MEC) / Symbiosis of physical and virtual worlds

References

[1] N. Stephenson, Snow Crash: A Novel, Spectra, 2003.

[2] H. Wang, H. Ning, Y. Lin, W. Wang, S. Dhelim, F. Farha, J. Ding, M. Daneshmand, A survey on the metaverse: the state-of-the-art, technologies, applications, and chal-lenges, IEEE Internet Things J. 10 (16) (2023) 14671-14688.

[3] K. Li, Y. Cui, W. Li, T. Lv, X. Yuan, S. Li, W. Ni, M. Simsek, F. Dressler, When internet of things meets metaverse: convergence of physical and cyber worlds, IEEE Internet Things J. 10 (5) (2023) 4148-4173.

[4] R. Asif, S.R. Hassan, Exploring the confluence of iot and metaverse: future opportu-nities and challenges, IoT 4 (3) (2023) 412-429.

[5] X. Wang, J. Yang, J. Han, W. Wang, F.-Y. Wang, Metaverses and demetaverses: from digital twins in cps to parallel intelligence in cpss, IEEE Intell. Syst. 37 (4) (2022) 97-102.

[6] P. Schwenteck, G.T. Nguyen, H. Boche, W. Kellerer, F.H. Fitzek, 6g perspective of mo-bile network operators, manufacturers, and verticals, IEEE Netw. Lett. 5 (3) (2023) 169-172.

[7] J. Gu, J. Wang, X. Guo, G. Liu, S. Qin, Z. Bi, A metaverse-based teaching building evacuation training system with deep reinforcement learning, IEEE Trans. Syst. Man Cybern. Syst. 53 (4) (2023) 2209-2219.

[8] N. Mourad, H.A. Alsattar, S. Qahtan, A.A. Zaidan, M. Deveci, A.K. Sangaiah, W. Pedrycz, Optimising control engineering tools using digital twin capabilities and other cyber-physical metaverse manufacturing system components, IEEE Trans. Con-sum. Electron. (2023).

[9] W. Hyun, Study on standardization for interoperable metaverse, in: 2023 25th Inter-national Conference on Advanced Communication Technology (ICACT), IEEE, 2023, pp. 319-322.

[10] J.D.N. Dionisio, W.G.B. Iii, R. Gilbert, 3d virtual worlds and the metaverse: current status and future possibilities, ACM Comput. Surv. 45 (3) (2013) 1-38.

[11] J. Pan, J. McElhannon, Future edge cloud and edge computing for internet of things applications, IEEE Internet Things J. 5 (1) (2017) 439-449.

[12] H.X. Qin, P. Hui, Empowering the metaverse with generative ai: survey and future directions, in: 2023 IEEE 43rd International Conference on Distributed Computing Systems Workshops (ICDCSW), IEEE, 2023, pp. 85-90.

[13] J. Ahlgren, K. Bojarczuk, S. Drossopoulou, I. Dvortsova, J. George, N. Gucevska, M. Harman, M. Lomeli, S.M. Lucas, E. Meijer, et al., Facebook’s cyber-cyber and cyber-physical digital twins,in: Proceedings of the 25th International Conference on Evaluation and Assessment in Software Engineering, 2021, pp. 1-9.

[14] Y. Han, D. Niyato, C. Leung, C. Miao, D.I. Kim, A dynamic resource allocation framework for synchronizing metaverse with iot service and data, in: ICC 2022-IEEE International Conference on Communications, IEEE, 2022, pp. 1196-1201.

[15] Y. Han, D. Niyato, C. Leung, D.I. Kim, K. Zhu, S. Feng, X. Shen, C. Miao, A dynamic hi-erarchical framework for iot-assisted digital twin synchronization in the metaverse, IEEE Internet Things J. 10 (1) (2022) 268-284.

[16] E. Datsika, A. Antonopoulos, D. Yuan, C. Verikoukis, Matching theory for over-the-top service provision in 5g networks, IEEE Trans. Wirel. Commun. 17 (8) (2018) 5452-5464.

[17] X. Kong, Y. Wu, H. Wang, F. Xia, Edge computing for internet of everything: a survey, IEEE Internet Things J. 9 (23) (2022) 23472-23485.

[18] D.Y. Zhang, D. Wang, An integrated top-down and bottom-up task allocation ap-proach in social sensing based edge computing systems, in: IEEE INFOCOM 2019-IEEE Conference on Computer Communications, IEEE, 2019, pp. 766-774.

[19] Y. Wu, K. Zhang, Y. Zhang, Digital twin networks: a survey, IEEE Internet Things J. 8 (18) (2021) 13789-13804.

[20] Q. Yu, J. Ren, Y. Fu, Y. Li, W. Zhang, Cybertwin: an origin of next generation network architecture, IEEE Wirel. Commun. 26 (6) (2019) 111-117.

[21] P. Porambage, J. Okwuibe, M. Liyanage, M. Ylianttila, T. Taleb, Survey on multi-access edge computing for internet of things realization, IEEE Commun. Surv. Tutor. 20 (4) (2018) 2961-2991.

[22] Q. Yu, D. Liang, M. Qin, J. Chen, H. Zhou, J. Ren, Y. Li, J. Wu, Y. Gao, W. Zhang, Cy-bertwin based cloud native networks, J. Commun. Inf. Netw. 8 (3) (2023) 187-202.

[23] Y. Xia, Y. Zhang, L. Dai, Y. Zhan, Z. Guo, A brief survey on recent advances in cloud control systems, IEEE Trans. Circuits Syst. II, Express Briefs 69 (7) (2022) 3108-3114.

[24] X.-F. Han, H. Laga, M. Bennamoun, Image-based 3d object reconstruction: state-of-the-art and trends in the deep learning era, IEEE Trans. Pattern Anal. Mach. Intell. 43 (5) (2019) 1578-1604.

[25] T.L. da Silveira, P.G. Pinto, J. Murrugarra-Llerena, C.R. Jung, 3d scene geometry estimation from 360 imagery: a survey, ACM Comput. Surv. 55 (4) (2022) 1-39.

[26] S. Verykokou, C. Ioannidis, An overview on image-based and scanner-based 3d mod-eling technologies, Sensors 23 (2) (2023) 596.

[27] H. Niu, L. Wang, K. Du, Z. Lu, X. Wen, Y. Liu, A pipelining task offloading strategy via delay-aware multi-agent reinforcement learning in cybertwin-enabled 6g network, Digit. Commun. Netw. (2023).

[28] X. Zhong, Y. He, A cybertwin-driven task offloading scheme based on deep reinforce-ment learning and graph attention networks, in: 2021 13th International Conference on Wireless Communications and Signal Processing (WCSP), IEEE, 2021, pp. 1-6.

[29] M. Adhikari, A. Munusamy, N. Kumar, S.N. Srirama, Cybertwin-driven resource pro-visioning for ioe applications at 6g-enabled edge networks, IEEE Trans. Ind. Inform. 18 (7) (2021) 4850-4858.

[30] W. Hou, H. Wen, H. Song, W. Lei, W. Zhang, Multiagent deep reinforcement learn-ing for task offloading and resource allocation in cybertwin-based networks, IEEE Internet Things J. 8 (22) (2021) 16256-16268.

[31] T.K. Rodrigues, J. Liu, N. Kato, Application of cybertwin for offloading in mobile multiaccess edge computing for 6g networks, IEEE Internet Things J. 8 (22) (2021) 16231-16242.

[32] Y. Xu, H. Zhou, J. Chen, T. Ma, S. Shen, Cybertwin assisted wireless asynchronous federated learning mechanism for edge computing, in: 2021 IEEE Global Communi-cations Conference (GLOBECOM), IEEE, 2021, pp. 1-6.

[33] H. Liang, H. Li, W. Zhang, A combinatorial auction resource trading mechanism for cybertwin-based 6g network, IEEE Internet Things J. 8 (22) (2021) 16349-16358.

[34] J. Li, W. Shi, Q. Ye, S. Zhang, W. Zhuang, X. Shen, Joint virtual network topology design and embedding for cybertwin-enabled 6g core networks, IEEE Internet Things J. 8 (22) (2021) 16313-16325.

[35] S. Yan, Q. Ye, W. Zhuang, Learning-based transmission protocol customization for vod streaming in cybertwin-enabled next-generation core networks, IEEE Internet Things J. 8 (22) (2021) 16326-16336.

[36] C. Yu, W. Quan, D. Gao, Y. Zhang, K. Liu, W. Wu, H. Zhang, X. Shen, Reliable cybertwin-driven concurrent multipath transfer with deep reinforcement learning, IEEE Internet Things J. 8 (22) (2021) 16207-16218.

[37] S. Mystakidis, Metaverse, Encyclopedia 2 (1) (2022) 486-497.

[38] F. Shi, H. Ning, X. Zhang, R. Li, Q. Tian, S. Zhang, Y. Zheng, Y. Guo, M. Danesh-mand, A new technology perspective of the metaverse: its essence, framework and challenges, Digit. Commun. Netw. (2023).

[39] Y. Fu, C. Li, F.R. Yu, T.H. Luan, P. Zhao, S. Liu, A survey of blockchain and intelligent networking for the metaverse, IEEE Internet Things J. 10 (4) (2022) 3587-3610.

[40] Y. Wang, Z. Su, N. Zhang, R. Xing, D. Liu, T.H. Luan, X. Shen, A survey on meta-verse: fundamentals, security, and privacy, IEEE Commun. Surv. Tutor. 25 (1) (2022) 319-352.

[41] T. Huynh-The, Q.-V. Pham, X.-Q. Pham, T.T. Nguyen, Z. Han, D.-S. Kim, Artificial intelligence for the metaverse: a survey, Eng. Appl. Artif. Intell. 117 (2023) 105581.

[42] Z. Allam, A. Sharifi, S.E. Bibri, D.S. Jones, J. Krogstie, The metaverse as a virtual form of smart cities: opportunities and challenges for environmental, economic, and social sustainability in urban futures, Smart Cities 5 (3) (2022) 771-801.

[43] D. Wu, Z. Yang, P. Zhang, R. Wang, B. Yang, X. Ma, Virtual-reality interpromo-tion technology for metaverse: a survey, IEEE Internet Things J. 10 (18) (2023) 15788-15809.

[44] F. Arena, M. Collotta, G. Pau, F. Termine, An overview of augmented reality, Com-puters 11 (2) (2022) 28.

[45] J. Ratcliffe, F. Soave, N. Bryan-Kinns, L. Tokarchuk, I. Farkhatdinov, Extended reality (xr) remote research: a survey of drawbacks and opportunities,in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1-13.

[46] A. Yaqoob, T. Bi, G.-M. Muntean, A survey on adaptive 360 video streaming: so-lutions, challenges and opportunities, IEEE Commun. Surv. Tutor. 22 (4) (2020) 2801-2838.

[47] F. Relvas, D. Mendes, A. Ferreira, J. Jorge, Separating degrees of freedom for object manipulation in vr, in: 2016 23rd Portuguese Meeting on Computer Graphics and Interaction (EPCGI), IEEE, 2016, pp. 1-7.

[48] J. van der Hooft, H. Amirpour, M.T. Vega, Y. Sanchez, R. Schatz, T. Schierl, C. Timmerer, A tutorial on immersive video delivery: from omnidirectional video to holography, IEEE Commun. Surv. Tutor. 25 (2) (2023) 1336-1375.

[49] J.M. Boyce, R. Doré, A. Dziembowski, J. Fleureau, J. Jung, B. Kroon, B. Salahieh, V. K.M. Vadakital, L. Yu, Mpeg immersive video coding standard, Proc. IEEE 109 (9)(2021) 1521-1536.

[50] T. Kanade, P. Rander, P. Narayanan, Virtualized reality: constructing virtual worlds from real scenes, IEEE Multimed. 4 (1) (1997) 34-47.

[51] M. Fumarola, R. Poelman, Generating virtual environments of real world facilities: discussing four different approaches, Autom. Constr. 20 (3) (2011) 263-269.

[52] Q. Sun, L.-Y. Wei, A. Kaufman, Mapping virtual and physical reality, ACM Trans. Graph. 35 (4) (2016) 1-12.

[53] M. Sra, S. Garrido-Jurado, C. Schmandt, P. Maes, Procedurally generated virtual reality from 3d reconstructed physical space, in: Proceedings of the 22nd ACM Con-ference on Virtual Reality Software and Technology, 2016, pp. 191-200.

[54] L. Van Holland, P. Stotko, S. Krumpen, R. Klein, M. Weinmann, Efficient 3d recon-struction, streaming and visualization of static and dynamic scene parts for multi-client live-telepresence in large-scale environments,in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 4258-4272.

[55] F. Wang, S. Tan, X. Li, Z. Tian, Y. Song, H. Liu,Mixed neural voxels for fast multi-view video synthesis, in:Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 19706-19716.

[56] I. Alam, K. Sharif, F. Li, Z. Latif, M.M. Karim, S. Biswas, B. Nour, Y. Wang, A survey of network virtualization techniques for internet of things using sdn and nfv, ACM Comput. Surv. 53 (2) (2020) 1-40.

[57] I. Mavridis, H. Karatza, Combining containers and virtual machines to enhance iso-lation and extend functionality on cloud computing, Future Gener. Comput. Syst. 94 (2019) 674-696.

[58] S. Wijethilaka, M. Liyanage, Survey on network slicing for internet of things realiza-tion in 5g networks, IEEE Commun. Surv. Tutor. 23 (2) (2021) 957-994.

[59] E. Van Eyk, A. Iosup, S. Seif, M. Thömmes,The spec cloud group’s research vision on faas and serverless architectures, in:Proceedings of the 2nd International Workshop on Serverless Computing, 2017, pp. 1-4.

[60] H. Cui, S. Shen, X. Gao, Z. Hu, Batched incremental structure-from-motion, in: 2017 International Conference on 3D Vision (3DV), IEEE, 2017, pp. 205-214.

[61] F. Furrer, T. Novkovic, M. Fehr, A. Gawel, M. Grinvald, T. Sattler, R. Siegwart, J. Nieto, Incremental object database: building 3d models from multiple partial ob-servations, in: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2018, pp. 6835-6842.

[62] S.-C. Wu, K. Tateno, N. Navab, F. Tombari, Scfusion: real-time incremental scene reconstruction with semantic completion, in: 2020 International Conference on 3D Vision (3DV), IEEE, 2020, pp. 801-810.

[63] Q. Yu, J. Ren, H. Zhou, W. Zhang, A cybertwin based network architecture for 6g, in: 2020 2nd 6G Wireless Summit (6G SUMMIT), IEEE, 2020, pp. 1-5.

[64] Y. Mao, J. Zhang, K.B. Letaief, Dynamic computation offloading for mobile-edge computing with energy harvesting devices, IEEE J. Sel. Areas Commun. 34 (12)(2016) 3590-3605.

[65] Y. Cui, V.K. Lau, R. Wang, H. Huang, S. Zhang, A survey on delay-aware resource control for wireless systems—large deviation theory, stochastic Lyapunov drift, and distributed stochastic learning, IEEE Trans. Inf. Theory 58 (3) (2012) 1677-1701.

[66] J.D. Little, S.C. Graves, Little’s law, in: Building Intuition: Insights from Basic Oper-ations Management Models and Principles, 2008, pp. 81-100.

[67] H. Wu, J. Chen, T.N. Nguyen, H. Tang, Lyapunov-guided delay-aware energy ef-ficient offloading in iiot-mec systems, IEEE Trans. Ind. Inform. 19 (2) (2022) 2117-2128.

[68] D. Fernández, M.V. Solodov, Local convergence of exact and inexact augmented Lagrangian methods under the second-order sufficient optimality condition, SIAM J. Optim. 22 (2) (2012) 384-407.