Cloud-integrated cyber–physical systems: Reliability, performance and power consumption with shared-servers and parallelized services

Abstract

Cloud systems, which are typical cyber–physical systems, consist of physical nodes and virtualized facilities that collaborate to fulfill cloud computing services. The advent of virtualization technology engenders resource sharing and service parallelism in cloud services, introducing novel challenges to system modeling. In this study, we construct a systematic model that concurrently evaluates system reliability, performance, and power consumption (PC) while delineating cloud service disruptions arising from random hardware and software failures. Initially, we depict system states using a birth–death process that accommodates resource sharing and service parallelism. Given the relatively concise service duration and regular failure distributions, we employ transient-state transition probabilities instead of steady-state analysis. The birth–death process effectively links system reliability, performance, and PC through service durations governed by service assignment decisions and failure/repair distributions. Subsequently, we devise a multistage sample path randomization method to estimate system metrics and other factors related to service availability. The findings highlight that the trade-off between performance and PC, under the umbrella of reliability guarantees, hinges on the equilibrium between service duration and unit power. To further delve into the subject, we formulate optimization models for service assignment and juxtapose optimal decisions under varying availability scenarios, workload levels, and service attributes. Numerical results indicate that service parallelism can improve performance and conserve energy when the workload remains moderate. However, as the workload escalates, the repercussions of resource sharing-induced performance loss become more pronounced due to resource capacity limitations. In cases where system availability is constrained, resource sharing should be approached cautiously to ensure adherence to deadline requirements. This study theoretically analyzes the interrelations among system reliability, performance, and PC, offering valuable insights for making informed decisions in cloud service assignments.

Graphical abstract

Keywords

cloud service modeling / transient downtime analysis / resource sharing / service parallelism

References

[1] Al-Moalmi, A Luo, J Salah, A Li, K Yin, L (2021). A whale optimization system for energy-efficient container placement in data centers. Expert Systems with Applications, 164: 113719

[2] AmdahlG M (1967). Validity of the single processor approach to achieving large scale computing capabilities. In: Proceedings of the Spring Joint Computer Conference. Atlantic City, NJ: Association for Computing Machinery, 483–485

[3] Ataie, E Entezari-Maleki, R Etesami, S E Egger, B Sousa, L Movaghar, A (2022). Modeling and evaluation of dispatching policies in IaaS cloud data centers using SANs. Sustainable Computing: Informatics and Systems, 33: 100617

[4] BaiXLiMChenBTsaiW TGaoJ (2011). Cloud testing tools. In: Proceedings of 6th International Symposium on Service Oriented System. Irvine, CA: IEEE, 1–12

[5] Bennaceur, W M Kloul, L (2020). Formal models for safety and performance analysis of a data center system. Reliability Engineering & System Safety, 193: 106643

[6] Bora, S Walker, B Fidler, M (2023). The tiny-tasks granularity trade-off: Balancing overhead versus performance in parallel systems. IEEE Transactions on Parallel and Distributed Systems, 34( 4): 1128–1144

[7] Canosa-Reyes, R M Tchernykh, A Cortés-Mendoza, J M Pulido-Gaytan, B Rivera-Rodriguez, R Lozano-Rizk, J E Concepcion-Morales, E R Castro, Barrera H E Barrios-Hernandez, C J Medrano-Jaimes, F Avetisyan, A Babenko, M Drozdov, A Y (2022). Dynamic performance: Energy tradeoff consolidation with contention-aware resource provisioning in containerized clouds. PLoS One, 17( 1): e0261856

[8] Cao, X Bo, H Liu, Y Liu, X (2023). Effects of different resource-sharing strategies in cloud manufacturing: A Stackelberg game-based approach. International Journal of Production Research, 61( 2): 520–540

[9] Chinnathambi, S Santhanam, A Rajarathinam, J Senthilkumar, M (2019). Scheduling and checkpointing optimization algorithm for Byzantine fault tolerance in cloud clusters. Cluster Computing, 22( S6): 14637–14650

[10] Cotroneo, D de Simone, L Liguori, P Natella, R (2022). Fault injection analytics: A novel approach to discover failure modes in cloud-computing systems. IEEE Transactions on Dependable and Secure Computing, 19( 3): 1476–1491

[11] Du, A Y Smith, S D Yang, Z Qiao, C Ramesh, R (2015). Predicting transient downtime in virtual server systems: An efficient sample path randomization approach. IEEE Transactions on Computers, 64( 12): 3541–3554

[12] EshraghiNLiangB (2019). Joint offloading decision and resource allocation with uncertain task computing requirement. In: IEEE Conference on Computer Communications. Paris: IEEE, 1414–1422

[13] Fahmideh, M Beydoun, G Low, G (2019). Experiential probabilistic assessment of cloud services. Information Sciences, 502: 510–524

[14] FengWHuangM (2015). The research on service composition trust based on cloud computing. In: International Conference on Computer Science and Intelligent Communication. Zhengzhou: Atlantis Press, 291–294

[15] Garg, R Mittal, M Son, L H (2019). Reliability and energy efficient workflow scheduling in cloud environment. Cluster Computing, 22( 4): 1283–1297

[16] Guan, Z Ye, T Yin, R (2020). Channel coordination under Nash bargaining fairness concerns in differential games of goodwill accumulation. European Journal of Operational Research, 285( 3): 916–930

[17] GuoJChangZWangSDingHFengYMaoLBaoY (2019a). Who limits the resource efficiency of my datacenter: An analysis of Alibaba datacenter traces. In: Proceedings of the 27th International Symposium on Quality of Service. Phoenix, AZ: IEEE, 1–10

[18] Guo, M Guan, Q Chen, W Ji, F Peng, Z (2022). Delay-optimal scheduling of VMs in a queueing cloud computing system with heterogeneous workloads. IEEE Transactions on Services Computing, 15( 1): 110–123

[19] Guo, Z Li, J Ramesh, R (2019b). Optimal management of virtual infrastructures under flexible cloud service agreements. Information Systems Research, 30( 4): 1424–1446

[20] Guo, Z Li, J Ramesh, R (2020). Scalable, adaptable, and fast estimation of transient downtime in virtual infrastructures using convex decomposition and sample path randomization. INFORMS Journal on Computing, 32( 2): 321–345

[21] Guo, Z Li, J Ramesh, R (2023a). Green data analytics of supercomputing from massive sensor networks: Does workload distribution matter?. Information Systems Research, 34( 4): 1664–1685

[22] Guo, Z Zhang, Y Liu, S Wang, X V Wang, L (2023b). Exploring self-organization and self-adaption for smart manufacturing complex networks. Frontiers of Engineering Management, 10( 2): 206–222

[23] GuptaAAcunBSaroodOKaléL V (2014). Towards realizing the potential of malleable jobs. In: 21st International Conference on High Performance Computing. Goa: IEEE, 1–10

[24] HanXSchooleyRMackenzieDDavidOLloydW J (2020). Characterizing public cloud resource contention to support virtual machine co-residency prediction. In: IEEE International Conference on Cloud Engineering. Sydney: IEEE, 162–172

[25] Harchol-Balter, M (2021). Open problems in queueing theory inspired by datacenter computing. Queueing Systems, 97( 1–2): 3–37

[26] IbrahimMNabiSHussainRRazaM SImranMKazmiS M AOracevicAHussainF (2020). A comparative analysis of task scheduling approaches in cloud computing. In: 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing. Melbourne: IEEE, 681–684

[27] IslamM TKarunasekeraSBuyyaR (2017). dSpark: Deadline-based resource allocation for big data applications in apache spark. In: IEEE 13th International Conference on E-Science. Auckland: IEEE, 89–98

[28] IvanchenkoOKharchenkoVMorozBPonochovnyiYDegtyarevaL (2021). Availability assessment of a cloud server system: Comparing Markov and semi-Markov models. In: 11th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications. Cracow: IEEE, 1–6

[29] Izrailevsky, Y Bell, C (2018). Cloud reliability. IEEE Cloud Computing, 5( 3): 39–44

[30] Jian, C Ping, J Zhang, M (2021). A cloud edge-based two-level hybrid scheduling learning model in cloud manufacturing. International Journal of Production Research, 59( 16): 4836–4850

[31] Levitin, G Xing, L Dai, Y (2023). Optimizing partial component activation policy in multi-attempt missions. Reliability Engineering & System Safety, 235: 109251

[32] Li, M Feng, J Xu, S X (2023). Toward resilient cloud warehousing via a blockchain-enabled auction approach. Frontiers of Engineering Management, 10( 1): 20–38

[33] Li, X Y Liu, Y Lin, Y H Xiao, L H Zio, E Kang, R (2021). A generalized petri net-based modeling framework for service reliability evaluation and management of cloud data centers. Reliability Engineering & System Safety, 207: 107381

[34] Liang, Y Lu, M Shen, Z M Tang, R (2021). Data center network design for Internet-related services and cloud computing. Production and Operations Management, 30( 7): 2077–2101

[35] Lin, W Wang, H Zhang, Y Qi, D Wang, J Z Chang, V (2018). A cloud server energy consumption measurement system for heterogeneous cloud environments. Information Sciences, 468: 47–62

[36] Lin, W Wu, W He, L (2022). An on-line virtual machine consolidation strategy for dual improvement in performance and energy conservation of server clusters in cloud data centers. IEEE Transactions on Services Computing, 15( 2): 766–777

[37] Madni, S H H Abd-Latiff, M S Abdullahi, M Abdulhamid, S I M Usman, M J (2017). Performance comparison of heuristic algorithms for task scheduling in IaaS cloud computing environment. PLoS One, 12( 5): e0176321

[38] Malik, M K Singh, A Swaroop, A (2022). A planned scheduling process of cloud computing by an effective job allocation and fault-tolerant mechanism. Journal of Ambient Intelligence and Humanized Computing, 13( 2): 1153–1171

[39] N’Takpé, T Edgard, Gnimassoun J Oumtanaga, S Suter, F (2022). Data-aware and simulation-driven planning of scientific workflows on IaaS clouds. Concurrency and Computation, 34( 14): e6719

[40] Niño-Mora, J (2019). Resource allocation and routing in parallel multi-server queues with abandonments for cloud profit maximization. Computers & Operations Research, 103: 221–236

[41] Priya, V Sathiya Kumar, C Kannan, R (2019). Resource scheduling algorithm with load balancing for cloud service provisioning. Applied Soft Computing, 76: 416–424

[42] Qiu, X Dai, Y Xiang, Y Xing, L (2016). A hierarchical correlation model for evaluating reliability, performance, and power consumption of a cloud service. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 46( 3): 401–412

[43] Qiu, X Dai, Y Xiang, Y Xing, L (2019). Correlation modeling and resource optimization for cloud service with fault recovery. IEEE Transactions on Cloud Computing, 7( 3): 693–704

[44] Qiu, X Sun, P Dai, Y (2021). Optimal task replication considering reliability, performance, and energy consumption for parallel computing in cloud systems. Reliability Engineering & System Safety, 215: 107834

[45] Sayadnavard, M H Toroghi Haghighat, A Rahmani, A M (2019). A reliable energy-aware approach for dynamic virtual machine consolidation in cloud data centers. Journal of Supercomputing, 75( 4): 2126–2147

[46] Setlur, A R Nirmala, S J Singh, H S Khoriya, S (2020). An efficient fault tolerant workflow scheduling approach using replication heuristics and checkpointing in the cloud. Journal of Parallel and Distributed Computing, 136: 14–28

[47] Sharma, Y Si, W Sun, D Javadi, B (2019). Failure-aware energy-efficient VM consolidation in cloud computing systems. Future Generation Computer Systems, 94: 620–633

[48] Tian, Y Tian, J Li, N (2020). Cloud reliability and efficiency improvement via failure risk based proactive actions. Journal of Systems and Software, 163: 110524

[49] Wang, F Laili, Y Zhang, L (2021a). A many-objective memetic algorithm for correlation-aware service composition in cloud manufacturing. International Journal of Production Research, 59( 17): 5179–5197

[50] Wang, S Li, X Ruiz, R (2020). Performance analysis for heterogeneous cloud servers using queueing theory. IEEE Transactions on Computers, 69( 4): 563–576

[51] Wang, T Zhou, J Li, L Zhang, G Li, K Hu, X S (2022). Deadline and reliability aware multiserver configuration optimization for maximizing profit. IEEE Transactions on Parallel and Distributed Systems, 33( 12): 3772–3786

[52] Wang, Y Zhang, L Yu, P Chen, K Qiu, X Meng, L Kadoch, M Cheriet, M (2021b). Reliability-oriented and resource-efficient service function chain construction and backup. IEEE eTransactions on Network and Service Management, 18( 1): 240–257

[53] Xu, X Mo, R Yin, X Khosravi, M R Aghaei, F Chang, V Li, G (2021). PDM: Privacy-aware deployment of machine-learning applications for industrial cyber–physical cloud systems. IEEE Transactions on Industrial Informatics, 17( 8): 5819–5828

[54] ZaloumisC (2022). Are your data centers keeping you from sustainability? Online Article

[55] ZhangCKumbhareA GManousakisIZhangDMisraP AAssisRWoolcockKMahalingamNWarrierBGauthierDKunnathLSolomonSMoralesOFontouraMBianchiniR (2021). Flex: High-availability datacenters with zero reserved power. In: ACM/IEEE 48th Annual International Symposium on Computer Architecture. Valencia: IEEE, 319–332

[56] Zhang, C Yao, J Qi, Z Yu, M Guan, H (2014). vGASA: Adaptive scheduling algorithm of virtualized GPU resource in cloud gaming. IEEE Transactions on Parallel and Distributed Systems, 25( 11): 3036–3045

[57] Zhang, P Fang, J Yang, C Huang, C Tang, T Wang, Z (2020). Optimizing streaming parallelism on heterogeneous many-core architectures. IEEE Transactions on Parallel and Distributed Systems, 31( 8): 1878–1896

Electronic Supplementary Material

Supplementary material is available in the online version of this article at https://doi.org/10.1007/s42524-023-0272-2 and is accessible for authorized users.

Competing Interests

The authors declare that they have no competing interests.

Open Access

This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

RIGHTS & PERMISSIONS

2024 The Author(s). This article is published with open access at link.springer.com and journal.hep.com.cn