Physically resource disaggregated data center: technique routes, design, and open issues

Abstract

Traditional server-based data centers suffer from low resource utilization, insufficient hardware scalability, insufficient resource usage elasticity, and low fault tolerance. With the ever-increasing network speed and processing power in hardware controllers, physically disaggregating the coupled resources in a server has been a promising trend for building next-generation data centers, as it effectively addresses the limitations of server-based data centers. Although some existing works follow this trend, how to build an efficient physically resource-disaggregated data center (PRD-DC) is still in the exploring stage. Thus, in this article, we first describe the trends and technique routes for PRD-DCs. Then, we present a potential solution for realizing a PRD-DC, named Serverless DC, including the I/O Processing Unit (IPU), SDC-kernel, and networking systems for controlling, managing, and connecting disaggregated storage/computing units respectively. Finally, some open research issues in PRD-DC are discussed.

Graphical abstract

Keywords

data center / resource disaggregation / serverless DC

References

[1] Bappy F H, Islam T, Zaman T S, Hasan R, Caicedo C. A deep dive into the google cluster workload traces: analyzing the application failure characteristics and user behaviors. In: Proceedings of the 10th International Conference on Future Internet of Things and Cloud (FiCloud). 2023, 103−108

[2] Jiang C , Qiu Y , Shi W , Ge Z, Wang J, Chen S, Cérin C, Ren Z, Xu G, Lin J. Characterizing Co-Located Workloads in Alibaba Cloud Datacenters.IEEE Transactions on Cloud Computing, 2022, 10(4): 2381-2397

[3] Hennessy J L, Patterson D A. Computer Architecture, Sixth Edition: A Quantitative Approach. 6th ed. San Francisco: Morgan Kaufmann Publishers Inc., 2017

[4] Zhang M, Li J . A commentary of GPT-3 in MIT technology review 2021. Fundamental Research, 2021, 1( 6): 831–833

[5] Jonas E, Schleier-Smith J, Sreekanti V, Tsai C C, Khandelwal A, Pu Q, Shankar V, Carreira J M, Krauth K, Yadwadkar N, Gonzalez J, Popa R A, Stoica I, Patterson D A. Cloud programming simplified: a Berkeley view on serverless computing. Technical Report No. UCB/EECS-2019-3. Berkeley: Electrical Engineering and Computer Sciences University of California at Berkeley, 2019

[6] Brooker M, Danilov M, Greenwood C, Piwonka P. On-demand container loading in AWS lambda. In: Proceedings of 2023 USENIX Annual Technical Conference (USENIX ATC 23). 2023, 315−328

[7] Nishida S, Shinkawa Y. A performance prediction model for google app engine. In: Proceedings of the 10th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC). 2015, 134−140

[8] Schroeder B, Gibson G A. Disk failures in the real world: what does an MTTF of 1, 000, 000 hours mean to you? In: Proceedings of the 5th USENIX Conference on File and Storage Technologies. 2007, 1

[9] Liu W, Burnett M C, Werthimer D, Kocz J. A 400Gbit Ethernet core enabling high data rate streaming from FPGAs to servers and GPUs in radio astronomy. 2024, arXiv preprint arXiv: 2411.15630

[10] Michalowicz B, Suresh K K, Subramoni H, Panda D K D, Poole S. Battle of the BlueFields: an in-depth comparison of the BlueField-2 and BlueField-3 SmartNICs. In: Proceedings of 2023 IEEE Symposium on High-Performance Interconnects (HOTI). 2023, 41−48

[11] The fungible DPU™: a new category of microprocessor for the data-centric era: hot chips 2020. In: Proceedings of 2020 IEEE Hot Chips 32 Symposium (HCS). 2020, 1−25

[12] Burres B, Daly D, Debbage M, Louzoun E, Severns-Williams C, Sundar N, Turbovich N, Wolford B, Li Y. Intel’s hyperscale-ready infrastructure processing unit (IPU). In: Proceedings of 2021 IEEE Hot Chips 33 Symposium (HCS). 2021, 1−16

[13] Lim K, Chang J, Mudge T, Ranganathan P, Reinhardt S K, Wenisch T F. Disaggregated memory for expansion and sharing in blade servers. In: Proceedings of the 36th Annual International Symposium on Computer Architecture. 2009, 267−278

[14] Guo Z, Shan Y, Luo X, Huang Y, Zhang Y. Clio: a hardware-software co-designed disaggregated memory system. In: Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems. 2022, 417−433

[15] Shan Y, Huang Y, Chen Y, Zhang Y. LegoOS: a disseminated, distributed OS for hardware resource disaggregation. In: Proceedings of the 13th USENIX Conference on Operating Systems Design and Implementation. 2018, 69−87

[16] Nitu V, Teabe B, Tchana A, Isci C, Hagimont D. Welcome to zombieland: practical and energy-efficient memory disaggregation in a datacenter. In: Proceedings of the 13th EuroSys Conference. 2018, 16

[17] Amaro E, Branner-Augmon C, Luo Z, Ousterhout A, Aguilera M K, Panda A, Ratnasamy S, Shenker S. Can far memory improve job throughput? In: Proceedings of the 15th European Conference on Computer Systems. 2020, 14

[18] Gu J, Lee Y, Zhang Y, Chowdhury M, Shin K. Efficient memory disaggregation with infiniswap. In: Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). 2017, 649−667

[19] Ruan Z, Schwarzkopf M, Aguilera M K, Belay A. AIFM: high-performance, application-integrated far memory. In: Proceedings of the 14th USENIX Conference on Operating Systems Design and Implementation. 2020

[20] Wang C, Ma H, Liu S, Li Y, Ruan Z, Nguyen K, Bond M D, Netravali R, Kim M, Xu G H. Semeru: a memory-disaggregated managed runtime. In: Proceedings of the 14th USENIX Conference on Operating Systems Design and Implementation. 2020, 15

[21] Keeton K. The machine: an architecture for memory-centric computing. In: Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers. 2015, 1

[22] Fang K, Peng D. NetDAM: network direct attached memory with programmable in-memory computing ISA. 2021, arXiv preprint arXiv: 2110.14902

[23] Ranger C, Raghuraman R, Penmetsa A, Bradski G, Kozyrakis C. Evaluating MapReduce for multi-core and multiprocessor systems. In: Proceedings of the 13th IEEE International Symposium on High Performance Computer Architecture. 2007, 13−24

[24] Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, Kudlur M, Levenberg J, Monga R, Moore S, Murray D G, Steiner B, Tucker P, Vasudevan V, Warden P, Wicke M, Yu Y, Zheng X. TensorFlow: a system for large-scale machine learning. In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. 2016, 265−283

[25] Gonzalez J E, Low Y, Gu H, Bickson D, Guestrin C. PowerGraph: distributed graph-parallel computation on natural graphs. In: Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation. 2012, 17−30

[26] Calciu I, Imran M T, Puddu I, Kashyap S, Al Maruf H, Mutlu O, Kolli A. Rethinking software runtimes for disaggregated memory. In: Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems. 2021, 79−92

[27] Guo Z, He Z, Zhang Y. Mira: a program-behavior-guided far memory system. In: Proceedings of the 29th Symposium on Operating Systems Principles. 2023, 692−708

[28] Tsai S Y, Payer M, Zhang Y. Pythia: remote oracles for the masses. In: Proceedings of the 28th USENIX Conference on Security Symposium. 2019, 693−710

RIGHTS & PERMISSIONS

Higher Education Press