Rethinking the architecture design of data center networks

Abstract

In the rising tide of the Internet of things, more and more things in the world are connected to the Internet. Recently, data have kept growing at a rate more than four times of that expected in Moore’s law. This explosion of data comes from various sources such as mobile phones, video cameras and sensor networks, which often present multidimensional characteristics. The huge amount of data brings many challenges on the management, transportation, and processing IT infrastructures. To address these challenges, the state-of-art large scale data center networks have begun to provide cloud services that are increasingly prevalent. However, how to build a good data center remains an open challenge. Concurrently, the architecture design, which significantly affects the total performance, is of great research interest. This paper surveys advances in data center network design. In this paper we first introduce the upcoming trends in the data center industry. Then we review some popular design principles for today’s data center network architectures. In the third part, we present some up-to-date data center frameworks and make a comprehensive comparison of them. During the comparison, we observe that there is no so-called optimal data center and the design should be different referring to the data placement, replication, processing, and query processing. After that, several existing challenges and limitations are discussed. According to these observations, we point out some possible future research directions.

Keywords

data center networks / switch-based networks / direct networks / hybrid networks

References

[1] Yang M, Ni L M. Incremental design of scalable interconnection networks using basic building blocks. IEEE Transactions on Parallel and Distributed Systems, 2000, 11(11): 1126-1140

[2] Greenberg A, Hamilton J, Maltz D A, Patel P. The cost of a cloud: research problems in datacenter networks. ACM SIGCOMM Computer Communication Review, 2009, 39(1): 68-73

[3] Al-Fares M, Loukissas A, Vahdat A. A scalable commodity data center network architecture. In: Proceedings of the ACM SIGCOMM 2008 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2008, 63-74

[4] Guo C, Wu H, Tan K, Shi L, Zhang Y, Lu S. DCell: a scalable and faulttolerant network structure for data centers. In: Proceedings of the ACM SIGCOMM 2008 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2008, 75-86

[5] Guo C, Lu G, Li D, Wu H, Zhang X, Shi Y, Tian C, Zhang Y, Lu S. BCube: a high performance, server-centric network architecture for modular data centers. In: Proceedings of the ACM SIGCOMM 2009 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2009, 63-74

[6] Singla A, Singh A, Ramachandran K, Xu L, Zhang Y. Proteus: a topology malleable data center network. In: Proceedings of the 9th ACM workshop on Hot Topics in Networks. 2010

[7] Kliegl M, Lee J, Li J, Zhang X, Guo C, Rincon D. Generalized DCell structure for load-balanced data center Networks. In: Proceedings of 2010 INFOCOM IEEE Conference on Computer Communications Workshops. 2010

[8] Katayama Y, Takano K, Kohda Y, Ohba N, Nakano D. Wireless data center networking with steered-beam mmwave links. In: Proceedings of 2011 IEEE Wireless Communications and Networking Conference. 2011, 2179-2184

[9] Greenberg A G, Hamilton J R, Jain N, Kandula S, Kim C, Lahiri P, Maltz D A, Patel P, Sengupta S. VL2: a scalable and flexible data center network. In: Proceedings of the ACM SIGCOMM2009 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2009, 51-62

[10] Mysore R N, Pamboris A, Farrington N, Huang N, Miri P, Radhakrishnan S, Subramanya V, Vahdat A. PortLand: a scalable fault-tolerant layer 2 data center network fabric. In: Proceedings of the ACM SIGCOMM 2009 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2009, 39-50

[11] Costa P, Donnelly A, O’Shea G, Rowstron A. CamCube: a key-based data center. Technical Report, Microsoft Research, 2010

[12] Farrington N, Porter G, Radhakrishnan S, Bazzaz H H, Subramanya V, Fainman Y, Papen G, Vahdat A. Helios: a hybrid electrical/optical switch architecture for modular data centers. In: Proceedings of the ACM SIGCOMM 2010 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2010, 339-350

[13] Wang G, Andersen D G, Kaminsky M, Papagiannaki K, Ng T S E, Kozuch M, Ryan M P. c-Through: part-time optics in data centers. In: Proceedings of the ACM SIGCOMM 2010 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2010, 327-338

[14] Wu H, Lu G, Li D, Guo C, Zhang Y. Mdcube: a high performance network structure for modular datacenter interconnection. In: Proceedings of the 2009 ACM Conference on Emerging Networking Experiments and Technology. 2009, 25-36

[15] Halperin D, Kandula S, Padhye J, Bahl P, Wetherall D. Augmenting data center networks with multi-Gigabit wireless links. In: Proceedings of the ACM SIGCOMM 2011 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications. 2011, 38-49

[16] Zhang W, Zhou X, Yang L, Zhang Z, Zhao B Y, Zheng H. 3D beamforming for wireless data centers. In: Proceedings of the 10th ACM Workshop on Hot Topics in Networks. 2011

RIGHTS & PERMISSIONS

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg