Proactive planning of bandwidth resource using simulation-based what-if predictions forWeb services in the cloud

Abstract

Resource planning is becoming an increasingly important and timely problem for cloud users. As more Web services are moved to the cloud, minimizing network usage is often a key driver of cost control. Most existing approaches focus on resources such as CPU, memory, and disk I/O. In particular, CPU receives the most attention from researchers, but the bandwidth is somehow neglected. It is challenging to predict the network throughput of modern Web services, due to the factors of diverse and complex response, evolvingWeb services, and complex network transportation. In this paper, we propose a methodology of what-if analysis, named Log2Sim, to plan the bandwidth resource of Web services. Log2Sim uses a lightweight workload model to describe user behavior, an automated mining approach to obtain characteristics of workloads and responses from massive Web logs, and traffic-aware simulations to predict the impact on the bandwidth consumption and the response time in changing contexts. We use a real-life Web system and a classic benchmark to evaluate Log2Sim in multiple scenarios. The evaluation result shows that Log2Sim has good performance in the prediction of bandwidth consumption. The average relative error is 2% for the benchmark and 8% for the real-life system. As for the response time, Log2Sim cannot produce accurate predictions for every single service request, but the simulation results always show similar trends on average response time with the increase of workloads in different changing contexts. It can provide sufficient information for the system administrator in proactive bandwidth planning.

Keywords

what-if analysis / bandwidth management / network simulation / Web service / log mining / resource planning / evolution / OPNET

References

[1] Goncalves M, Cunha M, Mendonca N C, Sampaio A. Performance inference: a novel approach for planning the capacity of IaaS cloud applications. In: Proceedings of the 8th IEEE International Conference on Cloud Computing. 2015, 813–820

[2] Wolke A, Bichler M, Setzer T. Planning vs. dynamic control: resource allocation in corporate clouds. IEEE Transactions on Cloud Computing, 2016, 4(3): 322–335

[3] Amiri M, Mohammad-Khanli L. Survey on prediction models of applications for resources provisioning in cloud. Journal of Network and Computer Applications, 2017, 82: 93–113

[4] Hu J, Huang L, Huang J, Sun T, Ouyang Y. What-if model construction and validation of Web systems based on log mining. In: Proceedings of the 24th Asia-Pacific Software Engineering Conference. 2017, 505–512

[5] Guzek M, Bouvry P, Talbi E G. A survey of evolutionary computation for resource management of processing in cloud computing. IEEE Computational Intelligence Magazine, 2015, 10(2): 53–67

[6] Kim K I, Wang W, Humphrey M. PICS: a public iaas cloud simulator. In: Proceedings of IEEE International Conference on Cloud Computing. 2015, 211–220

[7] Hu J, Huang L, Sun T, Xu Y, Gong X. Log2Sim: automating what-if modeling and prediction for bandwidth management of cloud hosted Web services. In: Proceedings of IEEE International Conference on Web Services. 2018, 99–106

[8] Ciancone A, Filieri A, Drago M L, Mirandola R, Grassi U. KlaperSuite: an integrated model-driven environment for reliability and performance analysis of component-based systems. In: Proceedings of the 49th International Conference on Objects, Models, Components, Patterns. 2011, 99–114

[9] Rathfelder C, Kounev S, Evans D. Capacity planning for event-based systems using automated performance predictions. In: Proceedings of the 26th IEEE/ACM International Conference on Automated Software Engineering. 2011, 352–361

[10] Garcia D F, Garcia J. TPC-W e-commerce benchmark evaluation. Computer, 2003, 36(2): 42–48

[11] Hu J, Huang L, Fan Y, Tong L, Hu W. Bandwidth planning of Web services in changing contexts based on network simulation. In: Proceedings of IEEE International Conference on Web Services. 2019, 242–246

[12] Bahga A, Madisetti V K. Synthetic workload generation for cloud computing applications. Journal of Software Engineering and Applications, 2011, 4(7): 396

[13] Abbors F, Truscan D, Ahmad T. Mining Web server logs for creating workload models. In: Proceedings of the 9th International Joint Conference on Software Technologies. 2015, 131–150

[14] Vogele C, van Hoorn A, Schulz E, Hasselbring W, Krcmar H. WESSBAS: extraction of probabilistic workload specifications for load testing and performance prediction-a model-driven approach for session-based application systems. Software and Systems Modeling, 2018, 17(2): 443–447

[15] Amza C, Cecchet E, Chanda A, Cox A L, Elnikety S, Gil R, et al. Specification and implementation of dynamic Web site benchmarks. In: Proceedings of IEEE International Workshop on Workload Characterization. 2002

[16] Oi H, Niboshi S. Workload analysis of SPECjEnterprise2010. In: Proceedings of IEEE International Symposium on Parallel and Distributed Processing with Applications. 2012

[17] Dan P, Moore A W. X-means: extending k-means with efficient estimation of the number of clusters. In: Proceedings of the 17th International Conference on Machine Learning. 2000, 727–734

[18] Becker S, Koziolek H, Reussner R. The Palladio component model for model-driven performance prediction. Journal of Systems and Software, 2009, 82(1): 3–22

[19] Varga A. Using the OMNeT++ discrete event simulation system in education. IEEE Transactions on Education, 1999, 42(4): 372

[20] Koziolek H. Performance evaluation of component-based software systems: a survey. Performance Evaluation, 2010, 67(8): 634–658

[21] Desnoyers P, Wood T, Shenoy P, Singh R, Patil S, Vin H. Modellus: automated modeling of complex internet data center applications. ACM Transactions on the Web, 2012, 6(2): 1–29

[22] Caban D, Walkowiak T. Prediction of the performance of Web based systems. In: Zamojski W, Sugier J, eds. Dependability Problems of Complex Information Systems. Springer International Publishing, 2015

[23] Hao W, Zhengxin Z, Jiacheng L, Kun Y, Ching-Hsien H. Multiple attributes QoS prediction via deep neural model with contexts. IEEE Transactions on Services Computing, 2018

[24] Tariq M, Zeitoun A, Ualancius V, Feamster H, Ammar M. Answering what-if deployment and configuration questions with wise. IEEE/ACM Transactions on Networking, 2013, 21(1): 1–13

[25] Zhang L, Zhang B, Pahl C, Xu L, Zhu Z. Personalized quality prediction for dynamic service management based on invocation patterns. In: Proceedings of International Conference on Service-Oriented Computing. 2013, 84–98

[26] Viswanath P, Pinkesh R. I-DBSCAN: a fast hybrid density based clustering method. In: Proceedings of International Conference on Pattern Recognition. 2006, 912–915

[27] Li Y, Liu B. A normalized Levenshtein distance metric. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(6): 1091–1095

[28] Cardwell N, Savage S, Anderson T. Modeling TCP latency. In: Proceedings of the 19th Joint Conference of the IEEE Computer and Communications Societies. 2002

[29] Cain H W, Rajwar R, Marden M, Lipasti MH. An architectural evaluation of Java TPC-W. In: Proceedings of the 17th International Symposium on High-Performance Computer Architecture. 2001

[30] Shyam G K, Manvi S S. Virtual resource prediction in cloud environment: a Bayesian approach. Journal of Network and Computer Applications, 2016, 65: 144–154

[31] Wang H, Wang L, Yu Q, Zheng Z, Lyu M, Bouguettaya A. Online reliability prediction via motifs-based dynamic bayesian networks for serviceoriented systems. IEEE Transactions on Software Engineering, 2016, 43(6): 556–579

[32] Stewart C, Shen K. Performance modeling and system management for multi-component online services. In: Proceedings of the International Symposium on Networked Systems Design and Implementation. 2005

[33] Alam F M, Mohan S, Fowler J W, Gopalakrishnan M. A discrete event simulation tool for performance management of Web-based application systems. Journal of Simulation, 2012, 6(1): 21–32

[34] Koziolek H, Schlich B, Becker S, Hauck M. Performance and reliability prediction for evolving service-oriented software systems. Empirical Software Engineering, 2013, 18(4): 746–790

[35] Zheng W, Bianchini R, Janakiraman G J, Santos J R, Turner Y. JustRunIt: experiment-based management of virtualized data centers. In: Proceedings of USENIX Annual Technical Conference. 2009

[36] Jayasinghe D, Swint G, Malkowski S, Li J, Wang Q, et al. Expertus: a generator approach to automate performance testing in iaas clouds. In: Proceedings of the 5th IEEE International Conference on Cloud Computing. 2012, 73–80

[37] Verdickt T, Dhoedt B, De Turck F, Demeester P. Hybrid performance modeling approach for network intensive distributed software. In: Proceedings of the 6th International Workshop on Software and Performance. 2007, 189–200

[38] Jung G, Mukherjee T, Kunde S, Kim H, Sharma N, Goetz F. CloudAdvisor: a recommendation-as-a-service platform for cloud configuration and pricing. In: Proceedings of the 9th IEEE World Congress on Services. 2013, 456–463

[39] Li A, Yang X, Kandula S, Zhan M. CloudCmp: comparing public cloud providers. In: Proceedings of the 2010 ACM SIGCOMM Conference on Internet Measurement. 2010

[40] Zheng Z, Ma H, Lyu M R, King I. Qos-aware Web service recommendation by collaborative filtering. IEEE Transactions on Services Computing, 2011, 4(2): 140–152

[41] Yu C, Huang L. A Web service qos prediction approach based on timeand- location-aware collaborative filtering. Service Oriented Computing and Applications, 2016, 10(2): 135–149

[42] Lo W, Yin J, Li Y, Wu Z. EfficientWeb service QoS prediction using local neighborhood matrix factorization. Engineering Applications of Artificial Intelligence, 2015, 38: 14–23

[43] Wu H, Yue K, Li B, Zhang B, Hsu C H. Collaborative QoS prediction with context-sensitive matrix factorization. Future Generation Computer Systems, 2018, 82: 669–678

RIGHTS & PERMISSIONS

2020 Higher Education Press