Resource management at the network edge for federated learning

Abstract

Federated learning has been explored as a promising solution for training machine learning models at the network edge, without sharing private user data. With limited resources at the edge, new solutions must be developed to leverage the software and hardware resources as the existing solutions did not focus on resource management for network edge, specially for federated learning. In this paper, we describe the recent work on resource management at the edge and explore the challenges and future directions to allow the execution of federated learning at the edge. Problems such as the discovery of resources, deployment, load balancing, migration, and energy efficiency are discussed in the paper.

Keywords

Resource management / Edge computing / Federated learning / Machine learning

References

[1] N.L. da Fonseca, R. Boutaba, Cloud Services, Networking and Management, John Wiley & Sons, 2015.

[2] L.F. Bittencourt, A. Goldman, E.R.M. Madeira, N.L.S. da Fonseca, R. Sakellariou, Scheduling in distributed systems: a cloud computing perspective, Comput. Sci. Rev. 30 (2018) 31-54.

[3] Gartner,What Edge Computing Means for Infrastructure and Operations Leaders, 2018. URL, https://gtnr.it/35Vj3Ed.

[4] Gartner, 3 ai trends for enterprise computing, URL, https://gtnr.it/3y7hnn7, 2017.

[5] Cisco,Cisco Annual Internet Report (2018-2023)-” White Paper, 2020.

[6] Y. Xiao, M. Krunz,Qoe and power efficiency tradeoff for fog computing networks with fog node cooperation, in: IEEE INFOCOM 2017 -IEEE Conference on Computer Communications, 2017, pp. 1-9.

[7] X. Wang, Y. Han, V.C. Leung, D. Niyato, X. Yan, X. Chen, Convergence of edge computing and deep learning: a comprehensive survey, IEEE Commun. Surv. Tutor. 22 (2) (2020) 869-904.

[8] L.U. Khan, S.R. Pandey, N.H. Tran, W. Saad, Z. Han, M.N.H. Nguyen, C.S. Hong, Federated learning for edge networks: resource optimization and incentive mechanism, IEEE Commun. Mag. 58 (10) (2020) 88-93.

[9] L.F. Bittencourt, J. Diaz-Montes, R. Buyya, O.F. Rana, M. Parashar, Mobility-aware application scheduling in fog computing, IEEE Cloud Comput. 4 (2) (2017) 26-35.

[10] L. Bittencourt, R. Immich, R. Sakellariou, N. Fonseca, E. Madeira, M. Curado, L. Villas, L. DaSilva, C. Lee, O. Rana, The internet of things, fog and cloud continuum: integration and challenges, Internet of Things 3-4 (2018) 134-155.

[11] S. Wang, T. Tuor, T. Salonidis, K.K. Leung, C. Makaya, T. He, K. Chan, When edge meets learning: adaptive control for resource-constrained distributed machine learning, in: IEEE INFOCOM 2018-IEEE Conference on Computer Communications, IEEE, 2018, pp. 63-71.

[12] S. Wang, T. Tuor, T. Salonidis, K.K. Leung, C. Makaya, T. He, K. Chan, Adaptive federated learning in resource constrained edge computing systems, IEEE J. Sel. Area. Commun. 37 (6) (2019) 1205-1221.

[13] J. Konečnỳ, H. B. McMahan, F. X. Yu, P. Richtárik, A. T. Suresh,D. Bacon, Federated Learning: Strategies for Improving Communication Efficiency, arXiv preprint arXiv:1610.05492.

[14] B. McMahan, E. Moore, D. Ramage, S. Hampson, B.A. y Arcas, Communication-efficient learning of deep networks from decentralized data, in:Artificial Intelligence and Statistics, 2017, pp. 1273-1282.

[15] A. Tak, S. Cherkaoui, Federated Edge Learning: Design Issues and Challenges, IEEE Network 35 (2) (2021) 252-258.

[16] P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, et al., Advances and Open Problems in Federated Learning, arXiv preprint arXiv:1912.04977.

[17] K. Toczé, S. Nadjm-Tehrani, A taxonomy for management and optimization of multiple resources in edge computing, Wireless Commun. Mobile Comput. 2018 (2018) 1-23.

[18] L.F. Bittencourt, R. Immich, R. Sakellariou, N.L.S. da Fonseca, E.R.M. Madeira, M. Curado, L. Villas, L.A. DaSilva, C. Lee, O. Rana, The internet of things, fog and cloud continuum: integration and challenges, Internet of Things 3-4 (2018) 134-155.

[19] C.-H. Hong, B. Varghese, Resource management in fog/edge computing: a survey on architectures, infrastructure, and algorithms, ACM Comput. Surv. 52 (5) (2019) 1-37.

[20] D. Xu, T. Li, Y. Li, X. Su, S. Tarkoma, T. Jiang, J. Crowcroft, P. Hui, Edge Intelligence: Architectures, Challenges and Applications, arXiv e-prints (2020) arXiv-2003.

[21] Q. Yang, Y. Liu, T. Chen, Y. Tong, Federated machine learning: concept and applications, ACM Trans. Intell. Syst. Technol. (TIST) 10 (2) (2019) 1-19.

[22] O.A. Wahab, A. Mourad, H. Otrok, T. Taleb, Federated machine learning: survey, multi-level classification, desirable criteria and future directions in communication and networking systems, IEEE Commun. Surv. Tutor. 23 (2) (2021) 1342-1397.

[23] F. Chen, M. Luo, Z. Dong, Z. Li,X. He, Federated Meta-Learning with Fast Convergence and Efficient Communication, arXiv preprint arXiv:1802.07876.

[24] J.C. Jiang, B. Kantarci, S. Oktug, T. Soyata, Federated learning in smart city sensing: challenges and opportunities, Sensors 20 (21) (2020) 6230.

[25] N.H. Tran, W. Bao, A. Zomaya, M.N. Nguyen, C.S. Hong, Federated learning over wireless networks: optimization model design and analysis, in: IEEE INFOCOM 2019-IEEE Conference on Computer Communications, IEEE, 2019, pp. 1387-1395.

[26] M. Aledhari, R. Razzak, R.M. Parizi, F. Saeed, Federated learning: a survey on enabling technologies, protocols, and applications, IEEE Access 8 (2020) 140699-140725.

[27] W.Y.B. Lim, N.C. Luong, D.T. Hoang, Y. Jiao, Y.-C. Liang, Q. Yang, D. Niyato, C. Miao, Federated learning in mobile edge networks: a comprehensive survey, IEEE Commun. Surv. Tutor. 22 (3) (2020) 2031-2063.

[28] Z. Yang, M. Chen, K.-K. Wong, H. V. Poor, S. Cui, Federated Learning for 6g: Applications, Challenges, and Opportunities, arXiv preprint arXiv:2101.01338.

[29] A. Tak, S. Cherkaoui, Federated edge learning: design issues and challenges, IEEE Netw. 35 (2) (2021) 252-258.

[30] K. Kaur, S. Garg, G.S. Aujla, N. Kumar, J.J.P.C. Rodrigues, M. Guizani, Edge computing in the industrial internet of things environment: software-defined-networks-based edge-cloud interplay, IEEE Commun. Mag. 56 (2) (2018) 44-51.

[31] R. Hussain, M. Amini, A. Kovalenko, Y. Feng, O. Semiari, Federated edge computing for disaster management in remote smart oil fields, in: 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City, IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), 2019, pp. 929-936.

[32] D. Kelaidonis, A. Rouskas, V. Stavroulaki, P. Demestichas, P. Vlacheas, A federated edge cloud-iot architecture, in: 2016 European Conference on Networks and Communications, EuCNC), 2016, pp. 230-234.

[33] I. Afolabi, J. Prados-Garzon, M. Bagaa, T. Taleb, P. Ameigeiras, Dynamic resource provisioning of a scalable e2e network slicing orchestration system, IEEE Trans. Mobile Comput. 19 (11) (2019) 2594-2608.

[34] J. Prados-Garzon, T. Taleb, M. Bagaa,Learnet: reinforcement learning based flow scheduling for asynchronous deterministic networks, in: ICC 2020-2020 IEEE International Conference on Communications (ICC), IEEE, 2020, pp. 1-6.

[35] Z. Zhou, X. Chen, E. Li, L. Zeng, K. Luo, J. Zhang, Edge intelligence: paving the last mile of artificial intelligence with edge computing, Proc. IEEE 107 (8) (2019) 1738-1762.

[36] T.S. Brisimi, R. Chen, T. Mela, A. Olshevsky, I.C. Paschalidis, W. Shi, Federated learning of predictive models from federated electronic health records, Int. J. Med. Inf. 112 (2018) 59-67.

[37] J. Xu, B.S. Glicksberg, C. Su, P. Walker, J. Bian, F. Wang, Federated learning for healthcare informatics, J. Healthcare Inform. Res. 5 (2020) 1-19.

[38] T. Yang, G. Andrew, H. Eichner, H. Sun, W. Li, N. Kong, D. Ramage,F. Beaufays, Applied Federated Learning: Improving Google Keyboard Query Suggestions, arXiv preprint arXiv:1812.02903.

[39] S. Samarakoon, M. Bennis, W. Saad, M. Debbah, Distributed federated learning for ultra-reliable low-latency vehicular communications, IEEE Trans. Commun. 68 (2)(2019) 1146-1159.

[40] M. Duan, D. Liu, X. Chen, Y. Tan, J. Ren, L. Qiao, L. Liang, Astraea: self-balancing federated learning for improving classification accuracy of mobile deep learning applications, in: 2019 IEEE 37th International Conference on Computer Design (ICCD), IEEE, 2019, pp. 246-254.

[41] J. Kang, Z. Xiong, D. Niyato, Y. Zou, Y. Zhang, M. Guizani, Reliable federated learning for mobile networks, IEEE Wireless Commun. 27 (2) (2020) 72-80.

[42] N. Rieke, J. Hancox, W. Li, F. Milletari, H.R. Roth, S. Albarqouni, S. Bakas, M. N. Galtier, B.A. Landman, K. Maier-Hein, et al., The future of digital health with federated learning, NPJ digit. med. 3 (1) (2020) 1-7.

[43] J. Xu, B.S. Glicksberg, C. Su, P. Walker, J. Bian, F. Wang, Federated learning for healthcare informatics, J. Healthcare Inform. Res. 5 (1) (2021) 1-19.

[44] W. Yang, Y. Zhang, K. Ye, L. Li, C.-Z. Xu, Ffd: a federated learning based method for credit card fraud detection,in: International Conference on Big Data, Springer, 2019, pp. 18-32.

[45] X. Wang, C. Wang, X. Li, V.C. Leung, T. Taleb, Federated deep reinforcement learning for internet of things with decentralized cooperative edge caching, IEEE Internet Things J. 7 (10) (2020) 9441-9455.

[46] A. Hard, K. Rao, R. Mathews, S. Ramaswamy, F. Beaufays, S. Augenstein, H. Eichner, C. Kiddon,D. Ramage, Federated Learning for Mobile Keyboard Prediction, arXiv preprint arXiv:1811.03604.

[47] Y. Liu, Y. Kang, C. Xing, T. Chen, Q. Yang, A secure federated transfer learning framework, IEEE Intell. Syst. 35 (4) (2020) 70-82.

[48] S. Feng, H. Yu, Multi-participant Multi-Class Vertical Federated Learning, arXiv preprint arXiv:2001.11154.

[49] Y. Liu, X. Zhang, L. Wang, Asymmetrically Vertical Federated Learning, arXiv preprint arXiv:2004.07427.

[50] Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin,V. Chandra, Federated Learning with Non-iid Data, arXiv preprint arXiv:1806.00582.

[51] J. Chen, X. Pan, R. Monga, S. Bengio,R. Jozefowicz, Revisiting Distributed Synchronous Sgd, arXiv preprint arXiv:1604.00981.

[52] Y. Chen, Y. Ning, H. Rangwala, Asynchronous Online Federated Learning for Edge Devices, arXiv preprint arXiv:1911.02134.

[53] C. Xie, S. Koyejo,I. Gupta, Asynchronous Federated Optimization, arXiv preprint arXiv:1903.03934.

[54] X. Wang, Y. Han, C. Wang, Q. Zhao, X. Chen, M. Chen, In-edge ai: intelligentizing mobile edge computing, caching and communication by federated learning, IEEE Netw. 33 (5) (2019) 156-165.

[55] R. Kobayashi, K. Adachi, Radio and computing resource allocation for minimizing total processing completion time in mobile edge computing, IEEE Access 7 (2019) 141119-141132.

[56] N. Wang, B. Varghese, M. Matthaiou, D.S. Nikolopoulos, Enorm: a framework for edge node resource management, IEEE Transactions on Services Computing 13 (6)(2020) 1086-1099.

[57] B. Varghese, N. Wang, J. Li,D. S. Nikolopoulos, Edge-as-a-service: towards Distributed Cloud Architectures, arXiv preprint arXiv:1710.10090.

[58] B. Amento, B. Balasubramanian, R.J. Hall, K. Joshi, G. Jung, K.H. Purdy, Focusstack: orchestrating edge clouds using location-based focus of attention, in: 2016 IEEE/ACM Symposium on Edge Computing (SEC), IEEE, 2016, pp. 179-191.

[59] I. Petri, O. Rana, L.F. Bittencourt, D. Balouek-Thomert, M. Parashar, Autonomics at the Edge: Resource Orchestration for Edge Native Applications, IEEE Internet Computing 25 (4) (2021) 21-29.

[60] D. Zeng, L. Gu, S. Pan, J. Cai, S. Guo, Resource management at the network edge: a deep reinforcement learning approach, IEEE Netw. 33 (3) (2019) 26-33.

[61] NVIDIA,Nvidia clara, An Application Framework Optimized for Healthcare and Life Sciences Developers, 2019. URL, https://developer.nvidia.com/clara.

[62] FATE, The fate authors. federated ai technology enabler, URL, https://www.fedai.org/, 2019.

[63] A. Boudi, M. Bagaa, P. Pöyhönen, T. Taleb, H. Flinck, Ai-based resource management in beyond 5g cloud native environment, IEEE Netw. 35 (2) (2021) 128-135.

[64] P. Liu, D. Willis, S. Banerjee, Paradrop: enabling lightweight multi-tenancy at the network's extreme edge, in: 2016 IEEE/ACM Symposium on Edge Computing (SEC), IEEE, 2016, pp. 1-13.

[65] Kubeedge Huawei,An Open Platform to Enable Edge Computing, 2018. URL, https://kubeedge.io/en/.

[66] C. Wang, R. Li, W. Li, C. Qiu, X. Wang, Simedgeintel: a open-source simulation platform for resource management in edge intelligence, J. Syst. Architect. 115 (2021) 102016.

[67] H.D. Chantre, N.L.S. da Fonseca, Multi-objective optimization for edge device placement and reliable broadcasting in 5g nfv-based small cell networks, IEEE J. Sel. Area. Commun. 36 (10) (2018) 2304-2317.

[68] A. Zavodovski, N. Mohan,J. Kangasharju, edisco: Discovering Edge Nodes along the Path, arXiv preprint arXiv:1805.01725.

[69] J.C. Guevara, N.L.S. da Fonseca, Task scheduling in cloud-fog computing systems, Peer Peer Netw, Appl 14 (2) (2021) 962-977.

[70] S. Khalili, O. Simeone, Inter-layer per-mobile optimization of cloud mobile computing: a message-passing approach, Trans. Emerg. Telecommun. Technol. 27 (6) (2016) 814-827.

[71] Y. Wang, S. Breedveld, B. Heijmen, S.F. Petit, Evaluation of plan quality assurance models for prostate cancer patients based on fully automatically generated pareto-optimal treatment plans, Phys. Med. Biol. 61 (11) (2016) 4268-4282.

[72] C. Jiang, J. Wan, H. Abbas, An edge computing node deployment method based on improved k-means clustering algorithm for smart manufacturing, IEEE Syst. J. 15 (2) (2021) 2230-2240.

[73] J.C. Guevara, L.F. Bittencourt, N.L.S. da Fonseca,Class of service in fog computing, in: 9th IEEE Latin-American Conference on Communications, LATINCOM 2017, Guatemala City, Guatemala, November 8-10, 2017, IEEE, 2017, pp. 1-6.

[74] J.C. Guevara, R. da Silva Torres, N.L.S. da Fonseca, On the classification of fog computing applications: a machine learning perspective, J. Netw. Comput. Appl. 159 (2020) 102596.

[75] R.A.C. da Silva, N.L.S. da Fonseca, On the location of fog nodes in fog-cloud infrastructures, Sensors 19 (11) (2019) 2445.

[76] M. Chen, M. Mozaffari, W. Saad, C. Yin, M. Debbah, C.S. Hong, Caching in the sky: proactive deployment of cache-enabled unmanned aerial vehicles for optimized quality-of-experience, IEEE J. Sel. Area. Commun. 35 (5) (2017) 1046-1061.

[77] K. Shanmugam, N. Golrezaei, A.G. Dimakis, A.F. Molisch, G. Caire, Femtocaching: wireless content delivery through distributed caching helpers, IEEE Trans. Inf. Theor. 59 (12) (2013) 8402-8413.

[78] Microsoft,Azure Iot Edge, 2019. URL, https://azure.microsoft.com/en-us/services/iot-edge/.

[79] E. Foundryt,About Edgex Foundry, 2019. URL, https://www.edgexfoundry.org/.

[80] Q. Li, Z. Wen, Z. Wu, S. Hu, N. Wang, B. He, A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection, arXiv preprint arXiv:1907.09693.

[81] H. Ludwig, N. Baracaldo, G. Thomas, Y. Zhou, A. Anwar, S. Rajamoni, Y. Ong, J. Radhakrishnan, A. Verma, M. Sinn, et al., Ibm Federated Learning: an Enterprise Framework White Paper V0. 1, arXiv preprint arXiv:2007.10987.

[82] N. Talagala, S. Sundararaman, V. Sridhar, D. Arteaga, Q. Luo, S. Subramanian, S. Ghanta, L. Khermosh, D. Roselli, ECO: harmonizing edge and cloud with ml/dl orchestration,in:USENIX Workshop on Hot Topics in Edge Computing (HotEdge 18), USENIX Association, Boston, MA, 2018. URL, https://www.usenix.org/conference/hotedge18/presentation/talagala.

[83] T. Nishio, R. Yonetani,Client selection for federated learning with heterogeneous resources in mobile edge, in: ICC 2019-2019 IEEE International Conference on Communications (ICC), IEEE, 2019, pp. 1-7.

[84] T. Li, M. Sanjabi, A. Beirami,V. Smith, Fair Resource Allocation in Federated Learning, arXiv preprint arXiv:1905.10497.

[85] X. Wang, R. Li, C. Wang, X. Li, T. Taleb, V.C. Leung, Attention-weighted federated deep reinforcement learning for device-to-device assisted heterogeneous collaborative edge caching, IEEE J. Sel. Area. Commun. 39 (1) (2020) 154-169.

[86] Z. Lin, X. Li, V. K. Lau, Y. Gong, K. Huang,Deploying Federated Learning in Large-Scale Cellular Networks: Spatial Convergence Analysis, arXiv preprint arXiv: 2103.06056.

[87] N.K. Giang, M. Blackstock, R. Lea, V.C.M. Leung, Developing iot applications in the fog: a distributed dataflow approach,in: 2015 5th International Conference on the Internet of Things, 2015, pp. 155-162.

[88] S. Hosseinalipour, S. Azam, C. Brinton, N. Michelusi, V. Aggarwal, D. Love, H. Dai,Multi-stage Hybrid Federated Learning over Large-Scale D2d-Enabled Fog Networks, arXiv preprint arXiv:2007.09511.

[89] D. Ye, R. Yu, M. Pan, Z. Han, Federated learning in vehicular edge computing: a selective model aggregation approach, IEEE Access 8 (2020) 23920-23935.

[90] A. Mtibaa, A. Fahim, K.A. Harras, M.H. Ammar, Towards resource sharing in mobile device clouds: power balancing across mobile devices, Comput. Commun. Rev. 43 (4) (2013) 51-56.

[91] C.-C. Hung, G. Ananthanarayanan, P. Bodik, L. Golubchik, M. Yu, P. Bahl, M. Philipose, Videoedge: processing camera streams using hierarchical clusters, in: 2018 IEEE/ACM Symposium on Edge Computing (SEC), IEEE, 2018, pp. 115-131.

[92] Y. Dai, D. Xu, S. Maharjan, Y. Zhang, Joint load balancing and offloading in vehicular edge computing and networks, IEEE Internet Things J. 6 (3) (2018) 4377-4387.

[93] Y. J. Cho, J. Wang, G. Joshi,Client Selection in Federated Learning: Convergence Analysis and Power-Of-Choice Selection Strategies, arXiv preprint arXiv: 2010.01243.

[94] M. Dayarathna, Y. Wen, R. Fan, Data center energy consumption modeling: a survey, IEEE Commun. Surv. Tutor. 18 (1) (2015) 732-794.

[95] Z. Yang, C. Pan, K. Wang, M. Shikh-Bahaei, Energy efficient resource allocation in uav-enabled mobile edge computing networks, IEEE Trans. Wireless Commun. 18 (9) (2019) 4576-4589.

[96] J. Zhang, X. Hu, Z. Ning, E.C.-H. Ngai, L. Zhou, J. Wei, J. Cheng, B. Hu, Energy-latency tradeoff for energy-aware offloading in mobile edge computing networks, IEEE Internet Things J. 5 (4) (2017) 2633-2645.

[97] K. Zhang, Y. Mao, S. Leng, Q. Zhao, L. Li, X. Peng, L. Pan, S. Maharjan, Y. Zhang, Energy-efficient offloading for mobile edge computing in 5g heterogeneous networks, IEEE Access 4 (2016) 5896-5907.

[98] Z. Yang, M. Chen, W. Saad, C.S. Hong, M. Shikh-Bahaei, Energy Efficient Federated Learning Over Wireless Communication Networks, IEEE Transactions on Wireless Communications 20 (3) (2021) 1935-1949.

[99] C.W. Zaw, S.R. Pandey, K. Kim, C.S. Hong, Energy-aware resource management for federated learning in multi-access edge computing systems, IEEE Access 9 (2021) 34938-34950.

[100] L. Li, D. Shi, R. Hou, H. Li, M. Pan, Z. Han,To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices, arXiv preprint arXiv:2012.11804.

[101] C.W. Zaw, C.S. Hong, A decentralized game theoretic approach for energy-aware resource management in federated learning, in: 2021 IEEE International Conference on Big Data and Smart Computing (BigComp), IEEE, 2021, pp. 133-136.

[102] Q. Zeng, Y. Du, K. Huang, K.K. Leung, Energy-efficient radio resource allocation for federated edge learning, in: 2020 IEEE International Conference on Communications Workshops (ICC Workshops), IEEE, 2020, pp. 1-6.

[103] L.F. Bittencourt, M.M. Lopes, I. Petri, O.F. Rana, Towards virtual machine migration in fog computing, in: 2015 10th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC), 2015, pp. 1-8.

[104] S. Yu, X. Chen, Z. Zhou, X. Gong, D. Wu,When deep reinforcement learning meets federated learning: intelligent multitimescale resource management for multiaccess edge computing in 5G ultradense network, IEEE Internet Things J 8 (4) (2021) 2238-2251.

[105] S. Wang, J. Xu, N. Zhang, Y. Liu, A survey on service migration in mobile edge computing, IEEE Access 6 (2018) 23511-23528.

[106] M. Chen, W. Li, G. Fortino, Y. Hao, L. Hu, I. Humar, A dynamic service migration mechanism in edge cognitive computing, ACM Trans. Internet Technol. 19 (2)(2019) 1-15.

[107] F. Callegati, W. Cerroni, Live migration of virtualized edge networks: analytical modeling and performance evaluation, in: 2013 IEEE SDN for Future Networks and Services (SDN4FNS), IEEE, 2013, pp. 1-6.

[108] D. Darsena, G. Gelli, A. Manzalini, F. Melito, F. Verde, Live migration of virtual machines among edge networks viawan links, in: 2013 Future Network & Mobile Summit, IEEE, 2013, pp. 1-10.

[109] W. Shi, J. Cao, Q. Zhang, Y. Li, L. Xu, Edge computing: vision and challenges, IEEE Internet Things J. 3 (5) (2016) 637-646.

[110] S. Shekhar, A. Gokhale, Dynamic resource management across cloud-edge resources for performance-sensitive applications, in: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), IEEE, 2017, pp. 707-710.

[111] A.S. Gomes, B. Sousa, D. Palma, V. Fonseca, Z. Zhao, E. Monteiro, T. Braun, P. Simoes, L. Cordeiro, Edge caching with mobility prediction in virtualized lte mobile networks, Future Generat. Comput. Syst. 70 (2017) 148-162.

[112] W. Bao, D. Yuan, Z. Yang, S. Wang, W. Li, B.B. Zhou, A.Y. Zomaya, Follow me fog: toward seamless handover timing schemes in a fog computing environment, IEEE Commun. Mag. 55 (11) (2017) 72-78.

[113] P. Bellavista, A. Zanni, M. Solimando, A migration-enhanced edge computing support for mobile devices in hostile environments, in: 2017 13th International Wireless Communications and Mobile Computing Conference (IWCMC), IEEE, 2017, pp. 957-962.

[114] E. Saurez, K. Hong, D. Lillethun, U. Ramachandran, B. Ottenwälder,Incremental deployment and migration of geo-distributed situation awareness applications in the fog, in:Proceedings of the 10th ACM International Conference on Distributed and Event-Based Systems, 2016, pp. 258-269.

[115] E. Foundryt, Meta-world: a benchmark and evaluation for multi-task and meta reinforcement learning, URL, https://meta-world.github.io/, 2019.

[116] K. Bonawitz, H. Eichner, W. Grieskamp, D. Huba, A. Ingerman, V. Ivanov, C. Kiddon, J. Konečnỳ, S. Mazzocchi, H. B. McMahan, et al., Towards Federated Learning at Scale: System Design, arXiv preprint arXiv:1902.01046.

[117] V. Smith, C.-K. Chiang, M. Sanjabi,A. Talwalkar, Federated Multi-Task Learning, arXiv preprint arXiv:1705.10467.

[118] Y. Zhang,Q. Yang, A Survey on Multi-Task Learning, arXiv preprint arXiv: 1707.08114.

[119] A. Fallah, A. Mokhtari, A. Ozdaglar,Personalized Federated Learning: A Meta-Learning Approach, arXiv preprint arXiv:2002.07948.

[120] Q. Wu, K. He, X. Chen, Personalized federated learning for intelligent iot applications: a cloud-edge based framework, IEEE Open J. Comput. Soc. 1 (2020) 35-44.

[121] V. Kulkarni, M. Kulkarni, A. Pant, Survey of personalization techniques for federated learning, in: 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4), IEEE, 2020, pp. 794-797.

[122] K. C. Sim, P. Zadrazil,F. Beaufays, An Investigation into On-Device Personalization of End-To-End Automatic Speech Recognition Models, arXiv preprint arXiv:1909.06678.

[123] T. Tuor, S. Wang, B. J. Ko, C. Liu, K. K. Leung, Data Selection for Federated Learning with Relevant and Irrelevant Data at Clients, arXiv preprint arXiv: 2001.08300.

[124] L. Cui, F.P. Tso, W. Jia, Federated service chaining: architecture and challenges, IEEE Commun. Mag. 58 (3) (2020) 47-53.