A survey on blockchain-enabled federated learning and its prospects with digital twin

Abstract

Digital Twin (DT) supports real time analysis and provides a reliable simulation platform in the Internet of Things (IoT). The creation and application of DT hinges on amounts of data, which poses pressure on the application of Artificial Intelligence (AI) for DT descriptions and intelligent decision-making. Federated Learning (FL) is a cutting-edge technology that enables geographically dispersed devices to collaboratively train a shared global model locally rather than relying on a data center to perform model training. Therefore, DT can benefit by combining with FL, successfully solving the "data island" problem in traditional AI. However, FL still faces serious challenges, such as enduring single-point failures, suffering from poison attacks, lacking effective incentive mechanisms. Before the successful deployment of DT, we should tackle the issues caused by FL. Researchers from industry and academia have recognized the potential of introducing Blockchain Technology (BT) into FL to overcome the challenges faced by FL, where BT acting as a distributed and immutable ledger, can store data in a secure, traceable, and trusted manner. However, to the best of our knowledge, a comprehensive literature review on this topic is still missing. In this paper, we review existing works about blockchain-enabled FL and visualize their prospects with DT. To this end, we first propose evaluation requirements with respect to security, fault-tolerance, fairness, efficiency, cost-saving, profitability, and support for heterogeneity. Then, we classify existing literature according to the functionalities of BT in FL and analyze their advantages and disadvantages based on the proposed evaluation requirements. Finally, we discuss open problems in the existing literature and the future of DT supported by blockchain-enabled FL, based on which we further propose some directions for future research.

Keywords

Digital twin / Artificial intelligence / Federated learning / Blockchain

References

[1] Y. Lu, X. Huang, K. Zhang, S. Maharjan, Y. Zhang, Communication-efficient federated learning and permissioned blockchain for digital twin edge networks, IEEE Internet Things J. 8 (4) (2021) 2276-2288.

[2] B. McMahan, E. Moore, D. Ramage, S. Hampson, B. A. y Arcas, Communication-efficient learning of deep networks from decentralized data, in: Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, PMLR, 2017, pp. 1273-1282.

[3] D.C. Nguyen, M. Ding, Q.-V. Pham, P.N. Pathirana, L.B. Le, A. Seneviratne, J. Li, D. Niyato, H.V. Poor, Federated learning meets blockchain in edge computing: opportunities and challenges, IEEE Internet Things J. 8 (16) (2021) 12806-12825.

[4] M. Ali, H. Karimipour, M. Tariq, Integration of blockchain and federated learning for Internet of Things: recent advances and future challenges, Comput. Secur. 108 (2021) 102355.

[5] S. Nakamoto, Bitcoin: a peer-to-peer electronic cash system. https://www.debr.io/section/2183-whitepaper, 2008.

[6] P. Lin, Q. Song, D. Wang, F.R. Yu, L. Guo, V.C.M. Leung, Resource management for pervasive-edge-computing-assisted wireless VR streaming in Industrial Internet of Things, IEEE Trans. Ind. Inf. 17 (11) (2021) 7607-7617.

[7] P. Lin, Q. Song, F.R. Yu, D. Wang, L. Guo, Task offloading for wireless VR-enabled medical treatment with blockchain security using collective reinforcement learning, IEEE Internet Things J. 8 (21) (2021) 15749-15761.

[8] Y. Lu, X. Huang, K. Zhang, S. Maharjan, Y. Zhang, Blockchain and federated learning for 5G beyond, IEEE Netw 35 (1) (2021) 219-225.

[9] Y. Li, C. Chen, N. Liu, H. Huang, Z. Zheng, Q. Yan, A blockchain-based decentralized federated learning framework with committee consensus, IEEE Netw 35 (1) (2021) 234-241.

[10] Y. Qu, S.R. Pokhrel, S. Garg, L. Gao, Y. Xiang,A blockchained federated learning framework for cognitive computing in Industry 4.0 networks, IEEE Trans. Ind. Inf. 17 (4) (2021) 2964-2973.

[11] Y, J. Zhao, L. Jiang, R. Tan, D. Niyato, Z. Li, L. Lyu, Y. Liu, Privacy-preserving blockchain-based federated learning for IoT devices, IEEE Netw 8 (3) (2021) 1817-1829.

[12] Y. Lu, X. Huang, Y. Dai, S. Maharjan, Y. Zhang, Blockchain and federated learning for privacy-preserved data sharing in Industrial IoT, IEEE Trans. Ind. Inf. 16 (6)(2020) 4177-4186.

[13] S.R. Pokhrel, J. Choi, Federated learning with blockchain for autonomous vehicles: analysis and design challenges, IEEE Trans. Commun. 68 (8) (2020) 4734-4746.

[14] M. Shayan, C. Fung, C.J.M. Yoon, I. Beschastnikh, Biscotti: a blockchain system for private and secure federated learning, IEEE Trans. Parallel Distr. Syst. 32 (7) (2021) 1513-1525.

[15] J. Kang, Z. Xiong, X. Li, Y. Zhang, D. Niyato, C. Leung, C. Miao, Optimizing task assignment for reliable blockchain-empowered federated edge learning, IEEE Trans. Veh. Technol. 70 (2) (2021) 1910-1923.

[16] J. Kang, Z. Xiong, D. Niyato, S. Xie, J. Zhang, Incentive mechanism for reliable federated learning: a joint optimization approach to combining reputation and contract theory, IEEE Internet Things J. 6 (6) (2019) 10700-10714.

[17] W. Zhang, Q. Lu, Q. Yu, Z. Li, Y. Liu, S.K. Lo, S. Chen, X. Xu, L. Zhu, Blockchain-based federated learning for device failure detection in Industrial IoT, IEEE Internet Things J. 8 (7) (2021) 5926-5937.

[18] Y. Wang, Z. Su, N. Zhang, A. Benslimane, Learning in the air: secure federated learning for UAV-assisted crowdsensing, IEEE Trans. Netw. Sci. Eng. 8 (2) (2021) 1055-1069.

[19] Y. Lu, X. Huang, K. Zhang, S. Maharjan, Y. Zhang, Blockchain empowered asynchronous federated learning for secure data sharing in Internet of Vehicles, IEEE Trans. Veh. Technol. 69 (4) (2020) 4298-4311.

[20] L. Peng, W. Feng, Z. Yan, Y. Li, X. Zhou, S. Shimizu, Privacy preservation in permissionless blockchain: a survey, Digit. Commun. Netw. 7 (3) (2021) 295-307.

[21] W. Feng, Z. Yan, Mcs-chain: decentralized and trustworthy mobile crowdsourcing based on blockchain, Future Generat. Comput. Syst. 95 (2019) 649-666.

[22] Z. Zheng, S. Xie, H. Dai, X. Chen, H. Wang, An overview of blockchain technology: architecture, consensus, and future trends, in: 2017 IEEE International Congress on Big Data (BigData Congress), IEEE, 2017, pp. 557-564.

[23] B. Putz, G. Pernul, Detecting blockchain security threats, in: 2020 IEEE International Conference on Blockchain (Blockchain), IEEE, 2020, pp. 313-320.

[24] J. Xie, F.R. Yu, T. Huang, R. Xie, J. Liu, Y. Liu, A survey on the scalability of blockchain systems, IEEE Netw 33 (5) (2019) 166-173.

[25] R. Yang, F.R. Yu, P. Si, Z. Yang, Y. Zhang, Integrated blockchain and edge computing systems: a survey, some research issues and challenges, IEEE Commun. Surv. Tutor. 21 (2) (2019) 1508-1532.

[26] Y. Liu, F.R. Yu, X. Li, H. Ji, V.C.M. Leung, Blockchain and machine learning for communications and networking systems, IEEE Commun. Surv. Tutor. 22 (2) (2020) 1392-1431.

[27] D.C. Nguyen, M. Ding, P.N. Pathirana, A. Seneviratne, J. Li, H.V. Poor, Federated learning for Internet of Things: a comprehensive survey, IEEE Commun. Surv. Tutor. 23 (3) (2021) 1622-1658.

[28] F. Mostafa, L. Tao, W. Yu, An effective architecture of digital twin system to support human decision making and AI-driven autonomy. https://onlinelibrary.wiley.com/doi/epdf/10.1002/cpe.6111, 2021.

[29] M.M. Rathore, S.A. Shah, D. Shukla, E. Bentafat, S. Bakiras, The role of AI, machine learning, and big data in digital twinning: a systematic literature review, challenges, and opportunities, IEEE Access 9 (2021) 32030-32052.

[30] W. Sun, N. Xu, L. Wang, H. Zhang, Y. Zhang, Dynamic digital twin and federated learning with incentives for air-ground networks, IEEE Trans. Netw. Sci. Eng. 9 (1)(2020) 321-333.

[31] Q. Song, S. Lei, W. Sun, Y. Zhang, Adaptive federated learning for digital twin driven Industrial Internet of Things, in: 2021 IEEE Wireless Communications and Networking Conference (WCNC), IEEE, 2021, pp. 1-6.

[32] Y. Lu, X. Huang, K. Zhang, S. Maharjan, Y. Zhang, Low-latency federated learning and blockchain for edge association in digital twin empowered 6G networks, IEEE Trans. Ind. Inf. 17 (7) (2021) 5098-5107.

[33] H. Liu, S. Zhang, P. Zhang, X. Zhou, X. Shao, G. Pu, Y. Zhang, Blockchain and federated learning for collaborative intrusion detection in vehicular edge computing, IEEE Trans. Veh. Technol. 70 (6) (2021) 6073-6084.

[34] L. Cui, X. Su, Z. Ming, Z. Chen, S. Yang, Y. Zhou, W. Xiao, Creat: blockchain-assisted compression algorithm of federated learning for content caching in edge computing, IEEE Internet Things J. 9 (16) (2020) 14151-14161.

[35] Y. Liu, J. Peng, J. Kang, A.M. Iliyasu, D. Niyato, A.A.A. El-Latif, A secure federated learning framework for 5G networks, IEEE Wireless Commun. 27 (4) (2020) 24-31.

[36] L. Melis, C. Song, E. De Cristofaro, V. Shmatikov, Exploiting unintended feature leakage in collaborative learning, in: 2019 IEEE Symposium on Security and Privacy (SP), IEEE, 2019, pp. 691-706.

[37] J. Konečný, H.B. McMahan, F.X. Yu, P. Richtárik, A.T. Suresh, D. Bacon, Federated learning: strategies for improving communication efficiency. https://arxiv.org/abs/1610.05492, 2017.

[38] H. Wu, P. Wang, Node selection toward faster convergence for federated learning on non-iid data, IEEE Trans. Netw. Sci. Eng. 9 (5) (2022) 3099-3111.

[39] S. King, S. Nadal, PPcoin: peer-to-peer crypto-currency with proof-of-stake. https://archive.org/details/PPCoinPaper, 2012.

[40] P. Blanchard, E.M. El Mhamdi, R. Guerraoui, J. Stainer, Machine learning with adversaries: byzantine tolerant gradient descent,in:Proceedings of the 31st International Conference on Neural Information Processing Systems, ACM, 2017, pp. 118-128.

[41] J. Benet, IPFS - content addressed, versioned, P2P file system. https://arxiv.org/abs/1407.3561, 2014.

[42] R.S. Sutton, A.G. Barto, Reinforcement Learning:an Introduction, MIT Press, Cambridge, Massachusetts, 2018.

[43] S.J. Alsunaidi, F.A. Alhaidari, A survey of consensus algorithms for blockchain technology, in: 2019 International Conference on Computer and Information Sciences (ICCIS), IEEE, 2019, pp. 1-6.

[44] H. Chai, S. Leng, Y. Chen, K. Zhang, A hierarchical blockchain-enabled federated learning algorithm for knowledge sharing in Internet of Vehicles, IEEE Trans. Intell. Transport. Syst. 22 (7) (2021) 3975-3986.

[45] G. Wood, et al., Ethereum: a secure decentralised generalised transaction ledger, Ethereum project yellow paper 151 (2014) 1-32.

[46] Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin, V. Chandra, Federated learning with non-iid data. https://arxiv.org/abs/1806.00582, 2018.

[47] L. Feng, Y. Zhao, S. Guo, X. Qiu, W. Li, P. Yu, Blockchain-based asynchronous federated learning for Internet of Things, IEEE Trans. Comput. (2021), https://doi.org/10.1109/TC.2021.3072033.

[48] L. Deng, P. Yang, W. Liu, An improved genetic algorithm, in: 2019 IEEE 5th International Conference on Computer and Communications (ICCC), IEEE, 2019, pp. 47-51.

[49] L. Feng, Z. Yang, S. Guo, X. Qiu, W. Li, P. Yu, Two-layered blockchain architecture for federated learning over mobile edge network, IEEE Netw 36 (1) (2021) 1-14.

[50] Y. Qu, L. Gao, T.H. Luan, Y. Xiang, S. Yu, B. Li, G. Zheng, Decentralized privacy using blockchain-enabled federated learning in fog computing, IEEE Internet Things J. 7 (6) (2020) 5171-5183.

[51] A. Kate, G.M. Zaverucha, I. Goldberg, Constant-size commitments to polynomials and their applications, in: International Conference on the Theory and Application of Cryptology and Information Security, Springer, 2010, pp. 177-194.

[52] X. Li, K. Huang, W. Yang, S. Wang, Z. Zhang, On the convergence of FedAvg on non-iid data. https://arxiv.org/abs/1907.02189, 2020.

[53] H. Kim, J. Park, M. Bennis, S.-L. Kim, Blockchained on-device federated learning, IEEE Commun. Lett. 24 (6) (2020) 1279-1283.

[54] H. Jin, X. Dai, J. Xiao, B. Li, H. Li, Y. Zhang, Cross-cluster federated learning and blockchain for internet of medical Things, IEEE Internet Things J. 8 (21) (2021) 15776-15784.

[55] Z. Li, H. Yu, T. Zhou, L. Luo, M. Fan, Z. Xu, G. Sun, Byzantine resistant secure blockchained federated learning at the edge, IEEE Netw 35 (4) (2021) 295-301.

[56] K. Toyoda, J. Zhao, A.N.S. Zhang, P.T. Mathiopoulos, Blockchain-enabled federated learning with mechanism design, IEEE Access 8 (2020) 219744-219756.

[57] J. Weng, J. Weng, J. Zhang, M. Li, Y. Zhang, W. Luo, Deepchain: auditable and privacy-preserving deep learning with blockchain-based incentive, IEEE Trans. Dependable Secure Comput. 18 (5) (2021) 2438-2455.

[58] S. Fan, H. Zhang, Y. Zeng, W. Cai, Hybrid blockchain-based resource trading system for federated learning in edge computing, IEEE Inter. Things J. J. 8 (4) (2021) 2252-2264.

[59] J. Zayuelas Mu-noz, Detection of bitcoin miners from network measurements. https://upcommons.upc.edu/bitstream/handle/2117/133503/137903.pdf, 2019.

[60] M. Castro, B. Liskov, Practical byzantine fault tolerance, in: USENIX Symposium on Operating Systems Design and Implementation, USENIX, 1999, pp. 173-186.

[61] C. Fung, C.J.M. Yoon, I. Beschastnikh, Mitigating sybils in federated learning poisoning. https://arxiv.org/abs/1808.04866, 2020.

[62] S. Fei, Z. Yan, W. Ding, H. Xie, Security vulnerabilities of SGX and countermeasures: a survey, ACM Comput. Surv. 54 (6) (2021) 1-36.

[63] G. Liu, Z. Yan, W. Feng, X. Jing, Y. Chen, M. Atiquzzaman, Sedid: an SGX-enabled decentralized intrusion detection framework for network trust evaluation, Inf. Fusion 70 (6) (2021) 100-114.

[64] P. Kairouz, H.B. McMahan, B. Avent, A. Bellet, M. Bennis, A.N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, R.G.L. D'Oliveira, H. Eichner, S.E. Rouayheb, D. Evans, J. Gardner, Z. Garrett, A. Gascón, B. Ghazi, P.B. Gibbons, M. Gruteser, Z. Harchaoui, C. He, L. He, Z. Huo, B. Hutchinson, J. Hsu, M. Jaggi, T. Javidi, G. Joshi, M. Khodak, J. Konečný, A. Korolova, F. Koushanfar, S. Koyejo, T. Lepoint, Y. Liu, P. Mittal, M. Mohri, R. Nock, A. Özgür, R. Pagh, M. Raykova, H. Qi, D. Ramage, R. Raskar, D. Song, W. Song, S.U. Stich, Z. Sun, A.T. Suresh, F. Tramèr, P. Vepakomma, J. Wang, L. Xiong, Z. Xu, Q. Yang, F.X. Yu, H. Yu, S. Zhao, Advances and open problems in federated learning. https://arxiv.org/abs/1912.04977, 2021.

[65] A. Lalitha, O.C. Kilinc, T. Javidi, F. Koushanfar, Peer-to-peer federated learning on graphs. https://arxiv.org/abs/1901.11173, 2019.

[66] A.G. Roy, S. Siddiqui, S. Pölsterl, N. Navab, C. Wachinger, Braintorrent: a peer-to-peer environment for decentralized federated learning. https://arxiv.org/abs/1905.06731, 2019.

[67] F. Boenisch, A survey on model watermarking neural network. https://arxiv.org/abs/2009.12153, 2020.

[68] L. Fan, K.W. Ng, C.S. Chan, Rethinking deep neural network ownership verification: embedding passports to defeat ambiguity attacks,in:Proceedings of the 33rd International Conference on Neural Information Processing Systems, ACM, 2019, pp. 4714-4723.

[69] R. Namba, J. Sakuma, Robust watermarking of neural network with exponential weighting, in: Proceedings of the 2019 ACM Asia Conference on Computer and Communications Security, ACM, 2019, pp. 228-240.

[70] B.G.A. Tekgul, Y. Xia, S. Marchal, N. Asokan, WAFFLE: watermarking in federated learning, in: 2021 40th International Symposium on Reliable Distributed Systems (SRDS), IEEE, 2021, pp. 310-320.

[71] H. Li, E. Wenger, S. Shan, B.Y. Zhao, H. Zheng, Piracy resistant watermarks for deep neural networks. https://arxiv.org/abs/1910.01226, 2020.

[72] Z. Yan, P. Zhang, A.V. Vasilakos, A survey on trust management for Internet of Things, J. Comput. Syst. Sci. 42 (2014) 120-134.

[73] Z. Yan, Y. Chen, Y. Shen, A practical reputation system for pervasive social chatting, J. Comput. Syst. Sci. 79 (5) (2013) 556-572.

[74] Z. Yan, P. Wang, W. Feng, A novel scheme of anonymous authentication on trust in pervasive social networking, Inf. Sci. 445 (2018) 79-96.