A blockchain based privacy-preserving federated learning scheme for Internet of Vehicles

Abstract

The application of artificial intelligence technology in Internet of Vehicles (IoV) has attracted great research interests with the goal of enabling smart transportation and traffic management. Meanwhile, concerns have been raised over the security and privacy of the tons of traffic and vehicle data. In this regard, Federated Learning (FL) with privacy protection features is considered a highly promising solution. However, in the FL process, the server side may take advantage of its dominant role in model aggregation to steal sensitive information of users, while the client side may also upload malicious data to compromise the training of the global model. Most existing privacy-preserving FL schemes in IoV fail to deal with threats from both of these two sides at the same time. In this paper, we propose a Blockchain based Privacy-preserving Federated Learning scheme named BPFL, which uses blockchain as the underlying distributed framework of FL. We improve the Multi-Krum technology and combine it with the homomorphic encryption to achieve ciphertext-level model aggregation and model filtering, which can enable the verifiability of the local models while achieving privacy-preservation. Additionally, we develop a reputation-based incentive mechanism to encourage users in IoV to actively participate in the federated learning and to practice honesty. The security analysis and performance evaluations are conducted to show that the proposed scheme can meet the security requirements and improve the performance of the FL model.

Keywords

Federated learning / Blockchain / Privacy-preservation / Homomorphic encryption / Internet of vehicles

References

[1] X. Lin, J. Wu, S. Mumtaz, S. Garg, J. Li, M. Guizani, Blockchain-based on-demand computing resource trading in iov-assisted smart city, IEEE Transactions on Emerging Topics in Computing 9 (3) (2020) 1373-1385.

[2] P. Liu, H. He, T. Fu, H. Lu, A. Alelaiwi, M.W.I. Wasi, Task offloading optimization of cruising uav with fixed trajectory, Comput. Network. 199 (2021) 108397.

[3] T. Fu, C. Wang, N. Cheng, Deep-learning-based joint optimization of renewable energy storage and routing in vehicular energy network, IEEE Internet Things J. 7 (7) (2020) 6229-6241.

[4] D.M. Manias, A. Shami, Making a case for federated learning in the internet of vehicles and intelligent transportation systems, IEEE Network 35 (3) (2021) 88-94.

[5] J.S. Ng, W.Y.B. Lim, H.-N. Dai, Z. Xiong, J. Huang, D. Niyato, X.-S. Hua, C. Leung, C. Miao,Communication-efficient federated learning in uav-enabled iov: a joint auction-coalition approach, in: GLOBECOM 2020-2020 IEEE Global Communications Conference, IEEE, 2020, pp. 1-6.

[6] D. Wang, B. Song, D. Chen, X. Du, Intelligent cognitive radio in 5g: ai-based hierarchical cognitive cellular networks, IEEE Wireless Commun. 26 (3) (2019) 54-61.

[7] A. Uprety, D.B. Rawat, J. Li, Privacy preserving misbehavior detection in iov using federated machine learning, in: 2021 IEEE 18th Annual Consumer Communications & Networking Conference (CCNC), IEEE, 2021, pp. 1-6.

[8] M. Shen, Y. Deng, L. Zhu, X. Du, N. Guizani, Privacy-preserving image retrieval for medical iot systems: a blockchain-based approach, IEEE Network 33 (5) (2019) 27-33.

[9] W. Yang, N. Wang, Z. Guan, L. Wu, X. Du, M. Guizani,A Practical Cross-Device Federated Learning Framework over 5g Networks, arXiv preprint arXiv: 2204.08134.

[10] Y. Zou, F. Shen, F. Yan, J. Lin, Y. Qiu, Reputation-based regional federated learning for knowledge trading in blockchain-enhanced iov, in: 2021 IEEE Wireless Communications and Networking Conference (WCNC), IEEE, 2021, pp. 1-6.

[11] S.R. Pokhrel, J. Choi, Improving tcp performance over wifi for internet of vehicles: a federated learning approach, IEEE Trans. Veh. Technol. 69 (6) (2020) 6798-6802.

[12] P. Liu, Y. Ding, T. Fu, Optimal throwboxes assignment for big data multicast in vdtns, Wireless Network (2019) 1-11.

[13] X. Lin, J. Wu, A.K. Bashir, J. Li, W. Yang, J. Piran, Blockchain-based incentive energy-knowledge trading in iot: joint power transfer and AI design, IEEE Internet Things Journal (99) (2020) 14685-14698, https://doi.org/10.1109/JIOT.2020.3024246, 1-1.

[14] H. B. McMahan, E. Moore, D. Ramage, B. A. y Arcas, Federated Learning of Deep Networks Using Model Averaging, arXiv preprint arXiv:1602.05629.

[15] N. Wang, W. Yang, Z. Guan, X. Du, M. Guizani, Bpfl: a blockchain based privacypreserving federated learning scheme, in: 2021 IEEE Global Communications Conference (GLOBECOM), IEEE, 2021, pp. 1-6.

[16] R. Shokri, M. Stronati, C. Song, V. Shmatikov, Membership inference attacks against machine learning models, in: 2017 IEEE Symposium on Security and Privacy (SP), IEEE, 2017, pp. 3-18.

[17] X. Du, Qos routing based on multi-class nodes for mobile ad hoc networks, Ad Hoc Netw. 2 (3) (2004) 241-254.

[18] A. Madi, O. Stan, A. Mayoue, A. Grivet-Sébert, C. Gouy-Pailler, R. Sirdey, A secure federated learning framework using homomorphic encryption and verifiable computing, in: 2021 Reconciling Data Analytics, Automation, Privacy, and Security: A Big Data Challenge (RDAAPS), IEEE, 2021, pp. 1-8.

[19] Y. Zhao, J. Zhao, L. Jiang, R. Tan, D. Niyato, Z. Li, L. Lyu, Y. Liu, Privacy-preserving blockchain-based federated learning for iot devices, IEEE Internet Things J. 8 (3) (2020) 1817-1829.

[20] N. Wang, X. Zhou, X. Lu, Z. Guan, L. Wu, X. Du, M. Guizani, When energy trading meets blockchain in electrical power system: the state of the art, Appl. Sci. 9 (8) (2019) 1561.

[21] Y. Lu, X. Huang, K. Zhang, S. Maharjan, Y. Zhang, Blockchain empowered asynchronous federated learning for secure data sharing in internet of vehicles, IEEE Trans. Veh. Technol. 69 (4) (2020) 4298-4311.

[22] J. Weng, J. Weng, J. Zhang, M. Li, Y. Zhang, W. Luo, Deepchain: auditable and privacy-preserving deep learning with blockchain-based incentive, IEEE Trans. Dependable Secure Computing 18 (5) (2019) 2438-2455.

[23] J. Kang, Z. Xiong, D. Niyato, S. Xie, J. Zhang, Incentive mechanism for reliable federated learning: a joint optimization approach to combining reputation and contract theory, IEEE Internet Things J. 6 (6) (2019) 10700-10714.

[24] X. Xu, L. Lyu, Towards Building a Robust and Fair Federated Learning System, arXiv preprint arXiv:2011.10464.

[25] M. Shayan, C. Fung, C. J. Yoon,I. Beschastnikh, Biscotti: A Ledger for Private and Secure Peer-To-Peer Machine Learning, arXiv preprint arXiv:1811.09904.

[26] P. Blanchard, E.M. El Mhamdi, R. Guerraoui, J. Stainer, Machine learning with adversaries: Byzantine tolerant gradient descent,in: Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017, pp. 118-128.

[27] D. Karger, E. Lehman, T. Leighton, R. Panigrahy, M. Levine, D. Lewin, Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the world wide web,in: Proceedings of the Twenty-Ninth Annual ACM Symposium on Theory of Computing, 1997, pp. 654-663.

[28] P. Paillier, Public-key cryptosystems based on composite degree residuosity classes, in: International Conference on the Theory and Applications of Cryptographic Techniques, Springer, 1999, pp. 223-238.

[29] B. McMahan, E. Moore, D. Ramage, S. Hampson, B.A. y Arcas, Communicationefficient learning of deep networks from decentralized data, in: Artificial Intelligence and Statistics, PMLR, 2017, pp. 1273-1282.

[30] B. Zhao, K. Fan, K. Yang, Z. Wang, H. Li, Y. Yang, Anonymous and privacypreserving federated learning with industrial big data, IEEE Transactions on Industrial Informatics 17 (9) (2021) 6314-6323.

[31] M. Mathias, R. Timofte, R. Benenson, L. Van Gool,Traffic sign recognition how far are we from the solution?, in: The 2013 International Joint Conference on Neural Networks (IJCNN) IEEE, 2013, pp. 1-8.

[32] S. Caldas, S. M. K. Duddu, P. Wu, T. Li, J. Kone_cnỳ, H. B. McMahan, V. Smith,A. Talwalkar, Leaf: A Benchmark for Federated Settings, arXiv preprint arXiv: 1812.01097.