Employing deep learning for pavement crack detection can significantly enhance accuracy, and federated learning can help to overcome the challenges of data silos and data security. This paper proposes a lightweight method to detect cracks. We use lightweight encoder modules to extract multi-scale features, and further feature fusion and modelling by selective fusion blocks and irregular-aware blocks. Moreover, this method combines federated learning with crack detection, effectively resolving the tension between data privacy and data sharing in decentralized devices. Experiments were conducted to compare our proposed method with other crack detection methods on two publicly available datasets, including the original method without federated learning and five state-of-the-art methods combined with the same federated learning framework. The experiment proves that our model obtains comparable F1 score with minimal parameters and computational effort. For example, compared to the original method, the number of parameters and computation are reduced by 67.1% and 73.6%, respectively.
| [1] |
He T, Shi F, Zhao M, et al. . A lightweight selective feature fusion and irregular-aware network for crack detection based on federated learning. Proceedings of 2022 International Conference on High Performance Big Data and Intelligent Systems (HDIS), December 10–11, 2022, Tianjin, China, 2022, New York, IEEE: 294-298 [C]
|
| [2] |
Tian S, Qin L, Pang W, et al. . An efficient and balanced feature pyramid network: shared-FPN. Optoelectronics letters, 2026, 22(5): 295-301 J]
|
| [3] |
Wang T, Zheng L, Lv H, et al. . A distributed joint extraction framework for sedimentological entities and relations with federated learning. Expert systems with applications, 2023, 213: 119216 J]
|
| [4] |
Niknam S, Dhillon H S, Reed J H. Federated learning for wireless communications: motivation, opportunities, and challenges. IEEE communications magazine, 2020, 58(6): 46-51 J]
|
| [5] |
Nguyen A, Do T, Tran M, et al. . Deep federated learning for autonomous driving. Proceedings of 2022 IEEE Intelligent Vehicles Symposium (IV), June 4–9, 2022, Aachen, Germany, 2022, New York, IEEE: 1824-1830 [C]
|
| [6] |
Rieke N, Hancox J, Li W, et al. . The future of digital health with federated learning. Npj digital medicine, 2020, 3(1): 119 J]
|
| [7] |
Cheng X, He T, Shi F, et al. . Selective feature fusion and irregular-aware network for pavement crack detection. IEEE transactions on intelligent transportation systems, 2024, 25(5): 3445-3456 J]
|
| [8] |
Yang F, Zhang L, Yu S, et al. . Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE transactions on intelligent transportation systems, 2020, 21(4): 1525-1535 J]
|
| [9] |
Liu Y, Yao J, Lu X, et al. . DeepCrack: a deep hierarchical feature learning architecture for crack segmentation. Neurocomputing, 2019, 338: 139-153 J]
|
| [10] |
Mcmahan H B, Moore E, Ramage D, et al. . Communication-efficient learning of deep networks from decentralized data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, April 20–22, 2017, Fort Lauderdale, FL, USA, 2017, Cambridge, PMLR: 1273-1282 [C]
|
| [11] |
Esteves L, Portugal D, Peixoto P, et al. . Towards mobile federated learning with unreliable participants and selective aggregation. Applied sciences, 2023, 13(5): 3135 J]
|
| [12] |
Oliveira H, Correia P L. Automatic road crack segmentation using entropy and image dynamic thresholding. Proceedings of 2009 17th European Signal Processing Conference, August 24–28, 2009, Glasgow, Scotland, UK, 2009, New York, IEEE: 622-626 [C]
|
| [13] |
Zhou J. Wavelet-based pavement distress detection and evaluation. Optical engineering, 2006, 45(2): 027007 J]
|
| [14] |
Zhang K, Cheng H. Zhao Y, Kong X, Taubman D. A novel pavement crack detection approach using pre-selection based on transfer learning. Image and graphics: 9th International Conference, ICIG 2017, September 13–15, 2017, Shanghai, China, 2017, Cham, Springer: 273-283 C]
|
| [15] |
Xie S, Tu Z. Holistically-nested edge detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), December 7–13, 2015, Santiago, Chile, 2015, New York, IEEE: 1395-1403 [C]
|
| [16] |
Yu J, Gao H, Zhou D, et al. . Deep temporal model-based identity-aware hand detection for space human-robot interaction. IEEE transactions on cybernetics, 2021, 52(12): 13738-13751 J]
|
| [17] |
Li J, Chen Z, Zhong Y, et al. . Appearance-based gaze estimation for ASD diagnosis. IEEE transactions on cybernetics, 2022, 52(7): 6504-6517 J]
|
| [18] |
Yu J, Gao H, Chen Y, et al. . Deep object detector with attentional spatiotemporal LSTM for space human-robot interaction. IEEE transactions on human-machine systems, 2022, 52(4): 784-793 J]
|
| [19] |
He K, Zhang X, Ren S, et al. . Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27–30, 2016, Las Vegas, NV, USA, 2016, New York, IEEE: 770-778 C]
|
| [20] |
PASZKE A, CHAURASIA A, KIM S, et al. ENet: a deep neural network architecture for real-time semantic segmentation[EB/OL]. (2016-06-07) [2026-05-15]. https://arxiv.org/abs/1606.02147.
|
| [21] |
Li K, Yang J, Ma S, et al. . Rethinking lightweight convolutional neural networks for efficient and high-quality pavement crack detection. IEEE transactions on intelligent transportation systems, 2024, 25(1): 237-250 J]
|
| [22] |
Dai J, Qi H, Xiong Y, et al. . Deformable convolutional networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), October 22–29, 2017, Venice, Italy, 2017, New York, IEEE: 764-773 [C]
|
| [23] |
Liu Y, Cheng M M, Hu X, et al. . Richer convolutional features for edge detection. IEEE transactions on pattern analysis and machine intelligence, 2019, 41(8): 1939-1946 J]
|
| [24] |
Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015, October 5–9, 2015, Munich, Germany, 2015, Cham, Springer International Publishing: 234-241 [C]
|
| [25] |
Oktay O, Schlemper J, Le Folgoc L L, et al. . Attention U-Net: learning where to look for the pancreas. Proceedings of the 1st Conference on Medical Imaging with Deep Learning (MIDL 2018), July 4–6, 2018, Amsterdam, The Netherlands, 2018: 1-10 [C]
|
| [26] |
Wang H, Cao P, Wang J, et al. . UCTransNet: rethinking the skip connections in U-Net from a channel-wise perspective with transformer. Proceedings of the 36th AAAI Conference on Artificial Intelligence, February 22–March 1, 2022, Virtual, 2022, Palo Alto, AAAI Press: 2441-2449 [C]
|
RIGHTS & PERMISSIONS
Tianjin University of Technology
PDF
