An edge computing-based embedded traffic information processing approach: application of deep learning in existing traffic systems

Abstract

To address traffic congestion, this study improves MobileNetv2-you only look once version 4 (YOLOv4) target detection algorithm (MobileNetv2-YOLOv4-K++F) and introduces an embedded traffic information processing solution based on edge computing. We transition models initially designed for large-scale graphics processing units (GPUs) to edge computing devices, maximizing the strengths of both deep learning and edge computing technologies. This approach integrates embedded devices with the current traffic system, eliminating the need for extensive equipment updates. The solution enables real-time traffic flow monitoring and license plate recognition at the edge, synchronizing instantaneously with the cloud, allowing for intelligent adjustments of traffic signals and accident forewarnings, enhancing road utilization, and facilitating traffic flow optimization. Through on-site testing using the RK3399PRO development board and the MobileNetv2-YOLOv4-K++F object detection algorithm, the upgrade costs of this approach are less than one-tenth of conventional methods. Under favorable weather conditions, the traffic flow detection accuracy reaches as high as 98%, with license plate recognition exceeding 80%.

References

[[1]] Young M S, Birrell S A, Stanton N A. Safe driving in a green world: a review of driver performance benchmarks and technologies to support “smart” driving. Applied ergonomics, 2011, 42(4): 533-539, J]

[[2]] Wen Y, Lu Y, Yan J Q, et al.. An algorithm for license plate recognition applied to intelligent transportation system. IEEE transactions on intelligent transportation systems, 2011, 12(3): 830-845, J]

[[3]] Cheng Q, Ma H T, Sun X. Vehicle LED detection and segmentation recognition based on deep learning for optical camera communication. Optoelectronics letters, 2022, 18(8): 508-512, J]

[[4]] Gudigar A, Chokkadi S U R. A review on automatic detection and recognition of traffic sign. Multimedia tools and applications, 2016, 75: 333-364, J]

[[5]] Alomari A H, Abu Lebdeh E. Smart real-time vehicle detection and tracking system using road surveillance cameras. Journal of transportation engineering, part A: systems, 2022, 148(10): 04022076, J]

[[6]] Li J, Xu Z J, Xu L. Vehicle and pedestrian detection method based on improved YOLOv4-tiny. Optoelectronics letters, 2023, 19(10): 623-628, J]

[[7]] Lin H J, Yuan Z L, He B, et al.. A deep learning framework for video-based vehicle counting. Frontiers in physics, 2022, 10: 829734, J]

[[8]] Dai Z, Song H S, Wang X, et al.. Video-based vehicle counting framework. IEEE access, 2019, 7: 64460-64470, J]

[[9]] Umair M, Farooq M U, Raza R H, et al.. Efficient video-based vehicle queue length estimation using computer vision and deep learning for an urban traffic scenario. Processes, 2021, 9(10): 1786, J]

[[10]] Chen Y, Lu J. A multi-loop vehicle-counting method under gray mode and RGB mode. Applied sciences, 2021, 11(15): 6831, J]

[[11]] Benjdira B, Koubaa A, Azar A T, et al.. TAU: a framework for video-based traffic analytics leveraging artificial intelligence and unmanned aerial systems. Engineering applications of artificial intelligence, 2022, 114: 105095, J]

[[12]] AZIMJONOV J, ÖZMEN A, VARAN M. A vision-based real-time traffic flow monitoring system for road intersections[J]. Multimedia tools and applications, 2023: 1–20.

[[13]] Wang L J, Cao C J, Zou B H, et al.. License plate recognition via attention mechanism. CMC-computers materials & continua, 2023, 75(1): 1801-1814, J]

[[14]] Zou Y J, Zhang Y J, Yan J, et al.. License plate detection and recognition based on YOLOv3 and IL-PRNET. Signal, image and video processing, 2022, 16(2): 473-480, J]

[[15]] KE X, ZENG G X, GUO W Z. An ultra-fast automatic license plate recognition approach for unconstrained scenarios[J]. IEEE transactions on intelligent transportation systems, 2023.

[[16]] He S H, Chen L, Zhang S Y, et al.. Automatic recognition of traffic signs based on visual inspection. IEEE access, 2021, 9: 43253-43261, J]

[[17]] Mishra J, Goyal S. An effective automatic traffic sign classification and recognition deep convolutional networks. Multimedia tools and applications, 2022, 81(13): 18915-18934, J]

[[18]] Deng Z, Lu G M. Intelligent control method of main road traffic flow based on multi-sensor information fusion. Cluster computing, 2023, 26(6): 3577-3586, J]

[[19]] Azimjonov J, Özmen A. A real-time vehicle detection and a novel vehicle tracking systems for estimating and monitoring traffic flow on highways. Advanced engineering informatics, 2021, 50: 101393, J]

[[20]] KHAN M M, ILYAS M U, KHAN I R, et al. A review of license plate recognition methods employing neural networks[J]. IEEE access, 2023.