A review of recent advancements and applications of 4D millimeter-wave radar in smart highways

Abstract

Smart highways, as vital components of intelligent transportation systems (ITS), have driven a growing demand for sophisticated sensing technologies. Among these, 4D millimeter-wave (mmWave) radar has emerged as a cornerstone, thanks to its capacity for high-resolution, real-time monitoring of complex traffic scenes. Unlike traditional radar systems, 4D mmWave not only measures the distance, velocity, and azimuth of moving objects but also captures elevation information, yielding an enriched three-dimensional understanding of the road environment. Although substantial research has been conducted on 4D mmWave radar in onboard applications, a comprehensive review focusing on its potential in roadside scenarios, such as smart highways, is currently lacking. This paper addresses that gap by first reviewing the operating principles of 4D mmWave radar and then examining how it integrates with complementary sensors. We assess its performance in key roadside functions, including multi-target detection, vehicle trajectory tracking, and macroscopic traffic flow monitoring. Further, we discuss critical challenges—such as real-time data processing bottlenecks, system scalability across extended highway networks, and suppression of inter-radar interference. By synthesizing current research and pinpointing outstanding issues, this review offers a comprehensive overview of 4D mmWave radar’s expanding role in smart highway ITS and outlines promising directions for future investigation.

Keywords

4D millimeter-wave radar / Smart highways / Autonomous driving / Onboard and roadside

References

[1] SunZ, BalakrishnanS, SuL, BhuyanA, WangP, QiaoC. Who is in control? Practical physical layer attack and defense for mmwave-based sensing in autonomous vehicles. IEEE Trans Inf Forensics Secur, 2021, 16: 3199-3214.

[2] WangJ, FuT, XueJ, LiC, SongH, XuW, ShangguanQ. Realtime wide-area vehicle trajectory tracking using millimeter-wave radar sensors and the open TJRD TS dataset. Int J Trans Sci Technol, 2023, 12: 273-290.

[3] Ouaknine A, Newson A, Rebut J, Tupin F, Perez P (2021) CARRADA dataset: camera and automotive radar with range-angle-Doppler annotations. In: 2020 25th International Conference on Pattern Recognition (ICPR). pp. 5068–5075. IEEE, Milan, Italy. https://doi.org/10.1109/ICPR48806.2021.9413181

[4] WangL, ZhangX, LiJ, XvB, FuR, ChenH, YangL, JinD, ZhaoL. Multi-modal and multi-scale fusion 3D object detection of 4D radar and LiDAR for autonomous driving. IEEE Trans Veh Technol, 2023, 72: 5628-5641.

[5] BahramgiriM, NooshabadiS, OlutomilayoKTT, FuhrmannDRR. Automotive radar-based hitch angle tracking technique for trailer backup assistant systems. IEEE Trans Intell Vehicles, 2023, 8: 1922-1933.

[6] ZengZ, DangX, LiY, HuangY, LiangX. A mmWave radar SLAM method in Subterranean tunnel for low visibility and degradation. IEEE Robot Autom Lett, 2024, 9: 4281-4288.

[7] SonnyA, KumarA, CenkeramaddiLR. Dynamic targets occupancy status detection utilizing mmWave radar sensor and ensemble machine learning. IEEE Open J Ind Electron Soc, 2024, 5: 251-263.

[8] AdolfssonD, MagnussonM, AlhashimiA, LilienthalAJ, AndreassonH. Lidar-level localization with radar? The CFEAR approach to accurate, fast, and robust large-scale radar odometry in diverse environments. IEEE Trans Robot, 2023, 39: 1476-1495.

[9] Zhang J, Zhuge H, Wu Z, Peng G, Wen M, Liu Y, Wang D (2023) 4DRadarSLAM: a 4D imaging radar SLAM system for large-scale environments based on pose graph optimization. In: 2023 IEEE International Conference on Robotics and Automation (ICRA). pp. 8333–8340. IEEE, London, United Kingdom. https://doi.org/10.1109/ICRA48891.2023.10160670

[10] Karimian-Sichani N, Alaee-Kerahroodi M, Mysore Rama Rao BS, Mehrshahi E, Ghorashi SA (2024) Antenna array and waveform design for 4-D-Imaging mmWave MIMO radar sensors. IEEE Trans Aerospace Electron Syst. 60:1848–1864. https://doi.org/10.1109/TAES.2023.3343688

[11] KarangwaJ, LiuJ, ZengZ. Vehicle detection for autonomous driving: a review of algorithms and datasets. IEEE Trans Intell Transp Syst, 2023, 24: 11568-11594.

[12] BresnahanDG, LiY. Classification of driver head motions using a mm-Wave FMCW radar and deep convolutional neural network. IEEE Access, 2021, 9: 100472-100479.

[13] Cui H, Wu J, Zhang J, Chowdhary G, Norris WR (2021) 3D detection and tracking for on-road vehicles with a monovision camera and dual low-cost 4D mmWave radars. In: 2021 IEEE International Intelligent Transportation Systems Conference (ITSC). pp. 2931–2937. IEEE, Indianapolis, IN, USA. https://doi.org/10.1109/ITSC48978.2021.9564904

[14] LiY, WangY, MengC, DuanY, JiJ, ZhangY, ZhangY. FARFusion: a practical roadside radar-camera fusion system for far-range perception. IEEE Robot Automation Lett, 2024, 9: 5433-5440.

[15] Zhou Y, Liu L, Zhao H, Lopez-Benitez M, Yu L, Yue Y (2022) Towards deep radar perception for autonomous driving: datasets, methods, and challenges. Sensors. 22. https://doi.org/10.3390/s22114208

[16] FengD, Haase-SchutzC, RosenbaumL, HertleinH, GlaserC, TimmF, WiesbeckW, DietmayerK. Deep multi-modal object detection and semantic segmentation for autonomous driving: datasets, methods, and challenges. IEEE Trans Intell Transport Syst, 2021, 22: 1341-1360.

[17] PatoleS, TorlakM, WangD, AliM. Automotive radars a review of signal processing techniques. IEEE Signal Process Mag, 2017, 34: 22-35.

[18] VenonA, DupuisY, VasseurP, MerriauxP. Millimeter Wave FMCW RADARs for perception, recognition and localization in automotive applications: a survey. IEEE Trans Intell Vehicles, 2022, 7: 533-555.

[19] SrivastavA, MandalS. Radars for autonomous driving: a review of deep learning methods and challenges. IEEE Access, 2023, 11: 97147-97168.

[20] Yao S, Guan R, Peng Z, Xu C, Shi Y, Ding W, Lim EG, Yue Y, Seo H, Man KL, Ma J, Zhu X, Yue Y (2024) Exploring radar data representations in autonomous driving: a comprehensive review. https://arxiv.org/abs/2312.04861

[21] Han Z, Wang J, Xu Z, Yang S, He L, Xu S, Wang J, Li K (2024) 4D millimeter-wave radar in autonomous driving: a survey. https://arxiv.org/abs/2306.04242

[22] YaoS, GuanR, HuangX, LiZ, ShaX, YueY, LimEG, SeoH, ManKL, ZhuX, YueY. Radar-camera fusion for object detection and semantic segmentation in autonomous driving: a comprehensive review. IEEE Trans Intell Veh, 2024, 9: 2094-2128.

[23] YonedaK, SuganumaN, YanaseR, AldibajaM. Automated driving recognition technologies for adverse weather conditions. IATSS Res, 2019, 43: 253-262.

[24] Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. n71. https://doi.org/10.1136/bmj.n71

[25] HambergerGF, SpathS, SiartU, EibertTF. A mixed circular/linear dual-polarized phased array concept for automotive radar—planar antenna designs and system evaluation at 78 GHz. IEEE Trans Antennas Propag, 2019, 67: 1562-1572.

[26] Zhao J, Zou L, Jiang R, Wang X, Gao H (2020) Hybrid antenna arrays with high angular resolution for 77 GHz automotive radars. IEICE Electron Express. 17. https://doi.org/10.1587/elex.16.20190687

[27] SchindlerD, SchweizerB, KnillC, HaschJ, WaldschmidtC. Synthetization of virtual transmit antennas for MIMO OFDM radar by space-time coding. IEEE Trans Aerosp Electron Syst, 2021, 57: 1964-1971.

[28] HanK, HongS. High-resolution phased-subarray MIMO radar with grating lobe cancellation technique. IEEE Trans Microw Theory Tech, 2022, 70: 2775-2785.

[29] RePDH, ComiteD, PodilchakSK, AlistarhCA, GoussetisG, SellathuraiM, ThompsonJ, LeeJ. FMCW radar with enhanced resolution and processing time by beam switching. IEEE Open J Antennas Propagation, 2021, 2: 882-896.

[30] YuT, KimE, ParkJ-H, KimB-S, NamS. W-Band Co-prime array FMCW MIMO radar with IPCE algorithm for high-angular resolution. IEEE Access, 2023, 11: 109899-109910.

[31] WuM, HaoC. Super-resolution TOA and AOA estimation for OFDM radar systems based on compressed sensing. IEEE Trans Aerosp Electron Syst, 2022, 58: 5730-5740.

[32] Ahmad M, Zhang X, Lai X, Ali F, Shi X (2024) Low-complexity 2D-DOD and 2D-DOA estimation in bistatic MIMO radar systems: a reduced-dimension music algorithm approach. Sensors. 24. https://doi.org/10.3390/s24092801

[33] XieQ, PanX, ZhaoF. Joint 2D-DOD and 2D-DOA estimation in Bistatic MIMO radar via tensor ring decomposition. IEEE Signal Process Lett, 2023, 30: 1507-1511.

[34] YouD, LiuP, ShangW, ZhangY, KangY, XiongJ. An improved unscented Kalman filter algorithm for radar azimuth mutation. Int J Aerospace Eng, 2020, 2020: 1-10.

[35] WuL, LiuZ-M, HuangZ-T. Deep convolution network for direction of arrival estimation with sparse prior. IEEE Signal Process Lett, 2019, 26: 1688-1692.

[36] JiangM, XuG, PeiH, FengZ, MaS, ZhangH, HongW. 4D high-resolution imagery of point clouds for automotive mmWave radar. IEEE Trans Intell Transport Syst, 2024, 25: 998-1012.

[37] ZhangY, HuangY, TaoJ, WenC, HanY, LiaoG, HongW. STNet: a space-time network solution for gridless DOA estimation with small snapshots for automotive radar system. IEEE Trans Intell Transp Syst, 2024.

[38] Huang X, Zhu J, Tian Z, Xu K, Liu Y (2024) An adaptive algorithm for generating 3D point clouds of the human body based on 4D millimeter-wave radar. Rev Sci Instrum. 95. https://doi.org/10.1063/5.0181265

[39] Shi L-F, Lv Y-F, Yin W, Shi Y (2023) Autonomous multiframe point cloud fusion method for mmWave radar. IEEE Trans Instrum Meas. 72. https://doi.org/10.1109/TIM.2023.3302936

[40] ChipengoU. High fidelity physics-based simulation of a 512-channel 4D-radar sensor for automotive applications. IEEE Access, 2023, 11: 15242-15251.

[41] Prabhakara A, Jin T, Das A, Bhatt G, Kumari L, Soltanaghai E, Bilmes J, Kumar S, Rowe A (2023) High resolution point clouds from mmWave radar. In: 2023 IEEE International Conference on Robotics and Automation (ICRA). pp. 4135–4142. IEEE, London, United Kingdom. https://doi.org/10.1109/ICRA48891.2023.10161429

[42] Cai P, Sur S (2022) MilliPCD: beyond traditional vision indoor point cloud generation via handheld millimeter-wave devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol 6, 1–24. https://doi.org/10.1145/3569497

[43] LuG, HeZ, ZhangS, HuangY, ZhongY, LiZ, HanY. A novel method for improving point cloud accuracy in automotive radar object recognition. IEEE Access, 2023, 11: 78538-78548.

[44] ChengY, SuJ, JiangM, LiuY. A novel radar point cloud generation method for robot environment perception. IEEE Trans Robot, 2022, 38: 3754-3773.

[45] SchneiderDA, RoeschM, TessmannA, ZwickT. Hybrid beam-steering OFDM-MIMO radar: high 3-D resolution with reduced channel count. IEEE Trans Microw Theory Tech, 2021, 69: 5057-5071.

[46] GottingerM, HoffmannM, ChristmannM, SchuetzM, KirschF, GuldenP, VossiekM. Coherent automotive radar networks: the next generation of radar-based imaging and mapping. IEEE J Microw, 2021, 1: 149-163.

[47] AlbabaA, BauduinM, VerbelenT, SahliH, BourdouxA. Forward-looking MIMO-SAR for enhanced radar imaging in autonomous mobile robots. IEEE Access, 2023, 11: 66934-66948.

[48] SunS, ZhangYD. 4D automotive radar sensing for autonomous vehicles: a sparsity-oriented approach. IEEE J Sel Top Signal Process, 2021, 15: 879-891.

[49] Piao W, Zhao X, Li Z (2023) MMGraphSLAM: autonomous indoor positioning based on millimeter wave GraphSLAM. Measurement. 220. https://doi.org/10.1016/j.measurement.2023.113300

[50] ChenX, WangH, YangQ, ZengY, DengB. An efficient MMW 3-D imaging algorithm for near-field MIMO-SAR with nonuniform transmitting array. IEEE Antennas Wireless Propagation Lett, 2022, 21: 2035-2039.

[51] ChenX, WangH, DengG, YangQ, ZengY, DengB. Efficient millimeter-wave imaging algorithm for layered dielectrics based on MIMO-SAR With nonuniform transmitting array. IEEE Antennas Wireless Propagation Lett, 2023, 22: 323-327.

[52] DuerrA, BoehmD, SchwarzD, HaefnerS, ThomaeR, WaldschmidtC. Coherent measurements of a multistatic MIMO radar network with phase noise optimized non-coherent signal synthesis. IEEE J Microw, 2022, 2: 239-252.

[53] SmithJW, TorlakM. Deep-learning-based multiband signal fusion for 3-D SAR superresolution. IEEE Trans Aerospace Electron Syst, 2024, 60: 8-24.

[54] VasanelliC, BoegelsackF, WaldschmidtC. Reducing the radar cross section of microstrip arrays using AMC structures for the vehicle integration of automotive radars. IEEE Trans Antennas Propagation, 2018, 66: 1456-1464.

[55] WangY, HuangY, LiuJ, ZhangR, ZhangH, HongW. Interference mitigation for automotive FMCW radar with tensor decomposition. IEEE Trans Intell Transp Syst, 2024.

[56] SiddiqK, HobdenMK, PennockSR, WatsonRJ. Phase noise in FMCW radar systems. IEEE Trans Aerospace Electron Syst, 2019, 55: 70-81.

[57] YuanM, JiangC, ZhangY, BaoJ, LiC. Interference suppression for automotive millimeter-wave radars with fused lasso. IEEE Trans Intell Transp Syst, 2024.

[58] JanoudiV, SchoederP, GrebnerT, AppenrodtN, DickmannJ, WaldschmidtC. Signal Model for Coherent processing of uncoupled and low frequency coupled MIMO radar networks. IEEE J Microw, 2024, 4: 69-85.

[59] LinY-C, LeeT-S, LinC-H. Interference avoidance and cancellation in automotive OFDM radar networks. J Signal Process Syst Signal Image Video Technol, 2020, 92: 1383-1396.

[60] PetrovV, FodorG, KokkoniemiJ, MoltchanovD, LehtomakiJ, AndreevS, KoucheryavyY, JunttiM, ValkamaM. On unified vehicular communications and radar sensing in millimeter-wave and low terahertz bands. IEEE Wirel Commun, 2019, 26: 146-153.

[61] Jiang T, Zhuang L, An Q, Wang J, Xiao K, Wang A (2023) T-RODNet: transformer for vehicular millimeter-wave radar object detection. IEEE Trans Instrum Meas. 72. https://doi.org/10.1109/TIM.2022.3229703

[62] GuanZ, ChenY, LeiP, LiD, ZhaoY. Application of hash function on FMCW based millimeter-wave radar against DRFM Jamming. IEEE Access, 2019, 7: 92285-92295.

[63] Ai M, Yang W, Xu L, Yan G, Yue L, Yang Z (2024) Fast algorithm for automotive radar target detection in mutual interference. IEICE Commun Express 13;26–29. https://doi.org/10.23919/comex.2023XBL0118

[64] WangY, ZhangQ, WeiZ, LinY, FengZ. Performance analysis of coordinated interference mitigation approach for automotive radar. IEEE Internet Things J, 2023, 10: 11683-11695.

[65] WangY, HuangY, WenC, ZhouX, LiuJ, HongW. Mutual interference mitigation for automotive FMCW radar with time and frequency domain decomposition. IEEE Trans Microw Theory Tech, 2023, 71: 5028-5044.

[66] YanG, LuoZ, LiuZ, LiY, ShiB, ZhangK. SensorX2Vehicle: online sensors-to-vehicle rotation calibration methods in road scenarios. IEEE Robot Automation Lett, 2024, 9: 3775-3782.

[67] LeeC-L, HouC-Y, WangC-C, LinW-C. Extrinsic and temporal calibration of automotive radar and 3-D LiDAR in factory and on-road calibration settings. IEEE Open J Intell Transp Syst, 2023, 4: 708-719.

[68] Zhao C, Shi Y, Du Y, Jiang S, Ji Y, Zhao X (2024) A rapid and convenient spatiotemporal calibration method of roadside sensors using floating connected and automated vehicle data. IEEE Trans. Intell Transp Syst 1–14. https://doi.org/10.1109/TITS.2024.3366758

[69] Zhang J, Zhang S, Peng G, Zhang H, Wang D (2022) 3DRadar2ThermalCalib: accurate extrinsic calibration between a 3D mmWave radar and a thermal camera using a spherical-trihedral. In: 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC). pp. 2744–2749. IEEE, Macau, China. https://doi.org/10.1109/ITSC55140.2022.9922522

[70] Paek DH, Kong SH, Wijaya KT (2022) K-radar: 4d radar object detection for autonomous driving in various weather conditions. Advances in Neural Information Processing Systems, 35, 3819–3829. https://doi.org/10.48550/arXiv.2206.08171

[71] DomhofJ, KooijJFP, GavrilaDM. A joint extrinsic calibration tool for radar, camera and lidar. IEEE Trans Intell Veh, 2021, 6: 571-582.

[72] ZhangC, WeiJ, DaiJ, QuS, SheX, WangZ. A roadside millimeter-wave radar calibration method based on connected vehicle technology. IEEE Intell Transport Syst Mag, 2023, 15: 117-131.

[73] ZhaoC, DingD, ShiY, JiY, DuY. Graph Matching-based spatiotemporal calibration of roadside sensors in cooperative vehicle-infrastructure systems. IEEE Trans Intell Transp Syst, 2024.

[74] ZhangC, WeiJ, HuAS, FuP. A novel method for calibration and verification of roadside millimetre-wave radar. IET Intel Transport Syst, 2022, 16: 408-419.

[75] ZhangD, ZhangX, XieY, ZhangF, WangX, LiY, ZhangD. LoCal: an automatic location attribute calibration approach for large-scale deployment of mmwave-based sensing systems. Proceedings ACM Interact Mobile Wearable Ubiquitous Technol, 2023, 7: 1-27.

[76] Meyer M, Kuschk G (2019) Automotive radar dataset for deep learning based 3d object detection. In 2019 16th european radar conference (EuRAD). pp. 129–132. IEEE

[77] Nowruzi FE, Kolhatkar D, Kapoor P, Al Hassanat F, Heravi EJ, Laganiere R (2020) Deep open space segmentation using automotive radar. In 2020 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM), pp. 1-4. IEEE. https://doi.org/10.1109/icmim48759.2020.9299052

[78] Zheng L, Ma Z, Zhu X, Tan B, Li S, Long K, Sun W, Chen S, Zhang L, Wan M, Huang L, Bai J (2022) TJ4DRadSet: a 4D radar dataset for autonomous driving. In: 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC). pp. 493–498. IEEE, Macau, China. https://doi.org/10.1109/ITSC55140.2022.9922539

[79] Matuszka T, Barton I, Butykai Á, Hajas P, Kiss D, Kovács D, Kunsági-Máté S, Lengyel P, Németh G, Pető L, Ribli D, Szeghy D, Vajna S, Varga B (2023) aiMotive dataset: a multimodal dataset for robust autonomous driving with long-range perception. https://arxiv.org/abs/2211.09445

[80] Kim G, Park YS, Cho Y, Jeong J, Kim A (2020) MulRan: multimodal range dataset for urban place recognition. In: 2020 IEEE International Conference on Robotics and Automation (ICRA). pp. 6246–6253. IEEE, Paris, France. https://doi.org/10.1109/ICRA40945.2020.9197298

[81] Wang Y, Wang G, Hsu H-M, Liu H, Hwang J-N. Rethinking of radar’s role: a camera-radar dataset and systematic annotator via coordinate alignment

[82] Deziel J-L, Merriaux P, Tremblay F, Lessard D, Plourde D, Stanguennec J, Goulet P, Olivier P (2021) PixSet: an opportunity for 3D computer vision to go beyond point clouds with a full-waveform LiDAR dataset. In: 2021 IEEE International Intelligent Transportation Systems Conference (ITSC). pp. 2987–2993. IEEE, Indianapolis, IN, USA. https://doi.org/10.1109/ITSC48978.2021.9565047

[83] Zhang A, Nowruzi FE, Laganiere R (2021) RADDet: range-azimuth-doppler based radar object detection for dynamic road users. In: 2021 18th Conference on Robots and Vision (CRV). pp. 95–102. IEEE, Burnaby, BC, Canada. https://doi.org/10.1109/CRV52889.2021.00021

[84] Gusland D, Christiansen JM, Torvik B, Fioranelli F, Gurbuz SZ, Ritchie M (2021) Open radar initiative: large scale dataset for benchmarking of micro-Doppler recognition algorithms. In 2021 IEEE Radar Conference (RadarConf21) , pp. 1–6. IEEE. https://doi.org/10.1109/radarconf2147009.2021.9455239

[85] Madani S, Guan J, Ahmed W, Gupta S, Hassanieh H (2022) Radatron: accurate detection using multi-resolution cascaded MIMO radar. In: Avidan S., Brostow G., Cissé M., Farinella G.M., Hassner T. (eds) Computer Vision–ECCV 2022. ECCV 2022. Lecture Notes in Computer Science, vol 13699. Springer, Cham. https://doi.org/10.1007/978-3-031-19842-7_10

[86] Palffy A, Pool E, Baratam S, Kooij JF, Gavrila DM (2022) Multi-class road user detection with 3+1d radar in the view-of-delft dataset. IEEE Robotics and Automation Letters, 7(2), 4961–4968. https://doi.org/10.1109/lra.2022.3147324

[87] LimT-Y, MarkowitzSA, DoMN. RaDICaL: a synchronized FMCW radar, depth, IMU and RGB camera data dataset with low-level FMCW radar signals. IEEE J Select Top Signal Process, 2021, 15: 941-953.

[88] Kramer A, Harlow K, Williams C, Heckman C (2022) ColoRadar: the direct 3D millimeter wave radar dataset. 41(4), 351–360. https://doi.org/10.1177/02783649211068535

[89] ChoiM, YangS, HanS, LeeY, LeeM, ChoiKH, KimK-S. MSC-RAD4R: ROS-based automotive dataset with 4D radar. IEEE Robot Autom Let, 2023, 8: 7194-7201.

[90] Zhang X, Wang L, Chen J, Fang C, Yang L, Song Z, Yang G, Wang Y, Zhang X, Li J, Li Z, Yang Q, Zhang Z, Ge SS (2023) Dual radar: a multi-modal dataset with dual 4D radar for autonomous driving. https://arxiv.org/abs/2310.07602

[91] Zhang J, Zhuge H, Liu Y, Peng G, Wu Z, Zhang H, Lyu Q, Li H, Zhao C, Kircali D, Mharolkar S, Yang X, Yi S, Wang Y, Wang D (2023) Ntu4dradlm: 4d radar-centric multi-modal dataset for localization and mapping. In 2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC), pp. 4291–4296. IEEE. https://doi.org/10.1109/itsc57777.2023.10422606

[92] RaiPK, StrokinaN, GhabchelooR. 4DEgo: ego-velocity estimation from high-resolution radar data. Front Signal Process, 2023, 31198205.

[93] Weston R, Gadd M, De Martini D, Newman P, Posner I (2022) Fast-MbyM: leveraging translational invariance of the fourier transform for efficient and accurate radar odometry. In: 2022 International Conference on Robotics and Automation (ICRA). pp. 2186–2192. IEEE, Philadelphia, PA, USA. https://doi.org/10.1109/ICRA46639.2022.9812063

[94] ZhuangY, WangB, HuaiJ, LiM. 4D iRIOM: 4D imaging radar inertial odometry and mapping. IEEE Robot Autom Lett, 2023, 8: 3246-3253.

[95] Ng YZ, Choi B, Tan R, Heng L (2021) Continuous-time radar-inertial odometry for automotive radars. In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 323–330. IEEE, Prague, Czech Republic. https://doi.org/10.1109/IROS51168.2021.9636014

[96] Zhuoins G, Lu S, Xiong L, Zhouins H, Zheng L, Zhou M (2024) 4DRVO-Net: deep 4D radar–visual odometry using multi-modal and multi-scale adaptive fusion. IEEE Trans. Intell. Veh. 1–15. https://doi.org/10.1109/TIV.2023.3330956

[97] YangS, ChoiM, HanS, ChoiK-H, KimK-S. 4D radar-camera sensor fusion for robust vehicle pose estimation in foggy environments. IEEE Access, 2023, 12: 1-1.

[98] XueB, ZhangG, LeungH, WangL. An applied frequency scaling algorithm based on local stretch factor for near-field miniature millimeter-wave radar imaging. IEEE Trans Microw Theory Tech, 2022, 70: 2786-2801.

[99] LiX, ZhangH, ChenW. 4D radar-based pose graph SLAM With ego-velocity pre-integration factor. IEEE Robot Autom Lett, 2023, 8: 5124-5131.

[100] Zhang G, Chi G, Zhang Y, Ding X, Yang Z (2023) Push the limit of millimeter-wave radar localization. ACM Trans Sensor Netw 19. https://doi.org/10.1145/3570505

[101] LuS, ZhuoG, XiongL, ZhuX, ZhengL, HeZ, ZhouM, LuX, BaiJ. Efficient deep-learning 4D automotive radar odometry method. IEEE Trans Intell Veh, 2024, 9: 879-892.

[102] ChenH, LiuY, ChengY. DRIO: robust radar-inertial odometry in dynamic environments. IEEE Robot Autom Lett, 2023, 8: 5918-5925.

[103] ChengY, PangC, JiangM, LiuY. Relocalization based on millimeter wave radar point cloud for visually degraded environments. J Field Robot, 2023, 40: 901-918.

[104] Hong Nhung Nguyen, Seongwook Lee, Tien-Tung Nguyen, Yong-Hwa Kim (2022) One-shot learning-based driver’s head movement identification using a millimetre-wave radar sensor. IET Radar Sonar Navigation 16;825–836. https://doi.org/10.1049/rsn2.12223

[105] ZhaoW, WangT, TanA, RenC. Nighttime pedestrian detection based on a fusion of visual information and millimeter-wave radar. IEEE Access, 2023, 11: 68439-68451.

[106] XiangY, MuA, TangL, YangX, WangG, GuoS, CuiG, KongL. Person identification method based on pointnet plus plus and adversarial network for mmWave radar. IEEE Internet Things J, 2024, 11: 10104-10114.

[107] CaoZ, DingW, ChenR, ZhangJ, GuoX, WangG. A joint global-local network for human pose estimation with millimeter wave radar. IEEE Internet Things J, 2023, 10: 434-446.

[108] SongW, YangY, FuM, QiuF, WangM. Real-time obstacles detection and status classification for collision warning in a vehicle active safety system. IEEE Trans Intell Transp Syst, 2018, 19: 758-773.

[109] ZhaoZ, SongY, CuiF, ZhuJ, SongC, XuZ, DingK. Point cloud features-based kernel SVM for human-vehicle classification in millimeter wave radar. IEEE Access, 2020, 8: 26012-26021.

[110] GaoX, XingG, RoyS, LiuH. RAMP-CNN: a novel neural network for enhanced automotive radar object recognition. IEEE Sens J, 2021, 21: 5119-5132.

[111] LiuY, ChangS, WeiZ, ZhangK, FengZ. Fusing mmWave radar with camera for 3-D detection in autonomous driving. IEEE Internet Things J, 2022, 9: 20408-20421.

[112] XiongW, LiuJ, HuangT, HanQ-L, XiaY, ZhuB. LXL: LiDAR excluded lean 3D object detection with 4D imaging radar and camera fusion. IEEE Trans Intell Vehicles, 2024, 9: 79-92.

[113] LeiM, YangD, WengX. Integrated sensor fusion based on 4D MIMO radar and camera: a solution for connected vehicle applications. IEEE Veh Technol Mag, 2022, 17: 38-46.

[114] Li W, Guan Y, Chen L, Sun L (2018) Millimeter-wave radar and machine vision-based lane recognition. Int J Pattern Recognit Artif Intell 32. https://doi.org/10.1142/S0218001418500155

[115] LiuS, LyuC, GongH. Vehicle video surveillance system based on image fusion and parallel computing. Int J Circuit Theory Appl, 2021, 49: 1532-1547.

[116] Tao Z, Li Y, Wang P, Ji L (2022) Traffic incident detection based on mmWave radar and improvement using fusion with camera. J Adv Trans. 2022. https://doi.org/10.1155/2022/2286147

[117] Hasanujjaman M, Chowdhury MZ, Jang YM (2023) Sensor fusion in autonomous vehicle with traffic surveillance camera system: detection, localization, and AI networking. Sensors 23. https://doi.org/10.3390/s23063335

[118] Zhu Z, Guo S, Chen J, Xue S, Xu Z, Wu P, Cui G, Kong L (2023) Non-line-of-sight targets localization algorithm via joint estimation of DoD and DoA. IEEE Trans Instrum Meas 72. https://doi.org/10.1109/TIM.2023.3323003

[119] CaoL, WangT, WangD, DuK, LiuY, FuC. Lane determination of vehicles based on a novel clustering algorithm for intelligent traffic monitoring. IEEE Access, 2020, 8: 63004-63017.

[120] Zhang Y, Ma Z, Han W, Li T, Hou F, Song X (2022) Intelligent traffic detection with millimeter-wave radar and camera. In: Cen, F. and Tan, G. (eds.) International Conference on Intelligent Traffic Systems and Smart City (ITSSC 2021). p. 29. SPIE, Zhengzhou, China. https://doi.org/10.1117/12.2627800

[121] LiJ, LiB, WangL, LiuW. Passive multiuser gait identification through micro-doppler calibration using mmWave radar. IEEE Internet Things J, 2024, 11: 6868-6877.

[122] Yao Y, Zhang H, Xia P, Liu C, Geng F, Bai Z, Du L, Chen X, Wang P, Han B, Yang T, Fang Z (2023) mmSignature: semi-supervised human identification system based on millimeter wave radar. Eng Appl Artif Intell 126. https://doi.org/10.1016/j.engappai.2023.106939

[123] Wang S, Cao D, Liu R, Jiang W, Yao T, Lu CX (2023) Human parsing with joint learning for dynamic mmWave radar point cloud. Proceed ACM Interactive Mobile Wearable Ubiquitous Technologies-imwut. https://doi.org/10.1145/3580779

[124] XuD, YuW, WangB, LiuS. Millimeter wave real-time tracking and imaging of moving objects based on virtual MIMO array and state vector prediction. IEEE Access, 2023, 11: 115854-115864.

[125] Zhou J, Le Kernec J (2023) 4D radar simulator for human activity recognition. IET Radar Sonar Navi. 18:rsn2.12468. https://doi.org/10.1049/rsn2.12468

[126] WangY, JiangZ, LiY, HwangJ-N, XingG, LiuH. RODNet: a real-time radar object detection network cross-supervised by camera-radar fused object 3D localization. IEEE J Select Topics Signal Process, 2021, 15: 954-967.

[127] Liu P, Yu G, Wang Z, Zhou B, Chen P (2022) Object classification based on enhanced evidence theory: radar-vision fusion approach for roadside application. IEEE Trans Instrum Meas 71. https://doi.org/10.1109/TIM.2022.3154001

[128] LiuJ, ZhaoQ, XiongW, HuangT, HanQ-L, ZhuB. SMURF: spatial multi-representation fusion for 3D object detection with 4D imaging radar. IEEE Trans Intell Vehicles, 2024, 9: 799-812.

[129] XiaoY, YinS, CuiG, YaoL, FangZ, ZhangW. A near-field area object detection method for intelligent vehicles based on multi-sensor information fusion. World Electric Vehicle J, 2022, 13160.

[130] PalffyA, KooijJFP, GavrilaDM. Detecting darting out pedestrians with occlusion aware sensor fusion of radar and stereo camera. IEEE Trans Intell Vehicles, 2023, 8: 1459-1472.

[131] ZhengR, SunS, LiuH, WuT. Deep-Neural-network-enabled vehicle detection using high-resolution automotive radar imaging. IEEE Trans Aerosp Electron Syst, 2023, 59: 4815-4830.

[132] KurniawanIT, TrilaksonoBR. ClusterFusion: leveraging radar spatial features for radar-camera 3D object detection in autonomous vehicles. IEEE Access, 2023, 11: 121511-121528.

[133] ZhouT, ChenJ, ShiY, JiangK, YangM, YangD. Bridging the view disparity between radar and camera features for multi-modal fusion 3D object detection. IEEE Trans Intell Vehicles, 2023, 8: 1523-1535.

Funding

the Natural Science Foundation of Jiangsu Province(BK20243064)

RIGHTS & PERMISSIONS

The Author(s)