Vision-based long-distance lane perception and front vehicle location for full autonomous vehicles on highway roads

Abstract

A new vision-based long-distance lane perception and front vehicle location method was developed for decision making of full autonomous vehicles on highway roads. Firstly, a real-time long-distance lane detection approach was presented based on a linear-cubic road model for two-lane highways. By using a novel robust lane marking feature which combines the constraints of intensity, edge and width, the lane markings in far regions were extracted accurately and efficiently. Next, the detected lane lines were selected and tracked by estimating the lateral offset and heading angle of ego vehicle with a Kalman filter. Finally, front vehicles were located on correct lanes using the tracked lane lines. Experiment results show that the proposed lane perception approach can achieve an average correct detection rate of 94.37% with an average false positive detection rate of 0.35%. The proposed approaches for long-distance lane perception and front vehicle location were validated in a 286 km full autonomous drive experiment under real traffic conditions. This successful experiment shows that the approaches are effective and robust enough for full autonomous vehicles on highway roads.

Keywords

lane detection / lane tracking / front vehicle location / full autonomous vehicle / feature line section / autonomous driving / vision

References

[1] AmditisA., BertolazziE., BimpasM., BiralF., BosettiP., LioD. M., DanielssonL., GallioneA., LindH., SaroldiA., SjogrenA.. A holistic approach to the integration of safety applications: The INSAFES subproject within the European framework programme 6 integrating project PReVENT [J]. IEEE Transactions on Intelligent Transportation Systems, 2010, 11(3): 554-566

[2] AmditisA., BimpasM., ThomaidisG., TsogasM., NettoM., MammarS., BeutnerA., MohlerN., WirthgenT., ZipserS., EtemadA., LioD. M., CicilloniR.. A situation-adaptive lane-keeping support system: Overview of the SAFELANE approach [J]. IEEE Transactions on Intelligent Transportation Systems, 2010, 11(3): 617-629

[3] KwonW., LeeS.. Performance evaluation of decision making strategies for an embedded lane departure warning system [J]. Journal of Robotic Systems, 2002, 19(10): 499-509

[4] LEE J W, KEE C D, YI U K, A new approach for lane departure identification [C]// Proceedings of IEEE Intelligent Vehicles Symposium. Columbus, OH, 2003: 100–105.

[5] MccallJ. C., TrivediM. M.. Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation [J]. IEEE Transactions on Intelligent Transportation Systems, 2006, 7(1): 20-37

[6] MCCALL J C, TRIVEDI M M. Visual context capture and analysis for driver attention monitoring [C]// Proceedings of IEEE Conference on Intelligent Transportation Systems. Washington D C, 2004: 332–337.

[7] SALVUCCI D D. Inferring driver intent: A case study in lane-change detection [C]// Proceedings of Human Factors Ergonomics Society 48th Annual Meeting. New Orleans, LA, 2004: 2228–2231.

[8] BertozziM., BroggiA.. GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection [J]. IEEE Transactions on Image Process, 1998, 7(1): 62-81

[9] EIDEHALL A, GUSTAFSSON F. Obtaining reference road geometry parameters from recorded sensor data [C]// Proceedings of IEEE Intelligent Vehicles Symposium. Tokyo, Japan, 2006: 256–260.

[10] WangY., TeohE. K., ShenD.-gang.. Lane detection and tracking using B-Snake [J]. Image Vision Computing, 2004, 22(4): 269-280

[11] CHEN Qiang, WANG Hong. A real-time lane detection algorithm based on a hyperbola-pair model [C]// Proceedings of IEEE Intelligent Vehicles Symposium. Tokyo, Japan, 2006: 510–515.

[12] HENDRIK W, PHILIPP L, GERD W. Vehicle tracking with lane assignment by camera and lidar sensor fusion [C]// Proceedings of IEEE Intelligent Vehicles Symposium. Xi’an, China, 2009: 513–520.

[13] SIMOND N. Reconstruction of the road plane with an embedded stereorig in urban environments [C]// Proceedings of IEEE Intelligent Vehicles Symposium. Tokyo, Japan, 2006: 70–75.

[14] HeY.-h., WangH., ZhangBo.. Color-based road detection in urban traffic scenes [J]. IEEE Transactions on Intelligent Transportation Systems, 2004, 5(4): 309-318

[15] RASMUSSEN C. Texture-based vanishing point voting for road shape estimation [C]// Proceedings of British Machine Vision Conference. Kingston, UK, 2004: 470–477.

[16] WangY., BaiL., FairhurstM.. Robust road modeling and tracking using condensation [J]. IEEE Transactions on Intelligent Transportation Systems, 2008, 9(4): 570-579

[17] JUNG R, KELBER C R. A robust linear-parabolic model for lane following [C]// Proceedings of Brazilian Symposium on Computer Graphics and Image. Sao Leopoldo, Brazil, 2004: 72–79.

[18] KimZ.. Robust lane detection and tracking in challenging scenarios [J]. IEEE Transactions on Intelligent Transportation Systems, 2008, 9(1): 16-26

[19] LIU Xin, SUN Zhen-ping, HE Han-gen. On-road vehicle detection fusing radar and vision [C]// Proceedings of IEEE International Conference on Vehicular Electronics and Safety. Beijing, China, 2011: 150–154.

[20] LIU Feng, SPARBERT J, STILLER C. IMMPDA vehicle tracking system using asynchronous sensor fusion of radar and vision [C]// Proceedings of IEEE Intelligent Vehicles Symposium. Eindhoven, Netherlands, 2008: 168–173.

[21] TzomakasC., SeelenW.Vehicle detection in traffic scenes using shadows [R], 1998Bochum, GermanyInstitut fur Neuroinformatik, Ruht-Universitat

[22] XiaoL.-y., GaoFeng.. Effect of information delay on string stability of platoon of automated vehicles under typical information frameworks [J]. Journal of Central South University of Technology, 2010, 17(6): 1271-1278

[23] LIU Xin, DAI Bin, HE Han-gen. Real-time on-road vehicle detection combining specific shadow segmentation and SVM classification [C]// Proceedings of International Conference on Digital Manufacturing and Automation. Zhangjiajie, China, 2011: 885–888.