Parallel Design and Implementation of Stereo Vision Algorithm of Zhurong Mars Rover

Abstract

Aiming at the problem that the large amount of environmental perception calculation affects the walking efficiency in the rover detection task of celestial bodies outside the earth, the scheme selection， the parallel optimization engineering design and the efficient hardware implementation of stereo vision algorithm were proposed. Through the optimization design of algorithms suitable for parallel implementation, such as one-time look-up table of forward camera model， omitting redundant calculation， 3D point cloud generation and fast filtering, the amount of calculation for stereo vision was significantly reduced. Through the parallel implementation of hardware， the perception efficiency was improved by 8 times compared with that of “Yutu 2” Lunar rover. “Zhurong” Mars rover extensively used the algorithm for autonomous obstacle avoidance and completed a safe and efficient 1km-distance walk. The flight verification results show that the design is safe and effective under unknown environments and resource constraints of celestial bodies outside the earth, and can be used as the cornerstone of subsequent deep space missions.

Keywords

Zhurong Mars rover / stereo vision / parallel design / forward camera model / redundant calculation

References

[1] LEGER P C，TREBI-OLLENNU A，WRIGHT J，et al. Mars exploration rover surface operations：driving spirit at Gusev crater[C]//2005 IEEE International Conference on Systems，Man and Cybernetics. Waikoloa，HI，USA：IEEE，2005.
[2] BIESIADECKI J J,BAUMGARTNER E T,BONITZ R G,et al. Mars exploration rover surface operations:driving opportunity at Meridiani planum[J]. IEEE Robotics & Automation Magazine,2006,13(2):63-71
[3] NACHON M，BORGES S，EWING R，et al. Coupling Mars ground and orbital views：generate view sheds of Mastcam images from the Curiosity rover using ArcGIS and public datasets[J]. Earth and Space Science，7（9）：1-13.
[4] NASA. NASA's Mars Curiosity Debuts Autonomous Navigation[EB/OL]. （2013-8-27）[2021-10-11]. https://mars.nasa.gov/news/nasas-mars-curiosity-debuts-autonomous-navigation/.
[5] 魏祥泉,黄建明,顾冬晴,等. 火星车自主导航与路径规划技术研究[J]. 深空探测学报(中英文),2016,3(3):275-281
WEI X Q,HUANG J M,GU D Q,et al. Researches on the techniques of autonomous navigation and path planning for mars rover[J]. Journal of Deep Space Exploration,2016,3(3):275-281
[6] KLETTE R，SCHLUNS K，KOSCHAN A. Computer vision：three-dimensional data from images[M]. Singapore：Springer-Verlag Ltd.，1998.
[7] HIRSCHMVLLER H. Stereo Processing by Semiglobal Matching and Mutual Information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2008,30(2):328-341
[8] YANG G，MANELA J，HAPPOLD M，et al. Hierarchical deep stereo matching on high-resolution images[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition（CVPR）. Long Beach，CA，USA：IEEE，2019
[9] ZHANG J，RAMANAGOPALG M S，VASUDEVAN R，et al. LiStereo：generate dense depth maps from lidar and stereo imagery[C]//2020 IEEE International Conference on Robotics and Automation（ICRA）. Paris，France：IEEE，2019.
[10] 王保丰,毛晓艳,唐歌实,等. 月球车鱼眼相机的标定方法研究[J]. 宇航学报,2011,32(4):933-939
WANG B F,MAO X Y,TANG G S,et al. A calibration method for fish-eye camera of lunar rover[J]. Journal of Astronautics,2011,32(4):933-939
[11] 毛晓艳，张晋，张巍，等. 机器视觉中光学成像传感器安装方法[P]. 北京：国家专利局，2017.
[12] SZELISKI R. Computer vision：algorithms and applications[M]. Newyork：Springer，2010.
[13] MAO X Y，HUANG X Y. The simulation method for wide-angle fish-eye image with distortion[C]//2016 12th World Congress on Intelligent Control and Automation （WCICA）. Guilin：WCICA，2016.
[14] FRASER C S. Photogrammetric camera component calibration：a review of analytical techniques[M]. Berlin：Springer Publication，2001.
[15] MALLON J，WHELAN P F. Precise radial un-distortion of images[C]//Proceedings of the 17th International Conference on Pattern Recognition，2004. ICPR 2004. Cambridge，UK：IEEE，2004.
[16] 邢琰，刘祥，滕宝毅，等. 一种适用于低信噪比图像的障碍快速识别方法[P]. 北京：国家专利局，2019.