Non-cooperative target extraction in complex industrial environment based on image segmentation

Abstract

In complex industrial scenes, it is difficult to acquire high-precision non-cooperative target pose under monocular visual servo control. This paper presents a new method of target extraction and high-precision edge fitting for the wheel of the sintering trolley in steel production, which fuses multiple target extraction algorithms adapting to the working environment of the target. Firstly, based on obvious difference between the pixels of the target image and the non-target image in the gray histogram, these pixels were classified and then segmented in intraclass, removing interference factors and remaining the target image. Then, multiple segmentation results were merged and a final target image was obtained after small connected regions were eliminated. In the edge fitting stage, the edge fitting method with best-circumscribed rectangle was proposed to accurately fit the circular target edge. Finally, PnP algorithm was adopted for pose measurement of the target. The experimental results showed that the average estimation error of pose angle γ with respect to the z-axis rotation was 0.234 6°, the average measurement error of pose angle α with respect to the x-axis rotation was 0.170 3°, and the average measurement error of pose angle β with respect to the y-axis rotation was 0.227 5°. The proposed method has practical application value.

Keywords

digital image processing / industrial environment / non-cooperative target / pose measurement

References

[1] TIAN G B, WANG J, WANG B W. Monocular camera non-cooperative target extraction and pose detection. Infrared and Laser Engineering, 2021, 50(12): 536-544.

[2] WANG X J, YU C, KAI Z . Methods of monocular pose measurement based on planar objects. Optics and Precision Engineering, 2017, 25(1): 274-280.

[3] LAO D B, ZHANG H J, XIONG Z, et al. Automatic measurement method of attitude based on monocular vision. Acta Photonica Sinica, 2019, 48(3): 315001.

[4] JIN Z M, WANG L, LIU H H, et al. Monocular-based pose estimation of non-cooperative space targets using EKF and EKPF//2020 13th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics, October 17-19, 2020, Chengdu, China. New York: IEEE, 2020: 46-51.

[5] MIAO R L, LI J L, JIU H F, et al. Research on monocular-vision indoor location technology for olfactory-based searching robots. Journal of Huazhong University of Science and Technology (Nature Science Edition), 2019, 47(4): 19-24.

[6] MEI J P, WANG H, ZHANG D, et al. Dynamic target tracking algorithm of a high-speed parallel robot based on monocular vision. Journal of Tianjin University, 2020, 53(2): 138-146.

[7] LIN T T, JIANG H, LI R H, et al. Non-cooperative target visual pose measurement and ground verification method. Journal of Dalian Jiaotong University, 2020,41(3): 34-40.

[8] PENG W, ZHOU Q T, SUN C K. Study of pose estimation based on multiple feature points topological determination. Infrared and Laser Engineering, 2017, 46(5): 517001.

[9] XU L Z, FU Q W, TAO W, et al. Monocular vehicle pose estimation based on 3D model. Optics and Precision Engineering, 2021, 29(6): 1346-1355.

[10] ZHANG C Y, ZHAO Q, PHILIP CHEN C L, et al. Deep compression of probabilistic graphical networks. Pattern Recognition, 2019, 96: 106979.

[11] SUN X Y, ZHU X J, WANG P Y, et al. A review of robot control with visual servoing//2018 IEEE 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems, July 19-23, 2018, Tianjin, China. New York: IEEE, 2018: 116-121.

[12] WU C R, ZHANG S Y, HE Z X. A rapid detection method of complex background ellipse based on gradient classification. Journal of Zhejiang University Engineering, 2018, 52(5): 943-950.

[13] GUO X G, WANG J, CHENG C. Image segmentation algorithm combining hierarchical clustering algorithm and graph-based segmentation algorithm. Journal of National University of Defense Technology, 2022, 44(3): 194-200.

[14] SHEN X J, ZHANG H, CHEN H P, et al. Fast recursive multi-threshold segmentation algorithm. Journal of Jilin University (Engineering and Technology Edition), 2016, 46(2): 528-534.

[15] LI D J, GUO S, YANG L. Yarn defect detection based on improved image threshold segmentation algorithm. Journal of Textile Research, 2021, 42(3): 82-88.

[16] XIAO M Y, LI X F. Multi-scale 3D Otsu thresholding algorithm based on Gaussian decomposition. Journal of Jilin University (Engineering and Technology Edition), 2017, 47(1): 255-261.