To address the challenges of varied aircraft skin hole detection types and susceptibility to noise, this paper proposes a method based on the perspective of dual contour edge information fusion. The core method combines stereoscopic vision and structured light dual contour information consistently, focusing on extracting edge point information around the hole edge to achieve precise detection of circular holes. In this approach, a line multi-directional gradient feature detector (LMGFD) is introduced for locating the holes from plane stereoscopic image. Furthermore, we establish a three-dimensional (3D) circular hole detection method (BPCircle) based on the dual contour edge information fusion. Finally, experiments demonstrate that our proposed method achieves superior accuracy and robustness based on public benchmark dataset and our own collected standard IPCDS dataset (including two-dimensional (2D) images, 3D point clouds, and measured data of three-coordinate measuring machine). The dataset and code can be found from https://github.com/Nicho1sdqw/123.
| [1] |
Chen L, Wang X J, Feng D Y. Design of bolt hole identification and positioning system based on machine vision. Construction machinery & equipment. 2023, 54(4): 99-103[J]
|
| [2] |
CHEN M, ZHOU L, ZHANG Y, et al. Aircraft skin countersink primitive extraction from 3-D measurement point clouds via deep clustering and fitting[J]. IEEE transactions on instrumentation and measurement, 2024: 1–9.
|
| [3] |
Hu Y, Fang X, Qin Y, et al. . Weighted geometric circle fitting for the Brogar ring: parameter-free approach and bias analysis. Measurement. 2022, 192: 110832 J]
|
| [4] |
Scitovski R, Sabo K. A combination of K-means and DBSCAN algorithm for solving the multiple generalized circle detection problem. Advances in data analysis and classification. 2021, 15(1): 83-98 J]
|
| [5] |
Zhang Z H, Zhong B J, Wang Z K, et al. . Ellipse detection algorithm for processing color images. Laser & optoelectronics progress. 2023, 60(12): 196-202[J]
|
| [6] |
LI Z, MENG C, LI D, et al. Single view-based pose estimation of unknown circular object with RGB-D camera[J]. IEEE transactions on aerospace and electronic systems, 2024: 1–13.
|
| [7] |
Zhang W, Zhou F, Liu Y, et al. . Object defect detection based on data fusion of a 3D point cloud and 2D image. Measurement science and technology. 2022, 34(2): 025002 J]
|
| [8] |
Xiao A, Huang J, Guan D, et al. . Unsupervised point cloud representation learning with deep neural networks: a survey. IEEE transactions on pattern analysis and machine intelligence. 2023, 45(9): 11321-11339 J]
|
| [9] |
Chen H H, Wei Z Y, Xie Q, et al. . Extraction method of multi-circular hole primitives on aircraft surface based on three-dimensional point cloud deep learning. Chinese journal of mechanical engineering. 2022, 58(14): 190-202 J]
|
| [10] |
Yu H Y, Cheng Y N, Sun Y H, et al. . Rapid detection method of verticality of aviation hole making. Acta metrologica sinica. 2023, 44(6): 837-843[J]
|
| [11] |
Tian Q L, Xiong T C, Huang X, et al. . A rivet hole location extraction method based on scattered point clouds. Aviation manufacturing technology. 2022, 65(7): 83-89[J]
|
| [12] |
Le T, Duan Y. Circle detection on images by line seg ment and circle completeness. 2016 IEEE International Conference on Image Processing (ICIP), September 25–28, 2016, Phoenix, AZ, USA. 2016, New York, IEEE: 3648-3652[C]
|
| [13] |
Salah M, Ayyad A, Ramadan M, et al. . High speed neuromorphic vision-based inspection of countersinks in automated manufacturing processes. Journal of intelligent manufacturing. 2024, 35: 3067-3081 J]
|
| [14] |
Lu X, Schaefer S, Luo J, et al. . Low rank matrix approximation for 3D geometry filtering. IEEE transactions on visualization and computer graphics. 2020, 28(4): 1835-1847 J]
|
| [15] |
WEI Z, CHEN H, TANG H, et al. Deep algebraic fitting for multiple circle primitives extraction from raw point clouds[EB/OL]. (2022-04-03) [2024-02-14]. https://arxiv.org/abs/2204.00920.
|
| [16] |
Wang Y, He F, Hou Z, et al. . Research on the algorithm of marker center positioning under the occlusion of thermoplastic film. 8th Symposium on Novel Photoelectronic Detection Technology and Applications, November 7–9, 2021, Kunming, China. 2022, Bellingham, SPIE: 12081213[C]
|
| [17] |
Huang H, Lin L, Tong R, et al. . Unet 3+: a full-scale connected Unet for medical image segmentation. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), May 4–8, 2020, Barcelona, Spain. 2020, New York, IEEE: 10551059[C]
|
| [18] |
Hou W. Research on automatic hole making technology of industrial robot based on Hough circle detection algorithm. International journal of wireless and mobile computing. 2023, 24(3–4): 352-360 J]
|
| [19] |
Borkowski J, Matuszewski BJ, Mroczka J, et al. . Geometric matching of circular features by least squares fitting. Pattern recognition letters. 2002, 23(7): 885-894 J]
|
| [20] |
Gao C, Bao S, Zhou C, et al. . Measuring methods of radius of curvature and tread circle-fitting studies for railway wheel profiles. Machines. 2023, 11(2): 181 J]
|
| [21] |
Scitovski R, Majstorovic S, Sabo K. A combination of RANSAC and DBSCAN methods for solving the multiple geometrical object detection problem. Journal of global optimization. 2021, 79(3): 669-686 J]
|
RIGHTS & PERMISSIONS
Tianjin University of Technology
PDF
