Pin-retraction detection for aerospace electrical connectors based on binocular stereo vision

Abstract

Electrical connectors are core functional components in aerospace electrical systems. Pin retraction may lead to signal transmission interruption and even system failure, directly affecting the reliability of electrical equipment and causing incalculable consequences. We propose a high-precision pin-retraction detection method that integrates binocular stereo vision with a multi-constrained optimization matching algorithm, aiming to achieve universal recognition of pins across different connector models and robust detection of pin retraction in complex scenarios. In this study, the Delaunay triangulation algorithm is employed to eliminate the misidentified pins from the template matching algorithm. Furthermore, the pin recognition rate is enhanced to nearly 99.75%, and the accuracy of pin center positioning is significantly improved by integrating a contour fitting and positioning algorithm for pin points. Subsequently, the binocular matching of pins is achieved by combining probabilistic epipolar constraints with geometric constraints, thereby completing the three-dimensional reconstruction of pin points. The Euclidean distance from the three-dimensional pin points to the reference plane is calculated as the pin retraction amount, enabling the quantitative measurement of pin retraction amount. Through the design of multiple experiments for measuring the pin retraction of different-type electrical connectors and the analysis of the results using the Kullback-Leibler (K-L) divergence, it is demonstrated that the system’s measurement accuracy is superior to 0.05 mm, with an repeatability error of less than 0.035 mm. The effectiveness of the proposed pin-retraction detection method is thus verified, and the detection efficiency over manual operations is greatly enhanced to meet the actual industrial inspection requirements.

Keywords

binocular stereo vision / pin-retraction detection / image processing / electrical connector / machine vision / 3D measurement

Acknowledgement

This work was supported by National Natural Science Foundation of China-Youth Program(No.62303420), and thank you to all the researchers who participated in this article for their hard work and contribution.

Declaration of conflicting interests

The authors have no conflict of interests related to this publication.

References

[1] ZHANG X L,LIU J J,BAI L Q,et al. Machine vision-based electrical connector pin identification and quality inspection method research. Mechanical Instrumentation and Automation, Journal of Physics: Conference Series, 2025, 3032(1): 012025.

[2] LI Z P. Review of key technologies for electrical connector contacts. Electromechanical Components, 2014, 34(4): 5.

[3] LU J. Research on Pin Inspection Technology for Aerospace Electrical Connectors Based on Machine Vision. Dissertation for the Master Degree. Harbin: Harbin Institute of Technology, 2017: 10-14.

[4] SUN R,HUANG J,GAO C,et al. Failure modes and critical process analysis of separation-release electrical connectors. Electromechanical Components, 2019, 39(1): 20-25.

[5] LIU X Y. Analysis of failure modes of electrical connectors. Electromechanical Components, 2017, 37(1): 53-54.

[6] WANG Y C. Research on detection system of terminal high and low pins based on machine vision. Dissertation for the Master Degree. Harbin: Heilongjiang University, 2018: 3-10.

[7] LI J,REN C,XU J,et al. Skewed pins detection of aviation connectors based on multi-modal cooperative perception//2024 International Conference on Artificial Intelligence of Things and Systems, October 17-19, 2024, Hangzhou, China. New York: IEEE, 2014: 1-6.

[8] GAO S D,ZHU C F,XUE C. Rapid detection device and method for pin retraction of circular electrical connectors. China Patent, CN107091942 B, 2019-06-07.

[9] SU X,FAN J,YANG Y,et al. Pin-retraction detection method for electrical connectors based on piezoresistive effect. Machine Building & Automation, 2018, 47(5): 242-245.

[10] JI H,HSU H Y,KONG L X,et al. Development of a contact probe incorporating a Bragg grating strain sensor for nano coordinate measuring machines. Measurement Science and Technology, 2009, 20(9): 095304.

[11] HAN Y,YAO Y,YANG X,et al. Research on connector pin retraction and bending detection system based on machine learning. Automation & Instrumentation, 2022, 37: 57–60.

[12] DU Q,LI D,CHEN H,et al. Pin-tip extraction from structured-light 3D point clouds. Chinese Journal of Liquid Crystals and Displays, 2021, 36(9): 1331-1340.

[13] GONG Y,DU S,WANG Z G,et al. Pillow spring height measurement method based on 3D point cloud processing. Journal of Test and Measurement Technology, 2025, 39(1): 63-71.

[14] LIU W C,YANG Y R,WANG W,et al. Orthogonality inspection method for connector pins using binocular vision. Laser & Optoelectronics Progress, 2023, 60(14): 289-297.

[15] HU Y. Design of automatic pin-retraction detection system for electrical connectors. Harbin: Harbin Institute of Technology, 2020: 5-8.

[16] ZHAO Y Y,LI J,ZHANG Q Y,et al. Simultaneous detection of defects in electrical connectors based on improved convolutional neural network. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 3511710.

[17] WU P F. Research on pin detection technology for automotive electronic connectors based on machine vision. Guilin: Guilin University of Electronic Technology, 2020: 6-8.

[18] ZHANG Y,LI X,ZHANG W. Detection of coplanarity of connector pins based on laser triangulation. Transducer and Microsystem Technologies, 2020, 39(9): 154-156.

[19] YUE J,YANG C,LI S,et al. 3D defect detection of connectors based on structured light. Optoelectronics Letters, 2021, 17(2): 107-111.

[20] STROPPA L,CRISTALLI C. Stereo vision system for accurate 3D measurements of connector pins’ positions in production lines. Experimental Techniques, 2017, 41(1): 69-78.

[21] YANG C,LU W Z,XIA Y Q. Positioning accuracy analysis of industrial robots based on non-probabilistic time-dependent reliability. IEEE Transactions on Reliability, 2024, 73(1): 608-621.