Real-time monitoring of brake shoe keys in freight cars

Abstract

Condition monitoring ensures the safety of freight railroad operations. With the development of machine vision technology, visual inspection has become a principal means of condition monitoring. The brake shoe key (BSK) is an important component in the brake system, and its absence will lead to serious accidents. This paper presents a novel method for automated visual inspection of the BSK condition in freight cars. BSK images are first acquired by hardware devices. The subsequent inspection process is divided into three stages: first, the region-of-interest (ROI) is segmented from the source image by an improved spatial pyramid matching scheme based on multi-scale census transform (MSCT). To localize the BSK in the ROI, census transform (CT) on gradient images is developed in the second stage. Then gradient encoding histogram (GEH) features and linear support vector machines (SVMs) are used to generate a BSK localization classifier. In the last stage, a condition classifier is trained by SVM, but the features are extracted from gray images. Finally, the ROI, BSK localization, and condition classifiers are cascaded to realize a completely automated inspection system. Experimental results show that the system achieves a correct inspection rate of 99.2% and a speed of 5 frames/s, which represents a good real-time performance and high recognition accuracy.

Keywords

Condition monitoring / Feature expression / Brake shoe key / Machine vision

References

[1] Anderson, G.B., 2007. Acoustic detection of distressed freight car roller bearings. Proc. ASME/IEEE Joint Rail Conf. and Int. Combustion Engineer Division Spring Technical Conf., p.167-171. [

[2] Cao, X., Shen, W., Yu, L., , 2012. Illumination invariant extraction for face recognition using neighboring wavelet coefficients. Patt. Recog., 45(4): 1299-1305. [

[3] Dalal, N., Triggs, B., 2005. Histograms of oriented gradients for human detection. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, p.886-893. [

[4] de Ruvo, P., Distante, A., Stella, E., , 2009. A GPUbased vision system for real time detection of fastening elements in railway inspection. Proc. 16th IEEE Int. Conf. on Image Processing, p.2333-2336. [

[5] Elder, J.H., Velisavljević, L., 2009. Cue dynamics underlying rapid detection of animals in natural scenes. J. Vis., 9(7): 7.1-7.20. [

[6] Gu, W., Xiang, C., Venkatesh, Y.V., , 2012. Facial expression recognition using radial encoding of local Gabor features and classifier synthesis. Patt. Recog., 45(1): 80-91. [

[7] Gualdi, G., Prati, A., Cucchiara, R., 2012. Multistage particle windows for fast and accurate object detection. IEEE Trans. Patt. Anal. Mach. Intell., 34(8): 1589-1604. [

[8] Guo, L., Ge, P.S., Zhang, M.H., , 2012. Pedestrian detection for intelligent transportation systems combining AdaBoost algorithm and support vector machine. Expert Syst. Appl., 39(4): 4274-4286. [

[9] Hart, J.M., Resendiz, E., Freid, B., , 2008. Machine vision using multi-spectral imaging for undercarriage inspection of railroad equipment. Proc. 8th World Congress on Railway Research, p.1-8.

[10] Hoiem, D., Efros, A.A., Hebert, M., 2008. Putting objects in perspective. Int. J. Comput. Vis., 80(1): 3-15. [

[11] Kim, H., Kim, W., 2011. Automated inspection system for rolling stock brake shoes. IEEE Trans. Instrum. Meas., 60(8): 2835-2847. [

[12] Kumar, M.A., Gopal, M., 2010. A comparison study on multiple binary-class SVM methods for unilabel text categorization. Patt. Recog. Lett., 31(11): 1437-1444. [

[13] Lampert, C.H., Blaschko, M.B., Hofmann, T., 2009. Efficient subwindow search: a branch and bound framework for object localization. IEEE Trans. Patt. Anal. Mach. Intell., 31(12): 2129-2142. [

[14] Lazebnik, S., Schmid, C., Ponce, J., 2006. Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, p.2169-2178. [

[15] Lee, P.H., Wu, S.W., Hung, Y.P., 2012. Illumination compensation using oriented local histogram equalization and its application to face recognition. IEEE Trans. Image Process., 21(9): 4280-4289. [

[16] Marino, F., Distante, A., Mazzeo, P.L., , 2007. A realtime visual inspection system for railway maintenance: automatic hexagonal-headed bolts detection. IEEE Trans.Syst. Man Cybern. Part C Appl. Rev., 37(3): 418-428. [

[17] Márquez, F.P.G., Roberts, C., Tobias, A.M., 2010. Railway point mechanisms: condition monitoring and fault detection. Proc. Inst. Mech. Eng. Part F: J. Rail Rapid Transit, 224(1): 35-44. [

[18] Mazzeo, P.L., Nitti, M., Stella, E., , 2004. Visual recognition of fastening bolts for railroad maintenance. Patt. Recog. Lett., 25(6): 669-677. [

[19] Milanés, V., Llorca, D.F., Villagrá, J., , 2012. Visionbased active safety system for automatic stopping. Expert Syst. Appl., 39(12): 11234-11242. [

[20] Mu, Y., Yan, S., Liu, Y., et al., 2008. Discriminative local binary patterns for human detection in personal album. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, p.1-8. [

[21] Oukhellou, L., Debiolles, A., Denoeux, T., , 2010. Fault diagnosis in railway track circuits using Dempster-Shafer classifier fusion. Eng. Appl. Artif. Intell., 23(1): 117-128. [

[22] Quinn, P.C., Eimas, P.D., Tarr, M.J., 2001. Perceptual categorization of cat and dog silhouettes by 3- to 4- month-old infants. J. Exp. Child Psychol., 79(1): 78-94. [

[23] Rathod, V.R., Anand, R.S., Ashok, A., 2012. Comparative analysis of NDE techniques with image processing. Nondestruct. Test. Eval., 27(4): 305-326. [

[24] Widodo, A., Yang, B.S., 2007. Support vector machine in machine condition monitoring and fault diagnosis. Mech. Syst. Signal Process., 21(6): 2560-2574. [

[25] Wojek, C., Dorkó , G., Schulz, A., , 2008. Slidingwindows for rapid object class localization: a parallel technique. Proc. 30th DAGM Symp. on Pattern Recognition, p.71-81. [

[26] Yella, S., Dougherty, M., Gupta, N.K., 2009. Condition monitoring of wooden railway sleepers. Transpo. Res. Part C Emerg. Technol., 17(1): 38-55. [

[27] Zhang, H., Yang, J., Tao, W., , 2011. Vision method of inspecting missing fastening components in high-speed railway. Appl. Opt., 50(20): 3658-3665. [

[28] Zhou, F.Q., Zou, R., Gao, H., 2013. Dust collector localization in trouble of moving freight car detection system. J. Zhejiang Univ.-Sci. C (Comput. & Electron.), 14(2): 98-106. [

[29] Zhou, F.Q., Zou, R., Qiu, Y., , 2014. Automated visual inspection of angle cocks during train operation. Proc. Instit. Mech. Eng. Part F J. Rail Rapid Transit, 228(7): 794-806. [