Deep convolutional tree-inspired network: a decision-tree-structured neural network for hierarchical fault diagnosis of bearings

Abstract

The fault diagnosis of bearings is crucial in ensuring the reliability of rotating machinery. Deep neural networks have provided unprecedented opportunities to condition monitoring from a new perspective due to the powerful ability in learning fault-related knowledge. However, the inexplicability and low generalization ability of fault diagnosis models still bar them from the application. To address this issue, this paper explores a decision-tree-structured neural network, that is, the deep convolutional tree-inspired network (DCTN), for the hierarchical fault diagnosis of bearings. The proposed model effectively integrates the advantages of convolutional neural network (CNN) and decision tree methods by rebuilding the output decision layer of CNN according to the hierarchical structural characteristics of the decision tree, which is by no means a simple combination of the two models. The proposed DCTN model has unique advantages in 1) the hierarchical structure that can support more accuracy and comprehensive fault diagnosis, 2) the better interpretability of the model output with hierarchical decision making, and 3) more powerful generalization capabilities for the samples across fault severities. The multiclass fault diagnosis case and cross-severity fault diagnosis case are executed on a multicondition aeronautical bearing test rig. Experimental results can fully demonstrate the feasibility and superiority of the proposed method.

Graphical abstract

Keywords

bearing / cross-severity fault diagnosis / hierarchical fault diagnosis / convolutional neural network / decision tree

References

[1] Chen X F, Wang S B, Qiao B J. Basic research on machinery fault diagnostics: past, present, and future trends. Frontiers of Mechanical Engineering, 2018, 13( 2): 264– 291

[2] Zheng P, Wang H, Sang Z. Smart manufacturing systems for Industry 4.0: conceptual framework, scenarios, and future perspectives. Frontiers of Mechanical Engineering, 2018, 13( 2): 137– 150

[3] Hoang D T, Kang H J. A survey on deep learning based bearing fault diagnosis. Neurocomputing, 2019, 335 : 327– 335

[4] Lei Y G, Yang B, Jiang X. Applications of machine learning to machine fault diagnosis: a review and roadmap. Mechanical Systems and Signal Processing, 2020, 138 : 106587–

[5] Zhou D H, Zhao Y H, Wang Z D. Review on diagnosis techniques for intermittent faults in dynamic systems. IEEE Transactions on Industrial Electronics, 2020, 67( 3): 2337– 2347

[6] Wu X Y, Zhang Y, Cheng C M. A hybrid classification autoencoder for semi-supervised fault diagnosis in rotating machinery. Mechanical Systems and Signal Processing, 2021, 149 : 107327–

[7] Liang P F, Deng C, Wu J. Single and simultaneous fault diagnosis of gearbox via a semi-supervised and high-accuracy adversarial learning framework. Knowledge-Based Systems, 2020, 198 : 105895–

[8] An Z H, Li S M, Wang J R. A novel bearing intelligent fault diagnosis framework under time-varying working conditions using recurrent neural network. ISA Transactions, 2020, 100 : 155– 170

[9] Zhong T, Qu J F, Fang X Y. The intermittent fault diagnosis of analog circuits based on EEMD-DBN. Neurocomputing, 2021, 436 : 74– 91

[10] Zhao D Z, Wang T Y, Chu F L. Deep convolutional neural network based planet bearing fault classification. Computers in Industry, 2019, 107 : 59– 66

[11] Lu S L, Yan R Q, Liu Y B. Tacholess speed estimation in order tracking: a review with application to rotating machine fault diagnosis. IEEE Transactions on Instrumentation and Measurement, 2019, 68( 7): 2315– 2332

[12] Cheng Y W, Lin M X, Wu J. Intelligent fault diagnosis of rotating machinery based on continuous wavelet transform-local binary convolutional neural network. Knowledge-Based Systems, 2021, 216 : 106796–

[13] Li M F, Wang T Y, Kong Y. Synchro-reassigning transform for instantaneous frequency estimation and signal reconstruction. IEEE Transactions on Industrial Electronics, 2021 (in press)

[14] Li M F, Wang T Y, Chu F L. Scaling-basis Chirplet transform. IEEE Transactions on Industrial Electronics, 2020, 68( 9): 8777– 8788

[15] Li M F, Wang T Y, Chu F L. Component matching chirplet transform via frequency-dependent chirp rate for wind turbine planetary gearbox fault diagnostics under variable speed condition. Mechanical Systems and Signal Processing, 2021, 161 : 107997–

[16] Cerrada M, Sánchez R V, Li C. A review on data-driven fault severity assessment in rolling bearings. Mechanical Systems and Signal Processing, 2018, 99 : 169– 196

[17] Zhao J, Yang S P, Li Q. A new bearing fault diagnosis method based on signal-to-image mapping and convolutional neural network. Measurement, 2021, 176 : 109088–

[18] Minhas A S, Kankar P K, Kumar N. Bearing fault detection and recognition methodology based on weighted multiscale entropy approach. Mechanical Systems and Signal Processing, 2021, 147 : 107073–

[19] Pan H Y, Yang Y, Zheng J D. A fault diagnosis approach for roller bearing based on symplectic geometry matrix machine. Mechanism and Machine Theory, 2019, 140 : 31– 43

[20] Wen L, Li X, Gao L. A new two-level hierarchical diagnosis network based on convolutional neural network. IEEE Transactions on Instrumentation and Measurement, 2020, 69( 2): 330– 338

[21] Amorim J P, Abreu P H, Reyes M, et al. Interpretability vs. complexity: the friction in deep neural networks. In: Proceedings of 2020 International Joint Conference on Neural Networks (IJCNN). Glasgow: IEEE, 2020, 20006226

[22] Yang Z B, Zhang J P, Zhao Z B. Interpreting network knowledge with attention mechanism for bearing fault diagnosis. Applied Soft Computing, 2020, 97 : 106829–

[23] Rauber T W, da Silva Loca A L, Boldt F de A. An experimental methodology to evaluate machine learning methods for fault diagnosis based on vibration signals. Expert Systems with Applications, 2021, 167 : 114022–

[24] Wu Y, Jin W D, Li Y. A novel method for simultaneous-fault diagnosis based on between-class learning. Measurement, 2021, 172 : 108839–

[25] Stock M, Nguyen B, Courtens W. Otolith identification using a deep hierarchical classification model. Computers and Electronics in Agriculture, 2021, 180 : 105883–

[26] Lu C, Wang Z Y, Zhou B. Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification. Advanced Engineering Informatics, 2017, 32 : 139– 151

[27] Liu P, Zhang Y, Zhang X Y. Evaluation of measurement uncertainty of oxygen in titanium alloys based on Monte Carlo method. Journal of Physics: Conference Series, 2020, 1605 : 012135–

[28] Kraus M, Feuerriegel S. Forecasting remaining useful life: interpretable deep learning approach via variational Bayesian inferences. Decision Support Systems, 2019, 125 : 113100–

[29] Gangsar P, Tiwari R. Signal based condition monitoring techniques for fault detection and diagnosis of induction motors: a state-of-the-art review. Mechanical Systems and Signal Processing, 2020, 144 : 106908–

[30] Wang X, Wang T Y, Ming A B. Semi-supervised hierarchical attribute representation learning via multi-layer matrix factorization for machinery fault diagnosis. Mechanism and Machine Theory, 2022, 167 : 104445–

[31] Blanco-Justicia A, Domingo-Ferrer J, Martínez S. Machine learning explainability via microaggregation and shallow decision trees. Knowledge-Based Systems, 2020, 194 : 105532–

[32] Sagi O, Rokach L. Explainable decision forest: transforming a decision forest into an interpretable tree. Information Fusion, 2020, 61 : 124– 138

[33] Vamsi I, Sabareesh G R, Penumakala P K. Comparison of condition monitoring techniques in assessing fault severity for a wind turbine gearbox under non-stationary loading. Mechanical Systems and Signal Processing, 2019, 124 : 1– 20

[34] Cabrera D, Sancho F, Sánchez R V. Fault diagnosis of spur gearbox based on random forest and wavelet packet decomposition. Frontiers of Mechanical Engineering, 2015, 10( 3): 277– 286

[35] Zhou Z H, Feng J. Deep forest: towards an alternative to deep neural networks. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI 2017). 2017, 3553– 3559

[36] Humbird K D, Peterson J L, McClarren R G. Deep neural network initialization with decision trees. IEEE Transactions on Neural Networks and Learning Systems, 2019, 30( 5): 1286– 1295

[37] Jiang S H, Mao H Y, Ding Z M. Deep decision tree transfer boosting. IEEE Transactions on Neural Networks and Learning Systems, 2020, 31( 2): 383– 395

[38] Kontschieder P, Fiterau M, Criminisi A. Deep neural decision forests. In: Proceedings of 2015 IEEE International Conference on Computer Vision (ICCV). Santiago: IEEE, 2015, 1467– 1475

[39] Zhang Q S, Yang Y, Ma H T. Interpreting CNNs via decision trees. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach: IEEE, 2019, 6254– 6263

[40] Roy D, Panda P, Roy K. Tree-CNN: a hierarchical deep convolutional neural network for incremental learning. Neural Networks, 2020, 121 : 148– 160

[41] Daga A P, Fasana A, Marchesiello S. The Politecnico di Torino rolling bearing test rig: description and analysis of open access data. Mechanical Systems and Signal Processing, 2019, 120 : 252– 273

[42] Zhou P, Peng Z K, Chen S Q. Non-stationary signal analysis based on general parameterized time–frequency transform and its application in the feature extraction of a rotary machine. Frontiers of Mechanical Engineering, 2018, 13( 2): 292– 300

[43] Zhang W, Peng G, Li C. A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors (Basel), 2017, 17( 2): 425–

[44] Jiang Y, Feng C, He B. Actuator fault diagnosis in autonomous underwater vehicle based on neural network. Sensors and Actuators. A, Physical, 2021, 324 : 112668–