Nonlinear industrial process fault diagnosis with latent label consistency and sparse Gaussian feature learning

Abstract

With the increasing complexity of industrial processes, the high-dimensional industrial data exhibit a strong nonlinearity, bringing considerable challenges to the fault diagnosis of industrial processes. To efficiently extract deep meaningful features that are crucial for fault diagnosis, a sparse Gaussian feature extractor(SGFE) is designed to learn a nonlinear mapping that projects the raw data into the feature space with the fault label dimension. The feature space is described by the one-hot encoding of the fault category label as an orthogonal basis. In this way, the deep sparse Gaussian features related to fault categories can be gradually learned from the raw data by SGFE. In the feature space, the sparse Gaussian (SG) loss function is designed to constrain the distribution of features to multiple sparse multivariate Gaussian distributions. The sparse Gaussian features are linearly separable in the feature space, which is conducive to improving the accuracy of the downstream fault classification task. The feasibility and practical utility of the proposed SGFE are verified by the handwritten digits MNIST benchmark and Tennessee-Eastman (TE) benchmark process, respectively.

Keywords

nonlinear fault diagnosis / multiple multivariate Gaussian distributions / sparse Gaussian feature learning / Gaussian feature extractor

References

[1] HeD-Y. Research of Tianjin Port explosion under the lack of power list [C]. Proceedings of the 2016 2nd International Conference on Economy, Management, Law and Education (EMLE 2016), 2016, Paris, France, Atlantis Press: 340345

[2] HuY-Y, ZhaoC-H, KeZ-W. Machine learning based online fault prognostics for nonstationary industrial process via degradation feature extraction and temporal smoothness analysis [J]. Journal of Central South University, 2021, 28(12): 3838-3855

[3] ChenJ-W, ZhaoC-H. Multi-lag and multi-type temporal causality inference and analysis for industrial process fault diagnosis [J]. Control Engineering Practice, 2022, 124: 105174

[4] ZhangG, WangH, ZhangT-Q. Stochastic resonance of coupled time-delayed system with fluctuation of mass and frequency and its application in bearing fault diagnosis [J]. Journal of Central South University, 2021, 28(9): 2931-2946

[5] GROSHEV M, GUIMARÃES C. Assessing the need for 5G driven edge and fog solution for digital twin systems [C]//WiNTECH’20: Proceedings of the 14th International Workshop on Wireless Network Testbeds, Experimental evaluation & Characterization. 2020: 126 - 127. DOI: https://doi.org/10.1145/3411276.3414697.

[6] ReisM, GinsG. Industrial process monitoring in the big data/industry 4.0 era: From detection, to diagnosis, to prognosis [J]. Processes, 2017, 5(4): 35

[7] ZhaoC-H, WangW, QinY, et al. . Comprehensive subspace decomposition with analysis of between-mode relative changes for multimode process monitoring [J]. Industrial & Engineering Chemistry Research, 2015, 54123154-3166

[8] LiK-D, ChenC-Y, ChenT-F, et al. . A new approach for on-line open-circuit fault diagnosis of inverters based on current trajectory [J]. Journal of Central South University, 2019, 26(3): 743-758

[9] YuW-K, ZhaoC-H. Broad convolutional neural network based industrial process fault diagnosis with incremental learning capability [J]. IEEE Transactions on Industrial Electronics, 2020, 67(6): 5081-5091

[10] YuH-Y, KhanF, GakaniyA V. Nonlinear Gaussian belief network based fault diagnosis for industrial processes [J]. Journal of Process Control, 2015, 35178-200

[11] FengL-J, ZhaoC-H. Fault description based attribute transfer for zero-sample industrial fault diagnosis [J]. IEEE Transactions on Industrial Informatics, 2021, 17(3): 1852-1862

[12] ChaiZ, ZhaoC-H, HuangB. Multisource-refined transfer network for industrial fault diagnosis under domain and category inconsistencies [J]. IEEE Transactions on Cybernetics, 2022, 52(9): 9784-9796

[13] ZhangZ-W, ChenH-H, LiS-M, et al. . A novel sparse filtering approach based on time-frequency feature extraction and softmax regression for intelligent fault diagnosis under different speeds [J]. Journal of Central South University, 2019, 26(6): 1607-1618

[14] ChenH-T, JiangB, LuN-Y, et al. . Deep PCA based real-time incipient fault detection and diagnosis methodology for electrical drive in high-speed trains [J]. IEEE Transactions on Vehicular Technology, 2018, 67(6): 4819-4830

[15] DingS, ZhangP, DingE, et al. . On the application of PCA technique to fault diagnosis [J]. Tsinghua Science & Technology, 2010, 15(2): 138-144

[16] YinS, ZhuX-P, KaynakO. Improved PLS focused on key-performance-indicator-related fault diagnosis [J]. IEEE Transactions on Industrial Electronics, 2015, 62(3): 1651-1658

[17] LiJ-D, ZhangL-Z, JiaoJ-F, et al. . Quality-related fault diagnosis based on improved PLS for industrial process [C]. 2019 34th Youth Academic Annual Conference of Chinese Association of Automation (YAC), 2019, Jinzhou, China, IEEE: 296301

[18] FengJ, WangJ, ZhangH-G, et al. . Fault diagnosis method of joint fisher discriminant analysis based on the local and global manifold learning and its kernel version [J]. IEEE Transactions on Automation Science and Engineering, 2016, 13(1): 122-133

[19] YangX-H, RuiS-H, ZhangX-L, et al. . Fault diagnosis in chemical processes based on class-incremental FDA and PCA [J]. IEEE Access, 2019, 7: 18164-18171

[20] YuW-K, ZhaoC-H. Sparse exponential discriminant analysis and its application to fault diagnosis [J]. IEEE Transactions on Industrial Electronics, 2018, 65(7): 5931-5940

[21] HuQ, QinA-S, ZhangQ-H, et al. . Fault diagnosis based on weighted extreme learning machine with wavelet packet decomposition and KPCA [J]. IEEE Sensors Journal, 2018, 18(20): 8472-8483

[22] NiJ-J, ZhangC-B, YangS X. An adaptive approach based on KPCA and SVM for real-time fault diagnosis of HVCBs [J]. IEEE Transactions on Power Delivery, 2011, 26(3): 1960-1971

[23] XuF, TseP W. A method combining refined composite multiscale fuzzy entropy with PSO-SVM for roller bearing fault diagnosis [J]. Journal of Central South University, 2019, 26(9): 2404-2417

[24] ShiQ, ZhangH. Fault diagnosis of an autonomous vehicle with an improved SVM algorithm subject to unbalanced datasets [J]. IEEE Transactions on Industrial Electronics, 2021, 68(7): 6248-6256

[25] ChaiZ, ZhaoC-H. Enhanced random forest with concurrent analysis of static and dynamic nodes for industrial fault classification [J]. IEEE Transactions on Industrial Informatics, 2020, 16(1): 54-66

[26] WangZ-W, ZhangQ-H, XiongJ-B, et al. . Fault diagnosis of a rolling bearing using wavelet packet denoising and random forests [J]. IEEE Sensors Journal, 2017, 17(17): 5581-5588

[27] HintonG E, SalakhutdinovR R. Reducing the dimensionality of data with neural networks [J]. Science, 2006, 313(5786): 504-507

[28] ShaoH-D, JiangH-K, ZhaoH-W, et al. . A novel deep autoencoder feature learning method for rotating machinery fault diagnosis [J]. Mechanical Systems and Signal Processing, 2017, 95: 187-204

[29] YuW-K, ZhaoC-H. Robust monitoring and fault isolation of nonlinear industrial processes using denoising autoencoder and elastic net [J]. IEEE Transactions on Control Systems Technology, 2020, 28(3): 1083-1091

[30] LuC, WangZ-Y, QinW-L, et al. . Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification [J]. Signal Processing, 2017, 130: 377-388

[31] YanS-F, YanX-F. Using labeled autoencoder to supervise neural network combined with k-nearest neighbor for visual industrial process monitoring [J]. Industrial & Engineering Chemistry Research, 2019, 58(23): 9952-9958

[32] YuH, WangK, LiY, et al. . Representation learning with class level autoencoder for intelligent fault diagnosis [J]. IEEE Signal Processing Letters, 2019, 26(10): 1476-1480

[33] ZhangS, YeF, WangB-N, et al. . Semi-supervised bearing fault diagnosis and classification using variational autoencoder-based deep generative models [J]. IEEE Sensors Journal, 2021, 21(5): 6476-6486

[34] WangY-L, YangH-B, YuanX-F, et al. . Deep learning for fault-relevant feature extraction and fault classification with stacked supervised auto-encoder [J]. Journal of Process Control, 2020, 92: 79-89

[35] KINGMA D P, WELLING M. Auto-encoding variational bayes [EB/OL] arXiv preprint arXiv, 2013:1312.6114.

[36] LecunY, BoserB, DenkerJ S, et al. . Backpropagation applied to handwritten zip code recognition [J]. Neural Computation, 1989, 1(4): 541-551

[37] DownsJ J, VogelE F. A plant-wide industrial process control problem [J]. Computers & Chemical Engineering, 1993, 17(3): 245-255

[38] RIETH C, AMSEL B D, TRAN R, et al. Additional Tennessee Eastman process simulation data for anomaly detection evaluation [OL]. Harvard Dataverse, 2017.