A novel minority sample fault diagnosis method based on multisource data enhancement

Abstract

Effective fault diagnosis has a crucial impact on the safety and cost of complex manufacturing systems. However, the complex structure of the collected multisource data and scarcity of fault samples make it difficult to accurately identify multiple fault conditions. To address this challenge, this paper proposes a novel deep-learning model for multisource data augmentation and small sample fault diagnosis. The raw multisource data are first converted into two-dimensional images using the Gramian Angular Field, and a generator is built to transform random noise into images through transposed convolution operations. Then, two discriminators are constructed to evaluate the authenticity of input images and the fault diagnosis ability. The Vision Transformer network is built to diagnose faults and obtain the classification error for the discriminator. Furthermore, a global optimization strategy is designed to upgrade parameters in the model. The discriminators and generator compete with each other until Nash equilibrium is achieved. A real-world multistep forging machine is adopted to compare and validate the performance of different methods. The experimental results indicate that the proposed method has multisource data augmentation and minority sample fault diagnosis capabilities. Compared with other state-of-the-art models, the proposed approach has better fault diagnosis accuracy in various scenarios.

Keywords

multisource data augmentation / minority sample fault diagnosis / complex manufacturing system / global optimization / Vision Transformer

References

[1] Shi J, Xu B, Wang X, Zhang J. A local spectrum enhancement-based method and its application in incipient fault diagnosis of rotating machinery. Int J Mech Syst Dyn. 2023;3:162-172.

[2] Han T, Tian J, Chung CY, Wei YM. Challenges and opportunities for battery health estimation: bridging laboratory research and real-world applications. J Energy Chem. 2024;89:434-436.

[3] Gu L, Wang G, Zhou Y, Peng R. Reliability optimization of multi-state systems with two performance sharing groups. Reliab Eng Syst Saf. 2024;241:109580.

[4] Zhou F, Yang S, Fujita H, Chen D, Wen C. Deep learning fault diagnosis method based on global optimization GAN for unbalanced data. Knowl-Based Syst. 2020;187:104837.

[5] Guo Y, Zhou Y, Zhang Z. Fault diagnosis of multi-channel data by the CNN with the multilinear principal component analysis. Measurement. 2021;171:108513.

[6] Han T, Xie W, Pei Z. Semi-supervised adversarial discriminative learning approach for intelligent fault diagnosis of wind turbine. Inf Sci (Ny). 2023;648:119496.

[7] Chen X, Yang R, Xue Y, Huang M, Ferrero R, Wang Z. Deep transfer learning for bearing fault diagnosis: a systematic review since 2016. IEEE Trans Instrum Meas. 2023;72:1-21.

[8] Wen H, Guo W, Li X. A novel deep clustering network using multirepresentation autoencoder and adversarial learning for large crossdomain fault diagnosis of rolling bearings. Expert Syst Appl. 2023;225:120066.

[9] Wang Y, Liu R, Lin D, et al. Coarse-to-fine: progressive knowledge transfer-based multitask convolutional neural network for intelligent large-scale fault diagnosis. IEEE Trans Neural Networks Learn Syst. 2023;34(2):761-774.

[10] Yang J, Bao W, Liu Y, Li X. Class metric regularized deep belief network with sparse representation for fault diagnosis. Int J Intell Syst. 2022;37(9):5996-6022.

[11] Shi J, Peng D, Peng Z, Zhang Z, Goebel K, Wu D. Planetary gearbox fault diagnosis using bidirectional-convolutional LSTM networks. Mech Syst Signal Process. 2022;162:107996.

[12] Yang B, Lei Y, Li X, Li N. Targeted transfer learning through distribution barycenter medium for intelligent fault diagnosis of machines with data decentralization. Expert Syst Appl. 2024;244:122997.

[13] Zhao K, Liu ZB, Zhao B, Shao HD. Class-Aware Adversarial Multiwavelet Convolutional Neural Network for Cross-Domain Fault Diagnosis. IEEE Trans Ind Inf. 2024;20(3):4492-4503.

[14] Gu L, Zheng R, Zhou Y, Zhang Z, Zhao K. Remaining useful life prediction using composite health index and hybrid LSTM-SVR model. Qual Reliability Eng Int. 2022;38:3559-3578.

[15] Shi J. In-process quality improvement: concepts, methodologies, and applications. IISE Trans. 2023;55(1):2-21.

[16] Yan H, Paynabar K, Shi J. Real-time monitoring of high-dimensional functional data streams via spatio-temporal smooth sparse decomposition. Technometrics. 2018;60(2):181-197.

[17] Paynabar K, Jin J, Pacella M. Monitoring and diagnosis of multichannel nonlinear profile variations using uncorrelated multilinear principal component analysis. IIE Trans. 2013;45(11):1235-1247.

[18] Zhang Y, Chen HC, Du Y, et al. Power transformer fault diagnosis considering data imbalance and data set fusion. High Voltage. 2021;6:543-554.

[19] Peng P, Zhang W, Zhang Y, Xu Y, Wang H, Zhang H. Cost sensitive active learning using bidirectional gated recurrent neural networks for imbalanced fault diagnosis. Neurocomputing. 2020;407:232-245.

[20] Haibo He, Garcia EA. Learning from imbalanced data. IEEE Trans Knowl Data Eng. 2009;21(9):1263-1284.

[21] Wu Z, Zhang H, Guo J, Ji Y, Pecht M. Imbalanced bearing fault diagnosis under variant working conditions using cost-sensitive deep domain adaptation network. Expert Syst Appl. 2022;193:116459.

[22] Ren Z, Zhu Y, Kang W, et al. Adaptive cost-sensitive learning: improving the convergence of intelligent diagnosis models under imbalanced data. Knowl-Based Syst. 2022;241:108296.

[23] Ng WWY, Hu J, Yeung DS, Yin S, Roli F. Diversified sensitivity-based undersampling for imbalance classification problems. IEEE Trans Cybern. 2015;45(11):2402-2412.

[24] Ren J, Wang Y, Cheung Y, Gao XZ, Guo X. Grouping-based oversampling in kernel space for imbalanced data classification. Pattern Recogn. 2023;133:108992.

[25] Rezvani S, Wang X. A broad review on class imbalance learning techniques. Appl Soft Comput. 2023;143:110415.

[26] Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321-357.

[27] He HB, Bai Y, Garcia EA, Li ST. ADASYN: adaptive synthetic sampling approach for imbalanced learning. In: IEEE International Joint Conference on Neural Networks, June 1–8, Hong Kong, China. IEEE;2008:1322-1328.

[28] Xu Y, Zhao Y, Ke W, et al. A multi-fault diagnosis method based on improved SMOTE for class-imbalanced data. Can J Chem Eng. 2023;101(4):1986-2001.

[29] Li Z, He Y, Xing Z, Duan J. Transformer fault diagnosis based on improved deep coupled dense convolutional neural network. Electr Power Syst Res. 2022;209:107969.

[30] Goodfellow I, Pouget-Abadie J, Mirza M, et al. Generative adversarial nets. Adv Neural Inf Process Syst. 2014;27:2672-2680.

[31] Liu Y, Jiang H, Wang Y, Wu Z, Liu S. A conditional variational autoencoding generative adversarial networks with selfmodulation for rolling bearing fault diagnosis. Measurement. 2022;192:110888.

[32] Guo Z, Pu Z, Du W, Wang H, Li C. Improved adversarial learning for fault feature generation of wind turbine gearbox. Renewable Energy. 2022;185:255-266.

[33] Jing Q, Yan J, Wang Y, Ye X, Wang J, Geng Y. A novel method for small and unbalanced sample pattern recognition of gas insulated switchgear partial discharge using an auxiliary classifier generative adversarial network. High Voltage. 2023;8(2):368-379.

[34] Zhang T, Chen J, Li F, Pan T, He S. A small sample focused intelligent fault diagnosis scheme of machines via multimodules learning with gradient penalized generative adversarial networks. IEEE Trans Ind Electron. 2021;68(10):10130-10141.

[35] Liu X, Liu S, Xiang J, Sun R. A transfer learning strategy based on numerical simulation driving 1D Cycle-GAN for bearing fault diagnosis. Inf Sci (Ny). 2023;642:119175.

[36] Liang P, Yu Z, Wang B, Xu X, Tian J. Fault transfer diagnosis of rolling bearings across multiple working conditions via subdomain adaptation and improved Vision Transformer network. Adv Eng Inf. 2023;57:102075.

[37] Vaswani A, Shazeer N, Parmar N. Attention is all you need. Adv Neural Inf Process Syst. 2017;30:5998-6008.

[38] He X, Wang Z, Li Y, et al. Joint decision-making of parallel machine scheduling restricted in job-machine release time and preventive maintenance with remaining useful life constraints. Reliability Eng Syst Saf. 2022;222:108429.

[39] Dosovitskiy A, Beyer L, Kolesnikov A, et al. An image is worth 16×16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929;2020.

[40] Han K, Wang Y, Chen H, et al. A survey on Vision Transformer. IEEE Trans Pattern Anal Mach Intell. 2023;45(1):87-110.

[41] Wang ZG, Oates T. Imaging time-series to improve classification and imputation. In: 24th International Joint Conference on Artificial Intelligence. Buenos Aires, Argentina, July 25–31. IJCAI;2015.

[42] Cheng Y, Lu M, Gai X, Guan R, Zhou S, Xue J. Research on multisignal milling tool wear prediction method based on GAF-ResNext. Robot Comput Integr Manuf. 2024;85:102634.

[43] Zeiler MD, Krishnan D, Taylor GW, Fergus G. Deconvolutional networks. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, June 13–18. IEEE;2010:2528-2535.

[44] Lei Y, Zhang Z, Jin J. Automatic tonnage monitoring for missing part detection in multi-operation forging processes. J Manuf Sci Eng. 2010;132(5):051010.

[45] Farahat AIZ, El-Morsy AW, El-Bitar TA. Severe plastic deformation of large-scale Nb-microalloyed steel billet by multi-directional forging process. Steel Res Int. 2014;85(85):844-850.

[46] Hawryluk M, Dudkiewicz Ł, Ziemba J, Polak S, Kaczyński P, Szymańska T. Problems of the process of manufacturing precision forgings in multiple systems on a hot hydraulic hammer. J Manuf Process. 2023;96:54-67.

[47] Guo Y, Hu T, Zhou Y, Zhou Y, Zhao K, Zhang Z. Multi-channel data fusion and intelligent fault diagnosis based on deep learning. Meas Sci Technol. 2023;34(1):015115.

RIGHTS & PERMISSIONS

2024 The Authors. International Journal of Mechanical System Dynamics published by John Wiley & Sons Australia, Ltd on behalf of Nanjing University of Science and Technology.