Unknown fault detection for EGT multi-temperature signals based on self-supervised feature learning and unary classification

Abstract

Intelligent power systems can improve operational efficiency by installing a large number of sensors. Data-based methods of supervised learning have gained popularity because of available Big Data and computing resources. However, the common paradigm of the loss function in supervised learning requires large amounts of labeled data and cannot process unlabeled data. The scarcity of fault data and a large amount of normal data in practical use pose great challenges to fault detection algorithms. Moreover, sensor data faults in power systems are dynamically changing and pose another challenge. Therefore, a fault detection method based on self-supervised feature learning was proposed to address the above two challenges. First, self-supervised learning was employed to extract features under various working conditions only using large amounts of normal data. The self-supervised representation learning uses a sequence-based Triplet Loss. The extracted features of large amounts of normal data are then fed into a unary classifier. The proposed method is validated on exhaust gas temperatures (EGTs) of a real-world 9F gas turbine with sudden, progressive, and hybrid faults. A comprehensive comparison study was also conducted with various feature extractors and unary classifiers. The results show that the proposed method can achieve a relatively high recall for all kinds of typical faults. The model can detect progressive faults very quickly and achieve improved results for comparison without feature extractors in terms of F1 score.

Graphical abstract

Keywords

fault detection / unary classification / self-supervised representation learning / multivariate nonlinear time series

References

[1] Tahan M, Tsoutsanis E, Muhammad M. . Performance-based health monitoring, diagnostics and prognostics for condition-based maintenance of gas turbines: A review. Applied Energy, 2017, 198: 122–144

[2] Jufri F H, Widiputra V, Jung J. State-of-the-art review on power grid resilience to extreme weather events: Definitions, frameworks, quantitative assessment methodologies, and enhancement strategies. Applied Energy, 2019, 239: 1049–1065

[3] Fink O, Wang Q, Svensén M. . Potential, challenges and future directions for deep learning in prognostics and health management applications. Engineering Applications of Artificial Intelligence, 2020, 92: 103678

[4] Yan C, Chen J, Liu H. . Health management for PEM fuel cells based on an active fault tolerant control strategy. IEEE Transactions on Sustainable Energy, 2021, 12(2): 1311–1320

[5] Jain T, Yamé J J. Fault-tolerant economic model predictive control for wind turbines. IEEE Transactions on Sustainable Energy, 2019, 10(4): 1696–1704

[6] Zhang D, Ye Z, Dong X. Co-design of fault detection and consensus control protocol for multi-agent systems under hidden DoS attack. IEEE Transactions on Circuits and Systems. I, Regular Papers, 2021, 68(5): 2158–2170

[7] Feng L, Zhao C. Fault description based attribute transfer for zero-sample industrial fault diagnosis. IEEE Transactions on Industrial Informatics, 2021, 17(3): 1852–1862

[8] Gao D W, Wang Q, Zhang F. . Application of AI techniques in monitoring and operation of power systems. Frontiers in Energy, 2019, 13(1): 71–85

[9] Michau G, Fink O. Unsupervised transfer learning for anomaly detection: Application to complementary operating condition transfer. Knowledge-Based Systems, 2021, 216: 106816

[10] Chen Y, Zuo M J. A sparse multivariate time series model-based fault detection method for gearboxes under variable speed condition. Mechanical Systems and Signal Processing, 2022, 167: 108539

[11] Gallo M, Costabile C, Sorrentino M. . Development and application of a comprehensive model-based methodology for fault mitigation of fuel cell powered systems. Applied Energy, 2020, 279: 115698

[12] Singla P, Duhan M, Saroha S. A comprehensive review and analysis of solar forecasting techniques. Frontiers in Energy, 2022, 16(2): 187–223

[13] Fu F, Wang D, Ding S X. . Fault identifiability analysis of linear discrete time-varying systems. IEEE Transactions on Circuits and Systems. I, Regular Papers, 2019, 66(6): 2371–2381

[14] Li Y, Zhang M, Chen C. A deep-learning intelligent system incorporating data augmentation for short-term voltage stability assessment of power systems. Applied Energy, 2022, 308: 118347

[15] Waqar Akram M, Li G, Jin Y. . Failures of photovoltaic modules and their detection: A review. Applied Energy, 2022, 313: 118822

[16] Ajagekar A, You F. Quantum computing based hybrid deep learning for fault diagnosis in electrical power systems. Applied Energy, 2021, 303: 117628

[17] Yang C C, Soh C S, Yap V V. A systematic approach in load disaggregation utilizing a multi-stage classification algorithm for consumer electrical appliances classification. Frontiers in Energy, 2019, 13(2): 386–398

[18] Sun Z, Han Y, Wang Z. . Detection of voltage fault in the battery system of electric vehicles using statistical analysis. Applied Energy, 2021, 307: 118172

[19] Dey M, Rana S P, Simmons C V. . Solar farm voltage anomaly detection using high-resolution μPMU data-driven unsupervised machine learning. Applied Energy, 2021, 303: 117656

[20] Zhao Y, Li D, Lu T. . Collaborative fault detection for large-scale photovoltaic systems. IEEE Transactions on Sustainable Energy, 2020, 11(4): 2745–2754

[21] Wei L, Qian Z, Zareipour H. Wind turbine pitch system condition monitoring and fault detection based on optimized relevance vector machine regression. IEEE Transactions on Sustainable Energy, 2020, 11(4): 2326–2336

[22] Zhuo Y, Ge Z. Auxiliary information-guided industrial data augmentation for any-shot fault learning and diagnosis. IEEE Transactions on Industrial Informatics, 2021, 17(11): 7535–7545

[23] Zhao Y, Li T, Zhang X. . Artificial intelligence-based fault detection and diagnosis methods for building energy systems: Advantages, challenges and the future. Renewable & Sustainable Energy Reviews, 2019, 109: 85–101

[24] Li B, Delpha C, Diallo D. . Application of artificial neural networks to photovoltaic fault detection and diagnosis: A review. Renewable & Sustainable Energy Reviews, 2021, 138: 110512

[25] Lu X, Lin P, Cheng S. . Fault diagnosis model for photovoltaic array using a dual-channels convolutional neural network with a feature selection structure. Energy Conversion and Management, 2021, 248: 114777

[26] Zuo B, Zhang Z, Cheng J. . Data-driven flooding fault diagnosis method for proton-exchange membrane fuel cells using deep learning technologies. Energy Conversion and Management, 2022, 251: 115004

[27] NandyJHsu WLeeM L. Towards maximizing the representation gap between in-domain & out-of-distribution examples. In: 34th Conference on Neural Information Processing Systems, 2020

[28] NguyenM NLi X LNgS K. Positive unlabeled learning for time series classification. In: Proceedings of the 22nd International Joint Conference on Artificial Intelligence—Volume Two, Barcelona, Catalonia, Spain, 2011

[29] Wang Y, Liu R, Lin D. . Coarse-to-fine: Progressive knowledge transfer-based multitask convolutional neural network for intelligent large-scale fault diagnosis. IEEE Transactions on Neural Networks and Learning Systems, 2021, 34(2): 761–774

[30] Sun S, Wang T, Yang H. . Condition monitoring of wind turbine blades based on self-supervised health representation learning: A conducive technique to effective and reliable utilization of wind energy. Applied Energy, 2022, 313: 118882

[31] Chen J, Xu X, Yan Z. . Data-driven distribution network topology identification considering correlated generation power of distributed energy resource. Frontiers in Energy, 2022, 16(1): 121–129

[32] ZhaoXYao JDengW, . Intelligent fault diagnosis of gearbox under variable working conditions with adaptive intraclass and interclass convolutional neural network. IEEE Transactions on Neural Networks and Learning Systems, 2022, online, https://doi.org/10.1109/TNNLS.2021.3135877

[33] Patnaik B, Mishra M, Bansal R C. . MODWT-XGBoost based smart energy solution for fault detection and classification in a smart microgrid. Applied Energy, 2021, 285: 116457

[34] Shi H, Li Y, Bai X. . A two-stage sound-vibration signal fusion method for weak fault detection in rolling bearing systems. Mechanical Systems and Signal Processing, 2022, 172: 109012

[35] Liang J, Zhang K, Al-Durra A. . A novel fault diagnostic method in power converters for wind power generation system. Applied Energy, 2020, 266: 114851

[36] Sapountzoglou N, Lago J, De Schutter B. . A generalizable and sensor-independent deep learning method for fault detection and location in low-voltage distribution grids. Applied Energy, 2020, 276: 115299

[37] Van Gompel J, Spina D, Develder C. Satellite based fault diagnosis of photovoltaic systems using recurrent neural networks. Applied Energy, 2022, 305: 117874

[38] Bai M, Yang X, Liu J. . Convolutional neural network-based deep transfer learning for fault detection of gas turbine combustion chambers. Applied Energy, 2021, 302: 117509

[39] Feng Y, Chen J, He S. . Globally localized multisource domain adaptation for cross-domain fault diagnosis with category shift. IEEE Transactions on Neural Networks and Learning Systems, 2021, 1–15

[40] SchroffFKalenichenko DPhilbinJ. FaceNet: A unified embedding for face recognition and clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, 2015

[41] MikolovTSutskever IChenK, . Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, 2013

[42] Breunig M M, Kriegel H P, Ng R T. . LOF: Identifying density-based local outliers. SIGMOD Record, 2000, 29(2): 93–104

[43] SaxenaAGoebel KSimonD, . Damage propagation modeling for aircraft engine run-to-failure simulation. In: 2008 International Conference on Prognostics and Health Management, Denver, CO, USA, 2008

[44] Sun R, Shi L, Yang X. . A coupling diagnosis method of sensors faults in gas turbine control system. Energy, 2020, 205: 117999

[45] Chen J, Zhang L, Li Y. . A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems. Renewable & Sustainable Energy Reviews, 2022, 161: 112395

[46] ZhouHZhang SPengJ, . Informer: Beyond efficient transformer for long sequence time-series forecasting. In: The 35th Conference on Artificial Intelligence, 2021

[47] Yang X, Zhao Q, Wang Y. . Fault signal reconstruction for multi-sensors in gas turbine control systems based on prior knowledge from time series representation. Energy, 2023, 262: 124996

[48] Rousseeuw P J, Driessen K V. A fast algorithm for the minimum covariance determinant estimator. Technometrics, 1999, 41(3): 212–223

[49] Tax D M J, Duin R P W. Support vector data description. Machine Learning, 2004, 54(1): 45–66

[50] Liu F T, Ting K M, Zhou Z H. Isolation-based anomaly detection. ACM Transactions on Knowledge Discovery from Data, 2012, 6(1): 3

[51] van den OordALiYVinyalsO. Representation learning with contrastive predictive coding. arXiv:1807.03748 [cs.LG], 2019

[52] TonekaboniSEytan DGoldengergA. Unsupervised representation learning for time series with temporal neighborhood coding. In: International Conference on Learning Representations, 2021

[53] van der Maaten L, Hinton G. Visualizing data using t-SNE. Journal of Machine Learning Research, 2008, 9: 2579–2605

RIGHTS & PERMISSIONS

Higher Education Press 2023