RVFLN-based online adaptive semi-supervised learning algorithm with application to product quality estimation of industrial processes

Abstract

Direct online measurement on product quality of industrial processes is difficult to be realized, which leads to a large number of unlabeled samples in modeling data. Therefore, it needs to employ semi-supervised learning (SSL) method to establish the soft sensor model of product quality. Considering the slow time-varying characteristic of industrial processes, the model parameters should be updated smoothly. According to this characteristic, this paper proposes an online adaptive semi-supervised learning algorithm based on random vector functional link network (RVFLN), denoted as OAS-RVFLN. By introducing a L₂-fusion term that can be seen a weight deviation constraint, the proposed algorithm unifies the offline and online learning, and achieves smoothness of model parameter update. Empirical evaluations both on benchmark testing functions and datasets reveal that the proposed OAS-RVFLN can outperform the conventional methods in learning speed and accuracy. Finally, the OAS-RVFLN is applied to the coal dense medium separation process in coal industry to estimate the ash content of coal product, which further verifies its effectiveness and potential of industrial application.

Keywords

semi-supervised learning (SSL) / L₂-fusion term / online adaptation / random vector functional link network (RVFLN)

References

[1] ShenL, HeJ-J, YuS-Y, GuiW-H. Temperature control for thermal treatment of aluminum alloy in a large-scale vertical quench furnace [J]. Journal of Central South University, 2016, 23(7): 1719-1728

[2] ChaiT-Y, QinS J, WangH. Optimal operational control for complex industrial processes [J]. Annual Reviews in Control, 2014, 38(1): 81-92

[3] ZhouP, DaiW, ChaiT-Y. Multivariable disturbance observer based advanced feedback control design and its application to a grinding circuit [J]. IEEE Transactions on Control Systems Technology, 2014, 22(4): 1474-1485

[4] ZhangT, ChenC L P, ChenL, XuX-M, HuB. Design of highly nonlinear substitution boxes based on I-Ching operators [J]. IEEE Transactions on Cybernetics, 2018, 48(12): 3349-3358

[5] ZhangJ-X, ChenH, ChenS-H, HongX. An improved mixture of probabilistic PCA for nonlinear data-driven process monitoring [J]. IEEE Transactions on Cybernetics, 2019, 49(1): 198-210

[6] WangD, LiuJ, SrinivasanR. Data-driven soft-sensor approach for quality prediction in a refining process [J]. IEEE Transactions on Industrial Informatics, 2010, 6(1): 11-17

[7] ZhouP, LuS-W, ChaiT-Y. Data-driven soft-sensor modeling for product quality estimation using case-based reasoning and fuzzy-similarity rough sets [J]. IEEE Transactions on Automation Science and Engineering, 2014, 11(4): 992-1003

[8] ChapelleO, LkopfB S, AlexanderZ. Semi-supervised learning [J]. IEEE Transactions on Neural Networks, 2009, 20: 542-542

[9] ZhuX-JSemi-supervised learning literature survey [R], 2005, Madison, University of Wisconsin

[10] PiroonsupN, SinthupinyoS. Analysis of training data using clustering to improve semi-supervised self-training [J]. Knowledge-Based Systems, 2018, 143: 65-80

[11] FujinoA, UedaN, SaitoK. A hybrid generative/discriminative classifier design for semi-supervised learning [J]. Transactions of the Japanese Society for Artificial Intelligence, 2006, 21(3): 301-309

[12] JoachimsT. Transductive inference for text classification using support vector machines [C]. Proceedings of the 16th Machine Learning, 1999, San Francisco, Morgan Kaufmann Publishers Inc: 200209

[13] BlumA, MitchellT. Combining labeled and unlabeled data with co-training [C]. Proceedings of the 11th Computational Learning Theory, 1998, New York, USA, ACM Press: 9210098

[14] BelkinM, NiyogiP. Laplacian eigenmaps and spectral techniques for embedding and clustering [J]. Advances in Neural Information Processing Systems, 2001, 14: 585-591

[15] PanickerR C, PuthusserypadyS, SunY. Adaptation in P300 brain-computer interfaces: A two-classifier cotraining approach [J]. IEEE Transactions on Biomedical Engineering, 2010, 57(12): 2927-2935

[16] DasguptaS, LittmanM L, DavidM. Pac generalization bounds for co-training [C]. Proceedings of the 14th Neural Information Processing Systems, 2001, Massachusetts, MIT Press: 18

[17] BalcanM F, BlumA, YangK. Co-training and expansion: Towards bridging theory and practice [C]. Proceedings of the Neural Information Processing Systems, 2004, Massachusetts, MIT Press: 8996

[18] TianZ, KuangR. Global linear neighborhoods for efficient label propagation [C]. Proceedings of the 2012 SIAM International Conference on Data Mining, 2013, Philadelphia, USA, Society for Industrial and Applied Mathematics: 863872

[19] NieF-P, XiangS-M, LiuY, ZhangC-S. A general-graph based semi-supervised learning with novel class discovery [J]. Neural Computing and Applications, 2010, 19(4): 549-555

[20] JoachimsT. Transductive inference for text classification using support vector machines [C]. Proceedings of the 16th International Conference on Machine Learning, 1999, San Francisco, Margan Kaufmann Publishers Inc: 200209

[21] UeffingN, HaffariG, SarkarA. Semi-supervised model adaptation for statistical machine translation [J]. Machine Translation, 2007, 21(2): 77-94

[22] LiY-Q, GuanC-T, LiH-Q, ChinZ-Y. A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system [J]. Pattern Recognition Letters, 2008, 29(9): 1285-1294

[23] GoldbergA B, LiM, ZhuX-J. Online manifold regularization: a new learning setting and empirical study [C]. Proceedings of the European Conference on Machine Learning & Knowledge Discovery in Databases, 2008, Berlin, Springer-Verlag: 393407

[24] GeorgakisC. Design of dynamic experiments: A data-driven methodology for the optimization of time-varying processes [J]. Industrial & Engineering Chemistry Research, 2013, 52(35): 12369-12382

[25] TangJ, YuW, ChaiT-Y, ZhaoL-J. On-line principal component analysis with application to process modeling [J]. Neurocomputing, 2012, 82: 167-178

[26] PaoY H, TakefujiY. Functional-link net computing: Theory, system architecture, and functionalities [J]. Computer, 1992, 25(5): 76-79

[27] ScardapaneS, WangD-H. Randomness in neural networks: An overview [J]. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2017, 7(2): 1-18

[28] GallagherN B, WiseB M, ButlerS W, WhiteD D J, BarnaG G. Development and benchmarking of multivariate statistical process control tools for a semiconductor etch process: improving robustness through model updating [J]. IFAC Proceedings Volumes, 1997, 30(9): 79-84

[29] ZhangL-J, XiaX-H, ZhuB. A dual-loop control system for dense medium coal washing processes with sampled and delayed measurements [J]. IEEE Transactions on Control Systems Technology, 2017, 25(6): 2211-2218