Machine learning-assisted surrogate model for developing MIMO quantitative relationship in plastic injection molding

Abstract

Plastic injection molding (IM) is a typical multiple-input multiple-output (MIMO) complex manufacturing process widely used in modern industrial production. Determining the critical process parameters and establishing the MIMO quantitative relationship between them and the plastic product quality are two fundamental problems in IM process decision analytics. Focusing on high-dimensional process parameters and multidimensional quality indicators in the IM process, this study developed a machine learning-assisted surrogate model that integrated joint mutual information (JMI) and multi-output support vector regression (MSVR). Firstly, a JMI-based sequential search algorithm was developed to measure the association relationship between each process parameter and a multidimensional quality indicator set, and automatically select the critical process parameters of the IM process. It can effectively filter redundant information from raw industrial datasets and provide essential input features for the development of surrogate models. The MSVR model was then developed to capture the MIMO quantitative relationship between the selected critical process parameters and multidimensional quality indicator set. The proposed method can preserve complete independent variable information and avoid losing the relevance of data during training. Finally, the effectiveness of the model was verified using a real-world IM process dataset.

Keywords

Plastic injection molding (IM) / Multiple-input multiple-output (MIMO) modeling / Process optimization / Machine learning application / Intelligent decision analytics

References

[1] Sun YN, Chen Y, Wang WY et al (2021) Modelling and prediction of injection molding process using copula entropy and multi-output SVR. In: IEEE 17th international conference on automation science and engineering, IEEE, lyon, France. https://doi.org/10.1109/CASE49439.2021.9551391

[2] QinY, ZhaoC, GaoF. An intelligent non-optimality self-recovery method based on reinforcement learning with small data in big data era. Chemom Intell Lab Syst, 2018, 176: 89-100

[3] Sáez-CometC, FontdecabaE, CuadradoN, et al.. Injection molding and characterization of microtextures on polycarbonate using laser textured inserts. Mater Manuf Process, 2022, 38: 618-628

[4] ManjunathM, PillappanSS, KurseS. Process parameter analysis of double pass friction stir composite welds. Mater Manuf Process, 2023, 39(2): 174-187

[5] ManojA, MiriyalaSS, MitraK. Multi-objective optimization through a novel Bayesian approach for industrial manufacturing of polyvinyl acetate. Mater Manuf Process, 2023, 38(15): 1955-1963

[6] LocknerY, HopmannC, ZhaoW. Transfer learning with artificial neural networks between injection molding processes and different polymer materials. J Manuf Process, 2022, 73: 395-408

[7] ZhaoNY, LianJY, WangPF, et al.. Recent progress in minimizing the warpage and shrinkage deformations by the optimization of process parameters in plastic injection molding: a review. Int J Adv Manuf Technol, 2022, 120: 85-101

[8] SelvarajSK, RajA, MahadevanRR, et al.. A review on machine learning models in injection molding machines. Adv Mater Sci Eng, 2022, 1: 1949061

[9] FarahaniS, KhadeV, BasuS, et al.. A data-driven predictive maintenance framework for injection molding process. J Manuf Process, 2022, 80: 887-897

[10] GimJ, TurngLS. A review of current advancements in high surface quality injection molding: measurement, influencing factors, prediction, and control. Polymer Test, 2022, 115: 107718

[11] GimJ, YangH, TurngLS. Transfer learning of machine learning models for multi-objective process optimization of a transferred mold to ensure efficient and robust injection molding of high surface quality parts. J Manuf Process, 2023, 87: 11-24

[12] ZhouX, ZhangY, MaoT, et al.. Monitoring and dynamic control of quality stability for injection molding process. J Mater Process Technol, 2017, 249: 358-366

[13] JiangQ, YanX, YiH, et al.. Data-driven batch-end quality modeling and monitoring based on optimized sparse partial least squares. IEEE Trans Ind Electron, 2020, 67: 4098-4107

[14] SunYN, QinW, XuHW, et al.. A multiphase information fusion strategy for data-driven quality prediction of industrial batch processes. Inf Sci, 2022, 608: 81-95

[15] WangJ, XuC, ZhangJ, et al.. Big data analytics for intelligent manufacturing systems: a review. J Manuf Syst, 2022, 62: 738-752

[16] LeeDH, YangJK, LeeCH, et al.. A data-driven approach to selection of critical process steps in the semiconductor manufacturing process considering missing and imbalanced data. J Manuf Syst, 2019, 52: 146-156

[17] XuH, ZhangJ, LvY, et al.. Hybrid feature selection for wafer acceptance test parameters in semiconductor manufacturing. IEEE Access, 2020, 8: 17320-17330

[18] QinW, ZhuangZ, GuoL, et al.. A hybrid multi-class imbalanced learning method for predicting the quality level of diesel engines. J Manuf Syst, 2022, 62: 846-856

[19] RaoH, ShiX, RodrigueAK, et al.. Feature selection based on artificial bee colony and gradient boosting decision tree. Appl Soft Comput, 2019, 74: 634-642

[20] MokhtiaM, EftekhariM, Saberi-MovahedF. Feature selection based on regularization of sparsity based regression models by hesitant fuzzy correlation. Appl Soft Comput, 2020, 91: 106255

[21] WangY, CangS, YuH. Mutual information inspired feature selection using kernel canonical correlation analysis. Expert Syst Appl, 2019, 4: 100014

[22] QinW, ZhaD, ZhangJ. An effective approach for causal variables analysis in diesel engine production by using mutual information and network deconvolution. J Intell Manuf, 2018, 31: 1661-1671

[23] WangJ, ZhengP, ZhangJ. Big data analytics for cycle time related feature selection in the semiconductor wafer fabrication system. Comput Ind Eng, 2020, 143: 106362

[24] RibeiroB. Support vector machines for quality monitoring in a plastic injection molding process. IEEE Trans Syst Man Cybern Part C Appl Rev, 2005, 35: 401-410

[25] LuN, GaoF. Stage-based process analysis and quality prediction for batch processes. Ind Eng Chem Res, 2005, 44: 3547-3555

[26] GuntherJC, ConnerJS, SeborgDE. Process monitoring and quality variable prediction utilizing PLS in industrial fed-batch cell culture. J Process Control, 2009, 19: 914-921

[27] ZhaoC, WangF, GaoF. Improved calibration investigation using phase-wise local and cumulative quality interpretation and prediction. Chemom Intell Lab Syst, 2009, 95: 107-121

[28] VuolioT, VisuriVV, SorsaA, et al.. Machine learning assisted identification of grey-box hot metal desulfurization model. Mater Manuf Process, 2023, 38(15): 1983-1996

[29] DhasonR, RoyS, DattaS. Surrogate model assisted design optimization of composite bone plates to achieve selective stress shielding. Mater Manuf Process, 2023, 38(16): 2034-2043

[30] WangG, LedwochA, HasaniRM, et al.. A generative neural network model for the quality prediction of work in progress products. Appl Soft Comput, 2019, 85: 105683

[31] ChiuCC, YaoY. Multiway elastic net (MEN) for final product quality prediction and quality-related analysis of batch processes. Chemom Intell Lab Syst, 2013, 125: 153-165

[32] ShengXC, XiongWL. Soft sensor design based on phase partition ensemble of LSSVR models for nonlinear batch processes. Math Biosci Eng, 2019, 17: 1901-1921

[33] FinkeldeyF, VolkeJ, ZargesJC, et al.. Learning quality characteristics for plastic injection molding processes using a combination of simulated and measured data. J Manuf Process, 2020, 60: 134-143

[34] XuHW, QinW, SunYN, et al.. Attention mechanism-based deep learning for heat load prediction in blast furnace ironmaking process. J Intell Manuf, 2023, 35(3): 1207-1220

[35] ZhouP, ZhangR, XieJ, et al.. Data-driven monitoring and diagnosing of abnormal furnace conditions in blast furnace ironmaking: an integrated PCA-ICA method. IEEE Trans Ind Electron, 2021, 68: 622-631

[36] XuHW, QinW, LvYL, et al.. Data-driven adaptive virtual metrology for yield prediction in multibatch wafers. IEEE Trans Ind Inform, 2022, 18: 9008-9016

[37] GarcíaV, SánchezJS, Rodríguez-PicónLA, et al.. Using regression models for predicting the product quality in a tubing extrusion process. J Intell Manuf, 2019, 30: 2535-2544

[38] SunYN, QinW, HuJH, et al.. A causal model-inspired automatic feature-selection method for developing data-driven soft sensors in complex industrial processes. Engineering, 2023, 22: 82-93

[39] SunYN, ChenQL, HuJH, et al.. An integrated CRN-SVR approach for the quality consistency improvement in a diesel engine assembly process. Int J Comput Integr Manuf, 2023, 37(9): 1126-1141

[40] DuttweilerDL. Proportionate normalized least-mean-squares adaptation in echo cancelers. IEEE Trans Speech Audio Process, 2000, 8: 508-518

[41] SalemOAM, LiuF, ChenYPP, et al.. Feature selection and threshold method based on fuzzy joint mutual information. Int J Approx Reason, 2021, 132: 107-126

[42] LallS, SinhaD, GhoshA, et al.. Stable feature selection using copula based mutual information. Pattern Recognit, 2021, 112: 107697

[43] ZhouH, ZhangY, ZhangY, et al.. Feature selection based on conditional mutual information: minimum conditional relevance and minimum conditional redundancy. Appl Intell, 2018, 49: 883-896

[44] ShenX, DuSC, SunYN, et al.. Advance scheduling for chronic care under online or offline revisit uncertainty. IEEE Trans Autom Sci Eng, 2023, 21(4): 5297-5310

[45] HanM, RenW, LiuX. Joint mutual information-based input variable selection for multivariate time series modeling. Eng Appl Artif Intell, 2015, 37: 250-257

[46] BennasarM, HicksY, SetchiR. Feature selection using joint mutual information maximization. Expert Syst Appl, 2015, 42: 8520-8532

[47] DruckerH, BurgesCJC, KaufmanL, et al.. Support vector regression machines. Proc NIPS, 1997, 9: 155-161

[48] Pérez-Cruz F, Camps-Valls G, Soria-Olivas E et al (2002) Multi-dimensional function approximation and regression estimation. In: International conference on artificial neural networks, Springer, Berlin. https://doi.org/10.1007/3-540-46084-5_123

[49] BaoY, XiongT, HuZ. Multi-step-ahead time series prediction using multiple-output support vector regression. Neurocomputing, 2014, 129: 482-493

[50] Sánchez-FernándezM, de-Prado-CumplidoM, Arenas-GarcíaJ, et al.. SVM multiregression for nonlinear channel estimation in multiple-input multiple-output systems. IEEE Trans Signal Process, 2004, 52: 2298-2307

[51] VapnikVN. An overview of statistical learning theory. IEEE Trans Neural Netw, 1999, 10: 988-999

[52] XuS, AnX, QiaoX, et al.. Multi-output least-squares support vector regression machines. Pattern Recognit Lett, 2013, 34: 1078-1084

Funding

National Natural Science Foundation of China(52305545)

Special Fund for Promoting High Quality Industrial Development by Shanghai Economic and Information Technology Commission(2023-GYHLW-01012)

Key Technologies Research and Development Program(2021YFB3300503)

RIGHTS & PERMISSIONS

Shanghai University and Periodicals Agency of Shanghai University and Springer-Verlag GmbH Germany, part of Springer Nature