Predicting task bottlenecks in digital manufacturing enterprises based on spatio-temporal graph convolutional networks

Abstract

Digital manufacturing enterprises require high operational agility due to the intricate and dynamically changing nature of their tasks. The implementation of accurate and timely predictions of task bottlenecks is therefore crucial to enhancing overall efficiency. Due to task complexities and dynamic business environments, bottleneck prediction is a challenging issue. This study introduces a novel approach that constructs a task network from extensive data accumulated within a digital enterprise to identify and depict the complex interrelations among tasks. Based on this method, we develop a Bottleneck Spatio-Temporal Graph Convolutional Network (BTGCN) model based on deep learning methods that considers spatial features of the task network and temporal data of task execution and integrates the strengths of GCN and GRU. We find that GCN effectively learns and represents the complex topology of task networks to capture spatial dependencies, while GRU adapts to the dynamic changes in task data, accurately capturing temporal dependencies. Informed by the theory of constraints, the study applies the proposed BTGCN model to the prediction of task throughput bottlenecks in digital enterprises. Experimental results demonstrate that while the model has certain limitations, it can accurately extract spatio-temporal correlations from system data, offering advantages in bottleneck prediction over other benchmark models.

Graphical abstract

Keywords

task bottleneck / task network / digital manufacturing enterprise / spatio-temporal

References

[1] Ahuett-Garza H, Kurfess T, (2018). A brief discussion on the trends of habilitating technologies for Industry 4.0 and Smart manufacturing. Manufacturing Letters, 15: 60–63

[2] ArjovskyMShahABengioY (2016). Unitary evolution recurrent neural networks. In: Proceedings of The 33rd International Conference on Machine Learning, PMLR 48:1120-1128

[3] Biller S, Jingshan Li, Marin S P, Meerkov S M, Liang Zhang, (2010). Bottlenecks in Bernoulli serial lines with rework. IEEE Transactions on Automation Science and Engineering, 7( 2): 208–217

[4] Bronstein M M, Bruna J, Lecun Y, Szlam A, Vandergheynst P, (2017). Geometric deep learning: Going beyond euclidean data. IEEE Signal Processing Magazine, 34( 4): 18–42

[5] Buffelli D, Vandin F, (2022). The impact of global structural information in graph neural networks applications. Data, 7( 10): 1–20

[6] Cao Z, Deng J, Liu M, Wang Y, (2012). Bottleneck prediction method based on improved adaptive network-based fuzzy inference system (ANFIS) in Semiconductor Manufacturing System. Chinese Journal of Chemical Engineering, 20( 6): 1081–1088

[7] Chang X, Jia X, (2023). A DeepAR based hybrid probabilistic prediction model for production bottleneck of flexible shop-floor in Industry 4.0. Computers & Industrial Engineering, 185: 109644

[8] Chryssolouris G, Mavrikios D, Papakostas N, Mourtzis D, Michalos G, Georgoulias K, (2009). Digital manufacturing: history, perspectives, and outlook. Proceedings of the Institution of Mechanical Engineers. Part B, Journal of Engineering Manufacture, 223( 5): 451–462

[9] Fang W, Guo Y, Liao W, Huang S, Yang N, Liu J, (2020). A Parallel Gated Recurrent Units (P-GRUs) network for the shifting lateness bottleneck prediction in make-to-order production system. Computers & Industrial Engineering, 140: 106246

[10] Fionda V, Gutierrez C, Pirrò G, (2016). Building knowledge maps of Web graphs. Artificial Intelligence, 239: 143–167

[11] GoldrattE MCoxJ (1984). The goal: A process of ongoing improvement. Taylor & Francis

[12] Hajlaoui R, Moulahi T, Zidi S, El Khediri S, Alaya B, Zeadally S, (2024). Towards smarter cyberthreats detection model for industrial internet of things (IIoT) 4.0. Journal of Industrial Information Integration, 39: 100595

[13] Hasan A S M M, Trianni A, (2023). Boosting the adoption of industrial energy efficiency measures through Industry 4.0 technologies to improve operational performance. Journal of Cleaner Production, 425: 138597

[14] Hu W, Fey M, Zitnik M, Dong Y, Ren H, Liu B, Catasta M, Leskovec J, (2020). Open graph benchmark: Datasets for machine learning on graphs. In: Advances in Neural Information Processing Systems, 33: 22118–22133

[15] Huang S Y, Chen H J, Chiu A A, Chen C P, (2014). The application of the theory of constraints and activity-based costing to business excellence: The case of automotive electronics manufacture firms. Total Quality Management & Business Excellence, 25( 5–6): 532–545

[16] Kiggundu M N, (1981). Task interdependence and the theory of job design. Academy of Management Review, 6( 3): 499–508

[17] Kisvari A, Lin Z, Liu X, (2021). Wind power forecasting—A data-driven method along with gated recurrent neural network. Renewable Energy, 163: 1895–1909

[18] Krizhevsky A, Sutskever I, Hinton G E, (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60( 6): 84–90

[19] Lai X, Shui H, Ding D, Ni J, (2021). Data-driven dynamic bottleneck detection in complex manufacturing systems. Journal of Manufacturing Systems, 60: 662–675

[20] LaiXShuiHNiJ (2018). A two-layer long short-term memory network for bottleneck prediction in multi-job manufacturing systems. In: ASME 2018 13th International Manufacturing Science and Engineering Conference, 3

[21] Li G, Müller M, Qian G, Delgadillo I C, Abualshour A, Thabet A, Ghanem B, (2023a). DeepGCNs: Making GCNs go as deep as CNNs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45( 6): 6923–6939

[22] Li L, (2018). A systematic-theoretic analysis of data-driven throughput bottleneck detection of production systems. Journal of Manufacturing Systems, 47: 43–52

[23] Li L, Chang Q, Ni J, (2009). Data driven bottleneck detection of manufacturing systems. International Journal of Production Research, 47( 18): 5019–5036

[24] Li L, Chang Q, Xiao G, Ambani S, (2011). Throughput bottleneck prediction of manufacturing systems using time series analysis. Journal of Manufacturing Science and Engineering, 133( 2): 021015

[25] Li X, Sun L, Ling M, Peng Y, (2023b). A survey of graph neural network based recommendation in social networks. Neurocomputing, 549: 126441

[26] MontiFBoscainiDMasciJRodolaESvobodaJBronsteinM M (2017). Geometric deep learning on graphs and manifolds using mixture model cnns. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR): 5115–5124

[27] Parisot S, Ktena S I, Ferrante E, Lee M, Guerrero R, Glocker B, Rueckert D, (2018). Disease prediction using graph convolutional networks: application to autism spectrum disorder and Alzheimer’s disease. Medical Image Analysis, 48: 117–130

[28] Peng H, Zhang R, Dou Y, Yang R, Zhang J, Yu P S, (2022). Reinforced neighborhood selection guided multi-relational graph neural networks. ACM Transactions on Information Systems, 40( 4): 1–46

[29] Piccarozzi M, Silvestri L, Silvestri C, Ruggieri A, (2024). Roadmap to Industry 5.0: Enabling technologies, challenges, and opportunities towards a holistic definition in management studies. Technological Forecasting and Social Change, 205: 123467

[30] R. Thorne D, (2006). Throughput: a simple performance index with desirable characteristics. Behavior Research Methods, 38( 4): 569–573

[31] Rezvanian A, Meybodi M R, (2016). Stochastic graph as a model for social networks. Computers in Human Behavior, 64: 621–640

[32] Shen G, Tan Q, Zhang H, Zeng P, Xu J, (2018). Deep learning with gated recurrent unit networks for financial sequence predictions. Procedia Computer Science, 131: 895–903

[33] Subramaniyan M, Skoogh A, Muhammad A S, Bokrantz J, Johansson B, Roser C, (2020). A generic hierarchical clustering approach for detecting bottlenecks in manufacturing. Journal of Manufacturing Systems, 55: 143–158

[34] Subramaniyan M, Skoogh A, Salomonsson H, Bangalore P, Bokrantz J, (2018a). A data-driven algorithm to predict throughput bottlenecks in a production system based on active periods of the machines. Computers & Industrial Engineering, 125: 533–544

[35] Subramaniyan M, Skoogh A, Salomonsson H, Bangalore P, Gopalakrishnan M, Sheikh Muhammad A, (2018b). Data-driven algorithm for throughput bottleneck analysis of production systems. Production & Manufacturing Research, 6( 1): 225–246

[36] Sun B, Zhao D, Shi X, He Y, (2021). Modeling global spatial–temporal graph attention network for traffic prediction. IEEE Access: Practical Innovations, Open Solutions, 9: 8581–8594

[37] TallecCOllivierY (2018). Can recurrent neural networks warp time? arXiv:1804.11188

[38] VashishthSSanyalSNitinVTalukdarP (2019). Composition-based multi-relational graph convolutional networks. arXiv:1911.03082

[39] Wu Z, Meng Z, Gray J, (2017). IoT-based techniques for online M2M-interactive itemized data registration and offline information traceability in a digital manufacturing system. IEEE Transactions on Industrial Informatics, 13( 5): 2397–2405

[40] Wu Z, Pan S, Chen F, Long G, Zhang C, Yu P S, (2021). A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems, 32( 1): 4–24

[41] Xiang W, Yu K, Han F, Fang L, He D, Han Q L, (2024). Advanced manufacturing in industry 5.0: A survey of key enabling technologies and future trends. IEEE Transactions on Industrial Informatics, 20( 2): 1055–1068

[42] Ye Z, Kumar Y J, Sing G O, Song F, Wang J, (2022). A comprehensive survey of graph neural networks for knowledge graphs. IEEE Access: Practical Innovations, Open Solutions, 10: 75729–75741

[43] Yu C, Matta A, (2016). A statistical framework of data-driven bottleneck identification in manufacturing systems. International Journal of Production Research, 54( 21): 6317–6332

[44] Zhang D, Lindholm G, Ratnaweera H, (2018). Use long short-term memory to enhance Internet of Things for combined sewer overflow monitoring. Journal of Hydrology, 556: 409–418

[45] Zhang T, Shan H R, Little M A, (2022). Causal GraphSAGE: A robust graph method for classification based on causal sampling. Pattern Recognition, 128: 108696

[46] ZhangYPalSCoatesMUstebayD (2019). Bayesian graph convolutional neural networks for semi-supervised classification. In: Proceedings of The 33rd AAAI Conference on Artificial Intelligence (AAAI-19):5829–5836

[47] Zhao F, Xia S, Wu Z, Duan D, Wang L, Lin W, Gilmore J H, Shen D, Li G, (2019). Spherical U-Net on cortical surfaces: Methods and applications. In: Chung A, Gee J, Yushkevich P, Bao S, eds. Information Processing in Medical Imaging. IPMI 2019. Lecture Notes in Computer Science, 11492: 855–866

RIGHTS & PERMISSIONS

Higher Education Press