Reliability of system-of-systems: A new challenge of complex engineered systems

Abstract

The emergence of systems-of-systems (SoS) brings new challenges for reliability research within the field of system-of-systems engineering (SoSE). In response, this study examines the requirements for measurement, evaluation, and design/testing of SoS reliability. Drawing on research practice in aerospace engineering, it outlines the concept of equipment SoS and proposes a corresponding research framework for equipment SoS reliability. By analyzing both the reliability demands of SoSE and the current research practice in aerospace equipment SoS, this study identifies several key challenges: Modeling of SoS and its reliability, network reliability in SoS, propagation and recovery of disturbances in SoS, reliability design and simulation methods, and reliability management in SoSE.

Graphical abstract

Keywords

system-of-systems (SoS) / architecture / reliability / network reliability / resilience

References

[1] Arasteh H, Vahidinasab V, Sepasian M S, Aghaei J, (2019). Stochastic system of systems architecture for adaptive expansion of smart distribution grids. IEEE Transactions on Industrial Informatics, 15( 1): 377–389

[2] Axelsson J, (2019). Game theory applications in systems-of-systems engineering: A literature review and synthesis. Procedia Computer Science, 153: 154–165

[3] Baldwin W C, Ben-Zvi T, Sauser B J, (2012). Formation of collaborative system of systems through belonging choice mechanisms. IEEE Transactions on Systems, Man, and Cybernetics. Part A, Systems and Humans, 42( 4): 793–801

[4] Bourne M, Franco-Santos M, Micheli P, Pavlov A, (2018). Performance measurement and management: A system of systems perspective. International Journal of Production Research, 56( 8): 2788–2799

[5] Cavallo A, Ireland V, (2014). Preparing for complex interdependent risks: A System of Systems approach to building disaster resilience. International Journal of Disaster Risk Reduction, 9: 181–193

[6] Chen K, Huang N, Wang Y, Zhu J X, Yu J T, (2024a). Reliability analysis for 5G industrial network with application and dynamic coupling. Reliability Engineering & System Safety, 238: 115384

[7] Chen L W, Dui H Y, Zhang C, (2020). A resilience measure for supply chain systems considering the interruption with the cyber-physical systems. Reliability Engineering & System Safety, 199: 106869

[8] Chen Z Q, Sun Q, Li N; Li X; Wang Y; I CL, (2024b). Enabling mobile AI agent in 6G era: Architecture and key technologies. IEEE Network, 38( 5): 66–75

[9] Chen Z W, Hong D P, Cui W W, Xue W K, Wang Y, Zhong J L, (2023). Resilience evaluation and optimal design for weapon system of systems with dynamic reconfiguration. Reliability Engineering & System Safety, 237: 109409

[10] ChenZ WYin S YLiL FCuiW WHongD P (2024c). Resilience metric and dynamic assessment of unmanned system-of-systems considering cooperative reconfiguration strategies. IEEE Transactions on Reliability: 1–13

[11] Cherfa I, Belloir N, Sadou S, Fleurquin R, Bennouar D, (2019). Systems of Systems: From mission definition to architecture description. Systems Engineering, 22( 6): 437–454

[12] Corsello M A, (2008). System-of-Systems architectural considerations for complex environments and evolving requirements. IEEE Systems Journal, 2( 3): 312–320

[13] De Domenico M, (2023). More is different in real-world multilayer networks. Nature Physics, 19( 9): 1247–1262

[14] DeLaurentis D A, Ayyalasomayajula S, (2009). Exploring the synergy between industrial ecology and system of systems to understand complexity. Journal of Industrial Ecology, 13( 2): 247–263

[15] Duan D L, Lv C C, Si S B, Wang Z, Li D Q, Gao J X, Havlin S, Stanley H E, Boccaletti S, (2019). Universal behavior of cascading failures in interdependent networks. Proceedings of the National Academy of Sciences of the United States of America, 116( 45): 22452–22457

[16] Dui H Y, Zheng X Q, Wu S M, (2021). Resilience analysis of maritime transportation systems based on importance measures. Reliability Engineering & System Safety, 209: 107461

[17] Eusgeld I, Nan C, Dietz S, (2011). “System-of-Systems” approach for interdependent critical infrastructures. Reliability Engineering & System Safety, 96( 6): 679–686

[18] Feng S, Sun H W, Yan X T, Zhu H J, Zou Z X, Shen S Y, Liu H X, (2023). Dense reinforcement learning for safety validation of autonomous vehicles. Nature, 615( 7953): 620–627

[19] Fiksel J, (2003). Designing resilient, sustainable systems. Environmental Science & Technology, 37( 23): 5330–5339

[20] Gao J X, Barzel B, Barabási A L, (2016). Universal resilience patterns in complex networks. Nature, 530( 7590): 307–312

[21] Gao J X, Buldyrev S V, Havlin S, Stanley H E, (2011). Robustness of a network of networks. Physical Review Letters, 107( 19): 195701

[22] Garro A, Tundis A, (2015). On the reliability analysis of systems and SoS: The RAMSAS method and related extensions. IEEE Systems Journal, 9( 1): 232–241

[23] Ge B F, Hipel K W, Yang K W, Chen Y W, (2014). A novel executable modeling approach for system-of-systems architecture. IEEE Systems Journal, 8( 1): 4–13

[24] Gorod A, Sauser B, Boardman J, (2008). System-of-Systems engineering management: a review of modern history and a path forward. IEEE Systems Journal, 2( 4): 484–499

[25] Han Q, Li W M, Xu Q L, Song Y F, Fan C L, Zhao M R, (2022). Novel measures for linguistic hesitant Pythagorean fuzzy sets and improved TOPSIS method with application to contributions of system-of-systems. Expert Systems with Applications, 199: 117088

[26] Holling C S, (1973). Resilience and stability of ecological systems. Annual Review of Ecology and Systematics, 4: 1–23

[27] Holt J, Perry S, Payne R, Bryans J, Hallerstede S, Hansen F O, (2015). A model-based approach for requirements engineering for systems of systems. IEEE Systems Journal, 9( 1): 252–262

[28] ISO/IEC/IEEE (2019). Systems and software engineering — System of Systems (SoS) considerations in life cycle stages of a system

[29] Jia N P, You Y Q, Lu Y J, Guo Y, Yang K W, (2019). Research on the search and rescue system-of-systems capability evaluation index system construction method based on weighted supernetwork. IEEE Access: Practical Innovations, Open Solutions, 7: 97401–97425

[30] Jiao T C, Yuan H, Wang J, Ma J, Li X L, Luo A M, (2024). System-of-Systems resilience analysis and design using Bayesian and dynamic bayesian networks. Mathematics, 12( 16): 2510

[31] Keating C B, Padilla J J, Adams K, (2008). System of Systems engineering requirements: Challenges and guidelines. Engineering Management Journal, 20( 4): 24–31

[32] Li J C, Tan Y J, Yang K W, Zhang X K, Ge B F, (2017). Structural robustness of combat networks of weapon system-of-systems based on the operation loop. International Journal of Systems Science, 48( 3): 659–674

[33] Li J C, Zhao D L, Jiang J, Yang K W, Chen Y W, (2021). Capability oriented equipment contribution analysis in temporal combat networks. IEEE Transactions on Systems, Man, and Cybernetics. Systems, 51( 2): 696–704

[34] Lin M L, Chen T, Ren B B, Chen H H, Zhang M M, Guo D K, (2023). CADer: A deep reinforcement learning approach for designing the communication architecture of system of systems. IEEE Transactions on Intelligent Vehicles, 8( 5): 3405–3417

[35] Liu J H, Xu R J, Li J C, Yang K W, Lou Z Y, (2024). Enhancing the resilience of combat system-of-systems under continuous attacks: Novel index and reinforcement learning-based protection optimization. Expert Systems with Applications, 251: 123912

[36] Liu S Y, (2011). Employing system of systems engineering in china’s emergency management. IEEE Systems Journal, 5( 2): 298–308

[37] Ma L J, Zhang X, Li J Q, Lin Q Z, Gong M G, Coello C A C, Nandi A K, (2022). Enhancing robustness and resilience of multiplex networks against node-community cascading failures. IEEE Transactions on Systems, Man, and Cybernetics. Systems, 52( 6): 3808–3821

[38] Maier M W, (1998). Architecting principles for systems-of-systems. Systems Engineering, 1( 4): 267–284

[39] Mostafavi A, Abraham D M, DeLaurentis D, Sinfield J, (2011). Exploring the dimensions of systems of innovation analysis: A system of systems framework. IEEE Systems Journal, 5( 2): 256–265

[40] Nielsen C B, Larsen P G, Fitzgerald J, Woodcock J, Peleska J, (2015). Systems of Systems engineering: Basic concepts, model-based techniques, and research directions. ACM Computing Surveys, 48( 2): 1–41

[41] Pan X, Dang Y H, Wang H X, Hong D P, Li Y H, Deng H X, (2022). Resilience model and recovery strategy of transportation network based on travel OD-grid analysis. Reliability Engineering & System Safety, 223: 108483

[42] Pan X, Wang H X, Yang Y J, Zhang G Z, (2019). Resilience based importance measure analysis for SoS. Journal of Systems Engineering and Electronics, 30( 5): 920–930

[43] Panetto H, Iung B, Ivanov D, Weichhart G, Wang X F, (2019). Challenges for the cyber-physical manufacturing enterprises of the future. Annual Reviews in Control, 47: 200–213

[44] Silva R D, Braga R T V, (2020). Simulating Systems-of-Systems with agent-based modeling: A systematic literature review. IEEE Systems Journal, 14( 3): 3609–3617

[45] Sun Q, Li H X, Wang Y Z, Zhang Y C, (2022). Multi-swarm-based cooperative reconfiguration model for resilient unmanned weapon system-of-systems. Reliability Engineering & System Safety, 222: 108426

[46] Sun Q, Li H X, Zhong Y F, Ren K Z, Zhang Y C, (2024). Deep reinforcement learning-based resilience enhancement strategy of unmanned weapon system-of-systems under inevitable interferences. Reliability Engineering & System Safety, 242: 109749

[47] Tao L F, Liu H F, Ning G, Cao W Y, Huang B H, Lu C, (2025). LLM-based framework for bearing failure diagnosis. Mechanical Systems and Signal Processing, 224: 112127

[48] Thacker S, Pant R, Hall J W, (2017). System-of-systems formulation and disruption analysis for multi-scale critical national infrastructures. Reliability Engineering & System Safety, 167: 30–41

[49] Tran H T, Domerçant J C, Mavris D N, (2015). Evaluating the agility of adaptive command and control networks from a cyber complex adaptive systems perspective. Journal of Defense Modeling and Simulation, 12( 4): 405–422

[50] Tsilipanos K, Neokosmidis I, Varoutas D, (2013). A System of Systems framework for the reliability assessment of telecommunications networks. IEEE Systems Journal, 7( 1): 114–124

[51] Uday P, Marais K, (2015). Designing resilient Systems-of-Systems: A survey of metrics, methods, and challenges. Systems Engineering, 18( 5): 491–510

[52] US Department of Defense (DoD) (2008). Systems engineering guide for systems of systems

[53] Wang L X, Ye D, Xiao Y, Kong X R, (2023). Trajectory planning for satellite cluster reconfigurations with sequential convex programming method. Aerospace Science and Technology, 136: 108216

[54] Wang Z, Liu S F, Fang Z G, (2020). Research on SoS-GERT network model for equipment system of systems contribution evaluation based on joint operation. IEEE Systems Journal, 14( 3): 4188–4196

[55] Wu T H, Gong P, Li Y, (2022). Future cities as a system of systems: Its concept, mechanism and creation. Chinese Science Bulletin, 67( 1): 18–26

[56] Yang B F, Zhang L, Zhang B, Xiang Y, An L, Wang W F, (2022). Complex equipment system resilience: Composition, measurement and element analysis. Reliability Engineering & System Safety, 228: 108783

[57] Yu Y S, Lakemond N, Holmberg G, (2024). Resilience in emerging complex intelligent systems: A case study of search and rescue. Journal of Contingencies and Crisis Management, 32( 4): e12626

RIGHTS & PERMISSIONS

Higher Education Press