Dynamic reliability decision-making frameworks: trends and opportunities

Abstract

Reliability engineering and management are becoming more important as systems evolve in functionality and complexity. Given various dynamic factors influencing reliability, static one-time decision frameworks can no longer offer optimal reliability decisions. In the paper, we discuss the recent trends in reliability decision-making methods across three stages of reliability issues: reliability testing and optimization, reliability modeling and evaluation, and post-service design. We can find a growing interest in time-dependent dynamic methods in research for all these three stages. Sequential decision modeling methods, such as the Markov decision process and its extensions, can be a resort to solve these problems, while modeling and problem-solving can be quite challenging under certain circumstances. Future research holds promising opportunities in related topics.

Keywords

Reliability / sequential decision models / maintenance optimization / reliability optimization

References

[1] Hong Y,Meeker WQ,Gu X.Statistical methods for degradation data with dynamic covariates information and an application to outdoor weathering data.Technometrics2015;57:180-93

[2] Diallo C,Khatab A.State of the art review of quality, reliability and maintenance issues in closed-loop supply chains with remanufacturing.Int J Prod Res2017;55:1277-96

[3] Zhang D.Dynamic decision-making for reliability and maintenance analysis of manufacturing systems based on failure effects.Enterp Inf Syst2017;11:1228-42

[4] Gandoman FH,Goutam S.Concept of reliability and safety assessment of lithium-ion batteries in electric vehicles: basics, progress, and challenges.Appl Energy2019;251:113343

[5] Zhao X,Doyen L.Optimal inspection and replacement policy based on experimental degradation data with covariates.IISE Trans2019;51:322-36

[6] Lobato FS,Cavalini Jr AA.Reliability-based robust multi-objective optimization applied to engineering system design.Eng Optim2020;52:1-21

[7] Liu L,Jiang T.Utilizing accelerated degradation and field data for life prediction of highly reliable products.Qual Reliab Eng Int2016;32:2281-97

[8] Collins DH,Huzurbazar AV,Weaver BP.Accelerated test methods for reliability prediction.J Qual Technol2013;45:244-59

[9] Baladeh AE.A two-stage stochastic programming model of component test plan and redundancy allocation for system reliability optimization.IEEE Trans Reliab2021;70:99-109

[10] Mellal MA,Williams EJ.System reliability optimization with heterogeneous components using hosted cuckoo optimization algorithm.Reliab Eng Syst Saf2020;203:107110

[11] Coit DW.The evolution of system reliability optimization.Reliab Eng Syst Saf2019;192:106259

[12] Li X,Ding Q.Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction.Reliab Eng Syst Saf2019;182:208-18

[13] Peng W,Ye Z.Degradation-based reliability modeling of complex systems in dynamic environments. Singapore: Springer; 2017; pp. 81-103.

[14] Li C,Li L,Wang X.On dynamically monitoring aggregate warranty claims for early detection of reliability problems.IISE Trans2020;52:568-87

[15] Gan S,Coit DW.Maintenance optimization considering the mutual dependence of the environment and system with decreasing effects of imperfect maintenance.Reliab Eng Syst Saf2023;235:109202

[16] Friederich J.Reliability assessment of manufacturing systems: a comprehensive overview, challenges and opportunities.J Manuf Syst2024;72:38-58

[17] Meeker WQ.A review of recent research and current issues in accelerated testing.Int Stat Rev1993;61:147

[18] Limon S,Liao H.A literature review on planning and analysis of accelerated testing for reliability assessment.Qual Reliab Eng Int2017;33:2361-83

[19] Zhao X,Liu B.Accelerated degradation tests planning with competing failure modes.IEEE Trans Reliab2018;67:142-55

[20] Meeker WQ,Hong Y.Using accelerated life tests results to predict product field reliability.Technometrics2009;51:146-61

[21] Meeker WQ,Lu CJ.Accelerated degradation tests: modeling and analysis.Technometrics1998;40:89

[22] Ye Z,Tang LC.Accelerated degradation test planning using the inverse gaussian process.IEEE Trans Reliab2014;63:750-63

[23] Ghaderi A,Khodaygan S.A Bayesian-reliability based multi-objective optimization for tolerance design of mechanical assemblies.Reliab Eng Syst Saf2021;213:107748

[24] Song J,Wei P,Zhang W.Constrained Bayesian optimization algorithms for estimating design points in structural reliability analysis.Reliab Eng Syst Saf2024;241:109613

[25] Fang G,Stufken J.Optimal setting of test conditions and allocation of test units for accelerated degradation tests with two stress variables.IEEE Trans Reliab2021;70:1096-111

[26] Zhao X,Lv S.Reliability testing for product return prediction.Eur J Oper Res2023;304:1349-63

[27] Etemadi AH.Design and routine test optimization of modern protection systems with reliability and economic constraints.IEEE Trans Power Deliv2012;27:271-8

[28] Wang R,Zhang W,Li Y.Reliability analysis of complex electromechanical systems: state of the art, challenges, and prospects.Qual Reliab Eng Int2022;38:3935-69

[29] He K,Xie M.Sequential Bayesian planning for accelerated degradation tests considering sensor degradation.IEEE Trans Reliab2023;72:964-74

[30] Lee I,Tseng S.Sequential Bayesian design for accelerated life tests.Technometrics2018;60:472-83

[31] Sutton RS. Reinforcement learning: an introduction. MIT Press; 2018. Available from: https://books.google.com/books?hl=zh-CN&lr=&id=uWV0DwAAQBAJ&oi=fnd&pg=PR7&dq=Sutton,+R.+S.+%26+Barto,+A.+G.+Reinforcement+Learning:+An+Introduction+(MIT+Press,+2018).&ots=mjqHm-YYo0&sig=qXB9jA_4jYcn0-4JysHj08ubr1I#v=onepage&q=Sutton%2C%20R.%20S.%20%26%20Barto%2C%20A.%20G.%20Reinforcement%20Learning%3A%20An%20Introduction%20(MIT%20Press%2C%202018).&f=false [Last accessed on 30 Nov 2024]

[32] Zhang Z,Xu Y,Cao Y.A novel reliability redundancy allocation problem formulation for complex systems.Reliab Eng Syst Saf2023;239:109471

[33] Li J,Li Y.Redundancy allocation under state-dependent distributional uncertainty of component lifetimes.Prod Oper Manag2023;32:930-50

[34] Wang S.Distributionally robust design for redundancy allocation.INFORMS J Comput2020;32:620-40

[35] Reihaneh M,Eskandarpour M.An exact algorithm for the redundancy allocation problem with heterogeneous components under the mixed redundancy strategy.Eur J Oper Res2022;297:1112-25

[36] Peiravi A,Zanjani MK.Universal redundancy strategy for system reliability optimization.Reliab Eng Syst Saf2022;225:108576

[37] Meng Z,Zhou H.A novel experimental data-driven exponential convex model for reliability assessment with uncertain-but-bounded parameters.Appl Math Model2020;77:773-87

[38] Murthy DNP,Jiang R.Weibull models. Wiley; 2004.

[39] Hajiha M,Hong Y.Degradation under dynamic operating conditions: modeling, competing processes and applications.J Qual Technol2021;53:347-68

[40] Singpurwalla ND.Survival in dynamic environments.Stat Sci1995;10:86-103

[41] Eryilmaz S.An algorithmic approach for the dynamic reliability analysis of non-repairable multi-state weighted k-out-of-n:G system.Reliab Eng Syst Saf2014;131:61-5

[42] Luo C,Xu A.Modelling and estimation of system reliability under dynamic operating environments and lifetime ordering constraints.Reliab Eng Syst Saf2022;218:108136

[43] Ye Z.Stochastic modelling and analysis of degradation for highly reliable products.2015;31:16-32

[44] Zhang S,Shi X.A wiener process model with dynamic covariate for degradation modeling and remaining useful life prediction.IEEE Trans Reliab2023;72:214-23

[45] Xu Z.Machine learning for reliability engineering and safety applications: review of current status and future opportunities.Reliab Eng Syst Saf2021;211:107530

[46] Song S,Feng Q.Reliability analysis for multi-component systems subject to multiple dependent competing failure processes.IEEE Trans Reliab2014;63:331-45

[47] Han X,Lu L,Zheng Y.A comparative study of commercial lithium ion battery cycle life in electrical vehicle: aging mechanism identification.J Power Sources2014;251:38-54

[48] Fan M,Zio E.Modeling dependent competing failure processes with degradation-shock dependence.Reliab Eng Syst Saf2017;165:422-30

[49] Wu B.A gamma process based model for systems subject to multiple dependent competing failure processes under Markovian environments.Reliab Eng Syst Saf2022;217:108112

[50] Zhou H.Optimal replacement in a proportional hazards model with cumulative and dependent risks.Comput Ind Eng2023;176:108930

[51] Zhai Q,Li C,Dunson DB.Modeling recurrent failures on large directed networks.J Am Stat Assoc2024;1-15

[52] de Jonge B, Scarf PA. A review on maintenance optimization.Eur J Oper Res2020;285:805-24

[53] Hu J,Shen L.Maintenance optimization of a two-component series system considering masked causes of failure.Qual Reliab Eng Int2024;40:388-405

[54] Sun Q,Wang X.Robust condition-based production and maintenance planning for degradation management.Prod Oper Manag2023;32:3951-67

[55] Uit Het Broek MA, Teunter RH, de Jonge B, Veldman J. Joint condition-based maintenance and load-sharing optimization for two-unit systems with economic dependency.Eur J Oper Res2021;295:1119-31

[56] Puterman ML.Chapter 8 Markov decision processes. Elsevier; 1990; pp. 331-434.

[57] Wiesemann W,Rustem B.Robust Markov decision processes.Math Oper Res2013;38:153-83

[58] Deep A,Veeramani D.Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations.Eur J Oper Res2023;311:533-44

[59] Drent C,Arts J.Real-time integrated learning and decision making for cumulative shock degradation.Manuf Serv Oper Manag2023;25:235-53

[60] Mahmoodi S,Zhao YQ.Condition-based maintenance policies for a multi-unit deteriorating system subject to shocks in a semi-Markov operating environment.Qual Eng2020;32:286-97

[61] Arcieri G,Schwery O,Papakonstantinou KG.POMDP inference and robust solution via deep reinforcement learning: an application to railway optimal maintenance.Mach Learn2024;113:7967-95

[62] González-Prida V.A framework for warranty management in industrial assets.Comput Ind2012;63:960-71

[63] Zheng R,Gu L.Joint optimization of lot sizing and condition-based maintenance for a production system using the proportional hazards model.Comput Ind Eng2021;154:107157

[64] Luo Y,Liu B.Condition-based maintenance policy for systems under dynamic environment.Reliab Eng Syst Saf2024;246:110072

[65] Farahani A.Integrated optimization of quality and maintenance: a literature review.Comput Ind Eng2021;151:106924

[66] Van Horenbeek A, Buré J, Cattrysse D, Pintelon L, Vansteenwegen P. Joint maintenance and inventory optimization systems: A review.Int J Prod Econ2013;143:499-508

[67] Paraschos PD,Koulouriotis DE.Reinforcement learning for combined production-maintenance and quality control of a manufacturing system with deterioration failures.J Manuf Syst2020;56:470-83

[68] Zheng M,Wang D.Joint decisions of components replacement and spare parts ordering considering different supplied product quality.IEEE Trans Automat Sci Eng2024;21:1952-64

[69] Xu J,Liu B.A risk-aware maintenance model based on a constrained Markov decision process.IISE Trans2022;54:1072-83

[70] Ogunfowora O.Reinforcement and deep reinforcement learning-based solutions for machine maintenance planning, scheduling policies, and optimization.J Manuf Syst2023;70:244-63