Evaluating data-driven algorithms for predicting mechanical properties with small datasets: A case study on gear steel hardenability

Abstract

Data-driven algorithms for predicting mechanical properties with small datasets are evaluated in a case study on gear steel hardenability. The limitations of current data-driven algorithms and empirical models are identified. Challenges in analysing small datasets are discussed, and solution is proposed to handle small datasets with multiple variables. Gaussian methods in combination with novel predictive algorithms are utilized to overcome the challenges in analysing gear steel hardenability data and to gain insight into alloying elements interaction and structure homogeneity. The gained fundamental knowledge integrated with machine learning is shown to be superior to the empirical equations in predicting hardenability. Metallurgical-property relationships between chemistry, sample size, and hardness are predicted via two optimized machine learning algorithms: neural networks (NNs) and extreme gradient boosting (XGboost). A comparison is drawn between all algorithms, evaluating their performance based on small data sets. The results reveal that XGboost has the highest potential for predicting hardenability using small datasets with class imbalance and large inhomogeneity issues.

Keywords

machine learning / small dataset / XGboost / hardenability / gear steel

References

[1] Vctor Li M, Niebuhr DV, Meekisho LL, Atteridge DG. A computational model for the prediction of steel hardenability. Metall. Mater. Trans. B, 1998, 29(3): 661.

[2] V. Javaheri, A. Pohjonen, J.I. Asperheim, D. Ivanov, and D. Porter, Physically based modeling, characterization and design of an induction hardening process for a new slurry pipeline steel, Mater. Des., 182(2019), art. No. 108047.

[3] O’ Brien ECHC, Yeddu HK. Multi-length scale modeling of carburization, martensitic microstructure evolution and fatigue properties of steel gears. J. Mater. Sci. Technol., 2020, 49, 157.

[4] P.H. Maynier, J. Dollet, and P. Bastien. Prediction of micro-structure via empirical formulas based on CCT diagrams, [in] The 107th AIME Annual Meeting, Denver, Colorado, 1978, p. 163.

[5] Khan D, Gautham B. Integrated modeling of carburizing-quenching-tempering of steel gears for an ICME framework. Integr. Mater. Manuf. Innovation, 2018, 7(1): 28.

[6] Feng S, Zhou HY, Dong HB. Using deep neural network with small dataset to predict material defects. Mater. Des., 2019, 162, 300.

[7] Shen CG, Wang CC, Wei XL, Li Y, van der Zwaag S, Xu W. Physical metallurgy-guided machine learning and artificial intelligent design of ultrahigh-strength stainless steel. Acta Mater., 2019, 179, 201.

[8] F.E. Bock, R.C. Aydin, C.J. Cyron, N. Huber, S.R. Kalidindi, and B. Klusemann, A review of the application of machine learning and data mining approaches in continuum materials mechanics, Front. Mater., 6(2019), art. No. 00110.

[9] Bhadeshia HKDH. Neural networks in materials science. ISIJ Int., 1999, 39(10): 966.

[10] Wu SW, Yang J, Cao GM. Prediction of the Charpy Vnotch impact energy of low carbon steel using a shallow neural network and deep learning. Int. J. Miner. Metall. Mater., 2021, 28(8): 1309.

[11] Deng ZH, Yin HQ, Jiang X, Zhang C, Zhang GF, Xu B, Yang GQ, Zhang T, Wu M, Qu XH. Machine-learning-assisted prediction of the mechanical properties of Cu-Al alloy. Int. J. Miner. Metall. Mater., 2020, 27(3): 362.

[12] Friedman J, Hastie T, Tibshirani R. Additive logistic regression: A statistical view of boosting (With discussion and a rejoinder by the authors). Ann. Stat., 2000, 28(2): 337.

[13] T.Q. Chen and C. Guestrin, XGBoost: A scalable tree boosting system [in] Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco, 2016, p.785

[14] J. Bennett and S. Lanning, The Netflix prize, [in] Proceedings of KDD Cup and Workshop 2007, San Jose, 2007.

[15] K. Song, F. Yan, T. Ding, L. Gao, and S.B. Lu, A steel property optimization model based on the XGBoost algorithm and improved PSO, Comput. Mater. Sci., 174(2020), art. No. 109472.

[16] E.T. Akinlabi1, O.M. Ikumapayi, O.P. Bodunde, B.A. Adaramola, I.D. Uchegbu, and S.O. Fatoba, Impact of quenching on the hardenability of steels EN-3 (∼1015), EN-8 (∼1040) and EN-24 (∼4340) during Jominy end quench technique. Int. J. Emerging Technol. 11(2020), No. 5, p. 290.

[17] F. Wetschoreck, T. Krabel, and S. Krishnamurthy, 8080labs/Ppscore: Zenodo Release [2020-10-15]. DOI: https://doi.org/10.5281/zenodo.4091345

[18] Waltz RA, Morales JL, Nocedal J, Orban D. An interior algorithm for nonlinear optimization that combines line search and trust region steps. Math. Program., 2006, 107(3): 391.

[19] Schüler P. Calculation of hardenability in the Jominy end quench test on the basis of the Chemical composition of steel. Revue de Métallurgie, 1992, 89(1): 93.

[20] F. Burden and D. Winkler, Bayesian regularization of neural networks, [in] D.J. Livingstone ed, Artificial Neural Networks, Methods in Molecular Biology™, Humana Press, 458(2008), p. 23.

[21] S. Feng, H.Y. Zhou, and H.B. Dong, Application of deep transfer learning to predicting crystal structures of inorganic substances, Comput. Mater. Sci., 195(2021), art. No. 110476.