A step-by-step tutorial on machine learning for engineers unfamiliar with programming

Abstract

Machine learning (ML) has garnered significant attention within the engineering domain. However, engineers without formal ML education or programming expertise may encounter difficulties when attempting to integrate ML into their work processes. This study aims to address this challenge by offering a tutorial that guides readers through the construction of ML models using Python. We introduce three simple datasets and illustrate how to preprocess the data for regression, classification, and clustering tasks. Subsequently, we navigate readers through the model development process utilizing well-established libraries such as NumPy, pandas, scikit-learn, and matplotlib. Each step, including data preparation, model training, validation, and result visualization, is covered with detailed explanations. Furthermore, we explore explainability techniques to help engineers understand the underlying behavior of their models. By the end of this tutorial, readers will have hands-on experience with three fundamental ML tasks and understand how to evaluate and explain the developed models to make engineering projects efficient and transparent.

Keywords

Machine learning / Engineering / Tutorial / Python

References

[1] al-BashitiMK, NaserMZ. Verifying domain knowledge and theories on Fire-induced spalling of concrete through eXplainable artificial intelligence. Construction and Building Materials, 2022, 348: 128648.

[2] Ben ChaabeneW, FlahM, NehdiML. Machine learning prediction of mechanical properties of concrete: Critical review. Construction and Building Materials, 2020.

[3] BishopC. Pattern recognition and machine learning. Technometrics, 2007.

[4] Frank I, Todeschini R. (1994). The data analysis handbook. Retrieved June 21, 2019, from https://books.google.com/books?hl=en&lr=&id=SXEpB0H6L3YC&oi=fnd&pg=PP1&ots=zfmIRO_XO5&sig=dSX6KJdkuav5zRNxaUdcftGSn2k

[5] Goodfellow I, Benigo Y, Courville A. (2016). Deep Learning (Adaptive Computation and Machine Learning series): Ian Goodfellow, Yoshua Bengio, Aaron Courville: 9780262035613: Amazon.com: Books, MIT Press.

[6] Hastie T, Tibshirani R, Friedman JH, MyiLibrary. (2001). The elements of statistical learning data mining, inference, and prediction : with 200 full-color illustrations, Springer Series in Statistics.

[7] KarniadakisGE, KevrekidisIG, LuL, PerdikarisP, WangS, YangL. Physics-informed machine learning. Nature Reviews Physics, 2021.

[8] Lundberg SM. Lee SI. (2017). A unified approach to interpreting model predictions, in: Adv. Neural Inf. Process. Syst.

[9] MaleklooA, OzerE, AlHamaydehM, GirolamiM. Machine learning and structural health monitoring overview with emerging technology and high-dimensional data source highlights. Structural Health Monitoring, 2022.

[10] MolnarC, CasalicchioG, BischlB. Interpretable machine learning—A brief history, state-of-the-art and challenges, communications in computer and information. Science, 2020, 1323: 417-431.

[11] NaserMZ. Can past failures help identify vulnerable bridges to extreme events? A biomimetical machine learning approach. Engineering with Computers, 2019.

[12] NaserMZMachine learning for civil and environmental engineers: a practical approach to data-driven analysis, explainability, and causality, 2023Wiley

[13] Nguyen-SyT, WakimJ, ToQD, VuMN, NguyenTD, NguyenTT. Predicting the compressive strength of concrete from its compositions and age using the extreme gradient boosting method. Construction and Building Materials, 2020, 260: 119757.

[14] Pine DJ. (2019). Introduction to Python for Science and Engineering. https://doi.org/10.1201/9780429506413

[15] Ribeiro MT, Singh S, Guestrin C. (2016). Why should i trust you? Explaining the predictions of any classifier, in: Proc ACM SIGKDD Int. Conf. Knowl. Discov. Data Min. https://doi.org/10.1145/2939672.2939778.

[16] RileyRD, SnellKIE, EnsorJ, BurkeDL, HarrellFE, MoonsKGM, CollinsGS. Minimum sample size for developing a multivariable prediction model: PART II—binary and time-to-event outcomes. Statistics in Medicine, 2019.

[17] TapehA, NaserMZ. Artificial Intelligence, machine learning, and deep learning in structural engineering: a scientometrics review of trends and best practices. Archives of Computational Methods in Engineering, 2022.

[18] ThaiH-TT. Machine learning for structural engineering: A state-of-the-art review. Elsevier, 2022.

[19] van SmedenM, MoonsKG, de GrootJA, CollinsGS, AltmanDG, EijkemansMJ, ReitsmaJB. Sample size for binary logistic prediction models: beyond events per variable criteria. Statistical Methods in Medical Research, 2018, 28: 2455-2474.

[20] XieQ, SuvarnaM, LiJ, ZhuX, CaiJ, WangX. Online prediction of mechanical properties of hot rolled steel plate using machine learning. Materials and Design, 2021.

[21] YouK, ZhouC, DingL. Deep learning technology for construction machinery and robotics. Automation in Construction, 2023.

[22] Yuan F-G, Zargar SA, Chen Q, Wang S. (2020). Machine learning for structural health monitoring: challenges and opportunities. https://doi.org/10.1117/12.2561610.

[23] ZarringolM, ThaiHT. Prediction of the load-shortening curve of CFST columns using ANN-based models. Journal of Building Engineering, 2022.

RIGHTS & PERMISSIONS

The Author(s)