Beyond digital shadows: A Digital Twin for monitoring earthwork operation in large infrastructure projects

Abstract

Current research on Digital Twin (DT) is largely focused on the performance of built assets in their operational phases as well as on urban environment. However, Digital Twin has not been given enough attention to construction phases, for which this paper proposes a Digital Twin framework for the construction phase, develops a DT prototype and tests it for the use case of measuring the productivity and monitoring of earthwork operation. The DT framework and its prototype are underpinned by the principles of versatility, scalability, usability and automation to enable the DT to fulfil the requirements of large-sized earthwork projects and the dynamic nature of their operation. Cloud computing and dashboard visualisation were deployed to enable automated and repeatable data pipelines and data analytics at scale and to provide insights in near-real time. The testing of the DT prototype in a motorway project in the Northeast of England successfully demonstrated its ability to produce key insights by using the following approaches: (i) To predict equipment utilisation ratios and productivities; (ii) To detect the percentage of time spent on different tasks (i.e., loading, hauling, dumping, returning or idling), the distance travelled by equipment over time and the speed distribution; and (iii) To visualise certain earthwork operations.

Keywords

Machine learning / Digital Twin / Earthwork / Data analytics / Data pipeline

References

[1] Ahn, C. R., Lee, S. & Peña-Mora, F. (2012). Monitoring system for operational efficiency and environmental performance of construction operations using vibration signal analysis. In Construction Research Congress 2012: Construction challenges in a flat world (pp. 1879–1888). https://doi.org/10.1061/9780784412329.189.

[2] AhnCR, LeeS, Peña-MoraF. Acceleromter-based measurement of construction equipment operating efficiency for monitoring environmental performance. Computing in Civil Engineering, 2013, 2013: 565-572

[3] Akhavian, R. & Behzadan, A. H. (2012). Remote monitoring of dynamic construction processes using automated equipment tracking. In Construction Research Congress 2012: Construction challenges in a flat world (pp. 1360–1369). https://doi.org/10.1061/9780784412329.137.

[4] AkhavianR, BehzadanAH. Construction equipment activity recognition for simulation input modeling using mobile sensors and machine learning classifiers. Advanced Engineering Informatics, 2015, 29: 867-877

[5] Al-Sehrawy, R. & Kumar, B. (2020). Digital twins in architecture, engineering, construction and operations. A brief review and analysis. In International conference on computing in civil and building engineering (pp. 924–939). Springer. https://doi.org/10.1007/978-3-030-51295-8_64.

[6] BelloSA, OyedeleLO, AkinadeOO, BilalM, DelgadoJMD, AkanbiLA, AjayiAO, OwolabiHA. Cloud computing in construction industry: Use cases, benefits and challenges. Automation in Construction, 2020

[7] BüglerM, BorrmannA, OgunmakinG, VelaPA, TeizerJ. Fusion of photogrammetry and video analysis for productivity assessment of earthwork processes. Computer-Aided Civil and Infrastructure Engineering, 2017, 32: 107-123

[8] ChenC, ZhuZ, HammadA. Automated excavators activity recognition and productivity analysis from construction site surveillance videos. Automation in Construction, 2020, 110: 103045

[9] ChengC-F, RashidiA, DavenportMA, AndersonDV. Evaluation of software and hardware settings for audio-based analysis of construction operations. International Journal of Civil Engineering, 2019, 17: 1469-1480

[10] Douglas, D., Kelly, G. & Kassem, M. (2021). BIM, Digital Twin and Cyber-Physical Systems: Crossing and blurring boundaries. arXiv preprint arXiv:2106.11030. https://doi.org/10.48550/arXiv.2106.11030.

[11] GeewaxJJJ. Google Cloud platform in action, 2018 Simon and Schuster

[12] GiustiC, CarlsenJ, WatsonK. The control of dust and emissions during construction and demolition, 2014 Greater London Authority

[13] Google. (2021a). BigQuery. Retrieved 2021a from https://cloud.google.com/bigquery.

[14] Google. (2021b). Visualizing BigQuery data using Data Studio. Retrieved 2021b from https://cloud.google.com/bigquery/docs/visualize-data-studio.

[15] GreifT, SteinN, FlathCM. Peeking into the void: Digital twins for construction site logistics. Computers in Industry, 2020, 121: 103264

[16] HongB, LüL. Assessment of emissions and energy consumption for construction machinery in earthwork activities by incorporating real-world measurement and discrete-event simulation. Sustainability, 2022, 14: 5326

[17] JagushteV. Usability review of telematics for construction equipment fleet management, 2017 University of Florida

[18] Kassem, M., Rogage, K., Huntingdon, J., Durojaye, G., Arena, N., Kelly, G., Lund, T. & Clarne, T. (2019). Measuring and improving the productivity of construction’s site equipment fleet: an integrated IoT and BIM system. In 36th CIB W78 2019 Conference Advances in ICT Design, Construction & Management in Architecture, Engineering, Construction and Operations (AECO) (pp. 901–911). Retrieved from http://itc.scix.net/paper/w78-2019-paper-085.

[19] KassemM, MahamediE, RogageK, DuffyK, HuntingdonJ. Measuring and benchmarking the productivity of excavators in infrastructure projects: A deep neural network approach. Automation in Construction, 2021, 124: 103532

[20] KimB, LeeH, ParkH, KimH. Greenhouse gas emissions from onsite equipment usage in road construction. Journal of Construction Engineering and Management, 2012, 138: 982-990

[21] KimH, AhnCR, EngelhauptD, LeeS. Application of dynamic time warping to the recognition of mixed equipment activities in cycle time measurement. Automation in Construction, 2018, 87: 225-234

[22] KimH, HamY, KimW, ParkS, KimH. Vision-based nonintrusive context documentation for earthmoving productivity simulation. Automation in Construction, 2019, 102: 135-147

[23] LiY, RazavialaviS, AbourizkS. Data-driven simulation approach for short-term planning of winter highway maintenance operations. Journal of Computing in Civil Engineering, 2021, 35: 04021013

[24] Mahamedi, E., Rogage, K., Doukari, O. & Kassem, M. (2021a). Automating equipment productivity measurement using deep learning. Retrieved from https://ec-3.org/publications/conference2021a/papers/Contribution_153_final.pdf.

[25] MahamediE, RogageK, DoukariO, KassemM. Automating excavator productivity measurement using deep learning. Proceedings of the Institution of Civil Engineers-Smart Infrastructure and Construction, 2022, 40: 1-13

[26] Mahamedi, E., Rogage, K. & Kassem, M. (2021b). A data-driven approach for monitoring performance of equipment in construction earthwork using IoT and Cloud computing, CIB World Building Congress, 27–30 June 2022, Melbourne, Australia.

[27] Mapbox. (2022). Maps and locations for developers. Retrieved from https://www.mapbox.com/.

[28] MatthewsJ, LovePE, PorterSR, FangW. Smart data and business analytics: A theoretical framework for managing rework risks in mega-projects. International Journal of Information Management, 2022, 65: 102495

[29] MoiT, CibicikA, RølvågT. Digital twin based condition monitoring of a knuckle boom crane: An experimental study. Engineering Failure Analysis, 2020, 112: 104517

[30] Montaser, A. & Moselhi, O. (2012). RFID+ for tracking earthmoving operations. In Construction Research Congress 2012: Construction challenges in a flat world (pp. 1011–1020). https://doi.org/10.1061/9780784412329.102.

[31] MontaserA, MoselhiO. Truck+ for earthmoving operations. Journal of Information Technology in Construction (ITcon), 2014, 19: 412-433

[32] Munappy, A. R., Bosch, J. & Olsson, H. H. (2020). Data pipeline management in practice: Challenges and opportunities. In International Conference on Product-Focused Software Process Improvement (pp. 168–184). Springer. https://doi.org/10.1007/978-3-030-64148-1_11.

[33] OkSC, SinhaSK. Construction equipment productivity estimation using artificial neural network model. Construction Management and Economics, 2006, 24: 1029-1044

[34] OpokuD-GJ, PereraS, Osei-KyeiR, RashidiM. Digital twin application in the construction industry: A literature review. Journal of Building Engineering, 2021, 40

[35] SaidH, NicolettiT, Perez-HernandezP. Utilizing telematics data to support effective equipment fleet-management decisions: Utilization rate and hazard functions. Journal of Computing in Civil Engineering, 2016, 30: 04014122

[36] SalemA, MoselhiO. AI-based cloud computing application for smart earthmoving operations. Canadian Journal of Civil Engineering, 2021, 48: 312-327

[37] Sartori, D., Catalano, G., Genco, M., Pancotti, C., Sirtori, E., Vignetti, S. & Del Bo, C. (2014). Guide to cost-benefit analysis of investment projects. Economic appraisal tool for Cohesion Policy, 2020.

[38] The Linux Foundation. (2022). OpenAPI initiative. Retrieved March 11, 2022 from https://www.openapis.org/.

[39] Tibco. (2022). What is prescriptive analytics?. Retrieved 2022 from https://www.tibco.com/reference-center/what-is-prescriptive-analytics.

[40] WuY, WangM, LiuX, WangZ, MaT, LuZ, LiuD, XieY, LiX, WangX. Monitoring the work cycles of earthmoving excavators in earthmoving projects using UAV remote sensing. Remote Sensing, 2021, 13: 3853

[41] ZhidchenkoV, HandroosH, KovartsevA. Application of digital twin and IoT concepts for solving the tasks of hydraulically actuated heavy equipment lifecycle management. International Journal of Engineering Systems Modelling and Simulation, 2020, 11: 194-206

[42] ZhidchenkoV, MalyshevaI, HandroosH, KovartsevA. Faster than real-time simulation of mobile crane dynamics using digital twin concept. Journal of Physics: Conference Series, 2018

[43] ZhongD, LvH, HanJ, WeiQ. A practical application combining wireless sensor networks and internet of things: Safety management system for tower crane groups. Sensors, 2014, 14: 13794-13814

Funding

Innovate UK(44584)