Just-in-time construction progress management for slope engineering with unmanned aerial vehicle-based automated spatial analysis

Abstract

Effective progress monitoring is crucial for optimizing the management of construction projects, particularly in slope engineering, where timely and accurate tracking of progress can significantly enhance efficiency. Traditional methods of monitoring often rely on manual intervention, leading to delays, inaccuracies, and high labor costs. This paper presents a just-in-time approach for automatic construction progress tracking using unmanned aerial vehicle-based spatial analysis, which minimizes human input and maximizes real-time monitoring. The proposed framework integrates an innovative point cloud segmentation technique, a virtual multi-view point cloud dense reconstruction method, and a voxelization process to convert unordered point cloud data into structured, actionable information. We applied this framework to Huangmeishan Tunnel Expansion Project in China, processing large-volume data sets. The automatic segmentation method achieved an average model accuracy of 96.55% compared to manual segmentation. Additionally, the automatic excavation volume calculation showed a 97.50% accuracy. By converting point cloud surface models into solid models and organizing them into structured sequences, the framework facilitates rapid spatial information analysis and provides real-time insights into project progress, including quantity estimation, progress monitoring, and over-excavation/under-excavation analysis. This automated approach ensures timely and efficient monitoring, offering a robust solution for JIT progress tracking in slope engineering.

Graphical abstract

Keywords

construction progress / automatic progress tracking / just-in-time / reconstruction technology / point cloud voxelization

References

[1] Golparvar-Fard M , Peña-Mora F , Savarese S . Integrated sequential as-built and as-planned representation with D4AR tools in support of decision-making tasks in the AEC/FM industry. Journal of Construction Engineering and Management, 2011, 137(12): 1099–1116

[2] Alizadehsalehi S , Yitmen I . A concept for automated construction progress monitoring: Technologies adoption for benchmarking project performance control. Arabian Journal for Science and Engineering, 2019, 44(5): 4993–5008

[3] Sugimori Y , Kusunoki K , Cho F , Uchikawa S . Toyota production system and Kanban system materialization of just-in-time and respect-for-human system. The International Journal of Production Research, 1977, 15(6): 553–564

[4] Liao X , Xie Y , Tian S , Cai S. . Automated monitoring method for construction progress based on computer vision.. Journal of Chongqing University, 2022, 45(S1): 70–73

[5] Tang P , Huber D , Akinci B , Lipman R , Lytle A . Automatic reconstruction of as-built building information models from laser-scanned point clouds: A review of related techniques. Automation in construction, 2010, 19(7): 829–843

[6] Li Y , Shi M , Liu M . Research on intelligent safety system for construction sites based on cloud-BIM and UWB. China Safety Science Journal, 2018, 14(9): 151–157

[7] Tang T , Pan H . Application of GPS measurement technology in the preliminary engineering of underground comprehensive pipe gallery. Building Technology, 2019, 50(11): 1366–1367

[8] Wang Y , Yang Z , Song P . Application study of BIM+UAV technologies in building construction project. Journal of Information Technology in Civil Engineering and Architecture, 2023, 15(01): 68–71

[9] Lorenzo T M , Benedetta B , Manuele C , Davide T . BIM and QR-code. A synergic application in construction site management. Procedia engineering, 2014, 85: 520–528

[10] Braun A , Tuttas S , Borrmann A , Stilla U . Improving progress monitoring by fusing point clouds, semantic data and computer vision. Automation in Construction. Automation in Construction, 2020, 116(8): 103210

[11] Wei W , Lu Y , Zhong T , Li P , Liu B . Integrated vision-based automated progress monitoring of indoor construction using mask region-based convolutional neural networks and BIM. Automation in Construction, 2022, 140: 104327

[12] Radke R J , Andra S , Al-Kofahi O , Roysam B . Image change detection algorithms: A systematic survey. IEEE Transactions on Image Processing, 2005, 14(3): 294–307

[13] Golparvar-Fard M , Pena-Mora F , Savarese S . D4AR––A 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication. Journal of Information Technology in Construction, 2009, 14(13): 129–153

[14] Liu S. Building construction progress monitoring technology and method of integrating point cloud data and BIM. Thesis for the Master’s Degree. Chengdu: Southwest Jiaotong University, 2019 (in Chinese)

[15] Pučko Z , Šuman N , Rebolj D . Automated continuous construction progress monitoring using multiple workplace real time 3D scans. Advanced Engineering Informatics, 2018, 38: 27–40

[16] Qiao S. . Fine modeling and accuracy analysis based on UAV oblique photogrammetry.. Southern Agricultural Machinery, 2023, 54(3): 130–133

[17] Yan S , Lin D , Li S . Application of Iterative reconstruction technology based on UAV tilt photography in bank collapse monitoring. Journal of Chengdu Institute of Technology, 2023, 26(1): 34–39

[18] El-Omari S , Moselhi O . Integrating 3D laser scanning and photogrammetry for progress measurement of construction work. Automation in Construction, 2008, 18(1): 1–9

[19] Bügler M, Metzmacher H, Borrmann A. Integrating feedback from image based 3D reconstruction into models of excavation processes for efficient scheduling. In: Proceedings of the EG-ICE Workshop on Intelligent Computing in Engineering. Vienna: European Group for Intelligent Computing in Engineering, 2013

[20] Zbirovský S , Nežerka V . Open-source automatic pipeline for efficient conversion of large-scale point clouds to IFC format. Automation in Construction, 2025, 177: 106303

[21] Chen Z. From point cloud to as-built BIM: Automated detection of openings in existing buildings. In: Proceedings of 33 Forum Bauinformatik. Munich: Technical University of Munich, 2022

[22] Mahmoud M , Chen W , Yang Y , Li Y . Automated BIM generation for large-scale indoor complex environments based on deep learning. Automation in Construction, 2024, 162: 105376

[23] Wolff K, Kim C, Zimmer H. Point cloud noise and outlier removal for image-based 3D reconstruction. In: Proceedings of 2016 Fourth International Conference on 3D Vision (3DV). Stanford, CA: IEEE, 2016: 118–127

[24] Kok K Y , Rajendran P . A review on stereo vision algorithm: Challenges and solutions. ECTI Transactions on Computer and Information Technology, 2019, 13(2): 112–128

[25] Furukawa Y , Hernández C . Multi-view stereo: A tutorial. Foundations and Trends in Computer Graphics and Vision, 2015, 9(1–2): 1–148

[26] Triggs B, McLauchlan P F, Hartley R I, Fitzgibbon A W. Bundle adjustment—A modern synthesis. In: Proceedings of International Workshop on Vision Algorithms. Berlin: Springer Berlin Heidelberg, 1999: 298–372

[27] Hirschmuller H . Stereo processing by semiglobal matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(2): 328–341

[28] Argyriou V , Petrou M . Photometric stereo: An overview. Advances in Imaging and Electron Physics, 2009, 156: 1–54

[29] Feng L , Soon S H . An effective 3D seed fill algorithm. Computers & Graphics, 1998, 22(5): 641–644

[30] Zhang W , Qi J , Wan P . An easy-to-use airborne LiDAR data filtering method based on cloth simulation. Remote sensing, 2016, 8(6): 501

[31] Tong ZChen YXu ZYu R. Wise-IoU: Bounding box regression loss with dynamic focusing mechanism. 2023. arXiv:2301.10051

[32] Stone W C , Cheok G , Lipman R . Automated earthmoving status determination. Robotics, 2000, 111–119

[33] Beckman G H , Polyzois D , Cha Y J . Deep learning-based automatic volumetric damage quantification using depth camera. Automation in Construction, 2019, 99: 114–124

[34] Limmer M, Forster J, Baudach D, Schüle F, Schweiger R, Lensch H P A. Robust deep-learning-based road-prediction for augmented reality navigation systems at night. In: Proceedings of 2016 IEEE 19th international conference on intelligent transportation systems (ITSC). Brazil: IEEE, 2016: 1888–1895

[35] Hahner M, Dai D, Sakaridis C, Zaech J N, Gool L V. Semantic understanding of foggy scenes with purely synthetic data. In: Proceedings of 2019 IEEE Intelligent Transportation Systems Conference (ITSC). Auckland: IEEE, 2019: 3675–3681

[36] Golparvar-Fard M , Peña-Mora F , Arboleda C A , Lee S . Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs. Journal of Computing in Civil Engineering, 2009, 23(6): 391–404

[37] Porav H, Bruls T, Newman P. I can see clearly now: Image restoration via de-raining. In: Proceedings of 2019 International Conference on Robotics and Automation (ICRA). Montreal: IEEE, 2019: 7087–7093

[38] Golparvar-Fard M , Pena-Mora F , Savarese S . Automated progress monitoring using unordered daily construction photographs and IFC-based building information models. Journal of Computing in Civil Engineering, 2015, 29(1): 04014025

RIGHTS & PERMISSIONS

The Author(s). This article is published with open access at link.springer.com and journal.hep.com.cn