Automated extraction of expressway road surface from mobile laser scanning data

Abstract

This paper presents a voxel-based region growing method for automatic road surface extraction from mobile laser scanning point clouds in an expressway environment. The proposed method has three major steps: constructing a voxel model; extracting the road surface points by employing the voxel-based segmentation algorithm; refining the road boundary using the curb-based segmentation algorithm. To evaluate the accuracy of the proposed method, the two-point cloud datasets of two typical test sites in an expressway environment consisting of flat and bumpy surfaces with a high slope were used. The proposed algorithm extracted the road surface successfully with high accuracy. There was an average recall of 99.5%, the precision was 96.3%, and the F1 score was 97.9%. From the extracted road surface, a framework for the estimation of road roughness was proposed. Good agreement was achieved when comparing the results of the road roughness map with the visual image, indicating the feasibility and effectiveness of the proposed framework.

Keywords

mobile laser scanning / segmentation / road surface / expressway / voxelization / point cloud

References

[1] GuanH, LiJ, YuY, ChapmanM, WangC. Automated road information extraction from mobile laser scanning data [J]. IEEE Transactions on Intelligent Transportation Systems, 2015, 16(1): 194-205

[2] DAVIES R B, CENEK P D, HENDERSON R J. The effect of skid resistance and texture on crash risk [C]// International Conference on Surface Friction-Roads and Runways. Christchurch, New Zealand, 2005.

[3] YadavM, SinghA K, LohaniB. Extraction of road surface from mobile lidar data of complex road environment [J]. International Journal of Remote Sensing, 2017, 38(16): 4655-4682

[4] SoilánM, TruongH L, RiveiroB, LaeferD. Automatic extraction of road features in urban environments using dense ALS data [J]. International Journal of Applied Earth Observation and Geoinformation, 2018, 64: 226-236

[5] AlshehhiR, MarpuP R. Hierarchical graph-based segmentation for extracting road networks from high-resolution satellite images [J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 126: 245-260

[6] BaladoJ, Díaz-VilariñoL, AriasP, GonzáLezjorgeH. Automatic classification of urban ground elements from mobile laser scanning data [J]. Automation in Construction, 2018, 86: 226-239

[7] MaL, LiY, LiJ, WangC, WangR, ChapmanM A. Mobile laser scanned point-clouds for road object detection and extraction: A Review [J]. Remote Sensing, 2018, 10(10): 1531

[8] ChenD-L, HeX-F. Fast automatic three-dimensional road model reconstruction based on mobile laser scanning system [J]. Optik, 2015, 126: 725-730

[9] AkagulM, YurtsevenH, AkburakS, DemirM, CigizogluH K, OzturkT, EksiM, AkayA O. Short term monitoring of forest road pavement degradation using terrestrial laser scanning [J]. Measurement, 2017, 103283-293

[10] YangMM, WanY C, LiuX L, XuJ Z, WeiZ Y, ChenM L, ShengP. Laser data based automatic recognition and maintenance of road markings from MLS system [J]. Optics & Laser Technology, 2018, 107: 192-203

[11] YAO L, CHEN Q, QIN C, WU H, ZHANG S. Automatic extraction of road markings from mobile laser-point cloud using intensity data [C]// International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Beijing, China, 2018: 2113–2119.

[12] GuanH, YanW, YuY, ZhongL, LiD. Robust traffic-sign detection and classification using mobile Lidar data with digital images [J]. IEEE Journal of Selected Topics in Applied Earth Observation and Remote Sensing, 2018, 11(5): 1715-1724

[13] GEHRUNG J, HEBEL M, ARENS M, STILLA U. An approach to extract moving objects from MLS data using a volumetric background representation [C]// ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Hannover, Germany, 2017. DOI: https://doi.org/10.5194/isprs-annals-IV-1-W1-107-2017.

[14] YadavM, SinghA K. Rural road surface extraction using mobile LiDAR point cloud data [J]. Journal of the Indian Society of Remote Sensing, 2018, 46(4): 531-538

[15] YangB, LiuY, DongZ, LiangF, LiB, PengX. 3D local feature BKD to extract road information from mobile laser scanning point clouds [J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 130: 329-343

[16] ZaiD W, LiJ, GuoY L, ChengM, LinY B, LuoH, WangC. 3-D road boundary extraction from mobile laser scanning data via supervoxels and graph cuts [J]. IEEE Transactions on Intelligent Transportation Systems, 2018, 19(3): 802-813

[17] XuS, WangR, ZhengH. Road curb extraction from mobile LiDAR point clouds [J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, 55(2): 996-1009

[18] KumarP, LewisP, MccarthyT. The potential of active contour models in extracting road edges from mobile laser scanning data [J]. Infrastructures, 2017, 2(3): 9

[19] NeupaneS R, GharaibehN G. A heuristic-based method for obtaining road surface type information from mobile lidar for use in network-level infrastructure management [J]. Measurement, 2019, 131: 664-670

[20] Holgado-BarcoA, RiveiroB, GonzálezaguileraD, AriasP. Automatic inventory of road cross-sections from mobile laser scanning system [J]. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(1): 3-17

[21] ChengM, ZhangH, WangC, LiJ. Extraction and classification of road markings using mobile laser scanning point clouds [J]. IEEE Journal of Selected Topics in Applied Earth Observation and Remote Sensing, 2017, 10(3): 1182-1196

[22] LiF, ElberinkS O, VosselmanG. Pole-like road furniture detection and decomposition in mobile laser scanning data based on spatial relations [J]. Remote Sensing, 2018, 10(4): 531

[23] LiY, WangW X, TangS J, LiD L, WangY K, YuanZ L, GuoR Z, LiX M, XiuW Q. Localization and extraction of road poles in urban areas from mobile laser scanning data [J]. Remote Sensing, 2019, 114401

[24] ChenS, Truong-HongL, LaeferD F, ManginaE. Automated bridge deck evaluation through UAV derived point cloud [C]// CERI2018 Congress. The 2018 Civil Engineering Research in Ireland Conference, 2018, Dublin, CERAI, 735-740

[25] KarilaK, MatikainenL, PuttonenE, HyyppäJ. Feasibility of multispectral airborne laser scanning data for road mapping [J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(3): 294-298

[26] MatikainenL, KarilaK, HyyppäJ, LitkeyP, PuttonenE, AhokasE. Object-based analysis of multispectral airborne laser scanner data for land cover classification and map updating [J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2017, 128298-313

[27] MCELHINNEY C, KUMAR P, CAHALANE C, MCCARTHY T. Initial results from european road safety inspection (EURSI) mobile mapping project [C]// International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Newcastle, UK, 2010.

[28] ZHANG W. Lidar based road and road-edge detection [C]// Proceedings of IEEE Intelligent Vehicles Symposium. San Diego, USA, 2010. DOI: https://doi.org/10.1109/IVS.2010.5548134.

[29] IBRAHIM S, LICHTI D. Curb-based street floor extraction from mobile terrestrial lidar point cloud [C]// International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. Melbourne, Australia, 2012. DOI: https://doi.org/10.5194/isprsarchives-XXXIX-B5-193-2012.

[30] YangB, FangL, LiJ. Semi-automated extraction and delineation of 3d roads of street scene from mobile laser scanning point clouds [J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2013, 79: 80-93

[31] WangH Y, LuoH, WenC L, ChengJ, LiP, ChenY P, WangC, LiJ. Road boundary detection based on local normal saliency from mobile laser scanning data [J]. IEEE Geoscience and Remote Sensing Letters, 2015, 12(10): 2085-2089

[32] CaboC, KukkoA, García-CortésS, KaartinenH, HyyppäJ, OrdoñezC. An algorithm for automatic road asphalt edge delineation from mobile laser scanner data using the line clouds concept [J]. Remote Sensing, 2016, 8(9): 1-20

[33] MIYAZAKI R, YAMAMOTO M, HANAMOTO E, IZUMI H, HARADA K. A line-based approach for precise extraction of road and curb region from mobile mapping data [C]// ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences. Rivar del Garda, Italy, 2014. DOI: https://doi.org/10.5194/isprsannals-II-5-243-2014.

[34] WuB, YuB, HuangC, WuQ, WuJ. Automated extraction of ground surface along urban roads from mobile laser scanning point clouds [J]. Remote Sensing Letters, 2016, 7(2): 170-179

[35] RusuR B, MartonZ C, BlodowN, DolhaM, BeetzM. Towards 3D point cloud based object maps for household environments [J]. Robotics and Autonomous System, 2008, 56(11): 927-941

[36] CloudCompare. GNU general public license, Version 2.10. [EB/OL]. http://www.cloudcompare.org/.

[37] AyalaD, BrunetP, JuanR, NavazoI. Object representation by means of nominal division quadtrees and octrees [J]. ACM Transactions on Graphics, 1985, 4(1): 41-59

[38] WANG J, OLIVEIRA M M, XIE H, KAUFMAN A E. Surface reconstruction using oriented charges [C]// Proceeding of Computer Graphics. Stony Brook, NY, USA, 2005. DOI: https://doi.org/10.1109/CGI.2005.1500390.

[39] PULLI K, DUCHAMP T, HOPPE H, MCDONALD J, SHAPIRO L, STUETZLE W. Robust meshes from multiple range maps [C]// International Conference on Recent Advances in 3-D Digital Imaging and Modeling. Ottawa, Ontario, Canada, 1997. DOI: https://doi.org/10.1109/IM.1997.603867.

[40] HOPPE H, DEROSE T, DUCHAMP T, MCDONALD J, STUETZLE W. Surface reconstruction from unorganized points [C]// Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 1992. DOI: https://doi.org/10.1145/142920.134011.

[41] VoA V, HongL T, LaeferD F, BertolottoM. Octree-based region growing for point cloud segmentation [J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2015, 104: 88-100

[42] ArmestoJ, PardiñasR J, LorenzoH, AriasP. Modelling masonry arches shape using terrestrial laser scanning data and nonparametric methods [J]. Engineering Structures, 2010, 32(2): 607-615

[43] JRA-Japan Road Association. Manual for asphalt pavement [M]. Tokyo, Japan, 1989.

[44] FariasM M, SouzaR O. Correlations and analyses of longitudinal roughness indices [J]. Road Materials and Pavement Design, 2009, 10(2): 399-415

[45] DIAZ J C F, JUDGE J, SLATTON K C, SHRESTHA R, CARTER W E, BLOOMQUIST D. Characterization of full surface roughness in agricultural soils using ground based LiDAR [C]// Proceeding of IEEE International Geoscience and Remote Sensing Symposium (IGARSS). Honolulu, Hawaii, USA, 2010. DOI: https://doi.org/10.1109/IGARSS.2010.5652056.

[46] ZHANG A M, RUSSELL R A. Surface roughness measurement for outdoor mobile robotic applications [C]// Proceedings of Australasian Conference on Robotics and Automation. Canberra, Australia, 2004.

[47] YEN K S, AKIN K, LOFTON A, RAVANI B, LASKY T A. Using mobile laser scanning to produce digital terrain models of pavement surfaces [R]. California Department of Trans Portation: CA10–1113. http://ahmct.ucdavis.edu/pdf/UCD-ARR-10-11-30-01.pdf.

[48] PATTNAIK S B, HALLMARK S, SOULEYRETTE R. Collecting road inventory using LIDAR surface models [C]// Proceedings of Map India Conference. New Delhi, India, 2003.

[49] ZHANG K, FREY H C. Road grade estimation for on-road vehicle emissions modeling using LIDAR data [C]// Proceedings of Air & Waste Management Association Annual Meeting. Minneapolis, USA, 2005. DOI: https://doi.org/10.1080/10473289.2006.10464500.

[50] AlhasanA, WhiteD J, BrabanterK D. Spatial pavement roughness from stationary laser scanning [J]. International Journal of Pavement Engineering, 2017, 18(1): 83-96

[51] SametH. The quadtree and related hierarchical data tructures [J]. ACM Computer Surveys, 1984, 16(2): 187-260

[52] KumarP, LewisP, McelhinneyC P, RahmanA A. An algorithm for automated estimation of road roughness from mobile laser scanning data [J]. Photogrammetric Record, 2015, 30(149): 30-45

[53] MLS GT-4. Mobile mapping system GT-4 [EB/OL]. [2019-10-01]. https://www.aeroasahi.co.jp/english/equipment/detail.php?id=21.

[54] RIEGL VQ-450. High speed 2D laser scanner with online waveform processing [EB/OL]. [2019-05-24]. http://www.riegl.com/uploads/tx_pxpriegldownloads/10_DataSheet_VQ-450_rund_2014-09-02.pdf (accessed on 24 May 2019).

[55] EXAT-Expressway and Rapid Transit Authority of Thailand. Expressway inspection manual and maintenance procedure [M]. Bangkok, Thailand, 2006.

[56] Truong-HongL, LaeferD F. Quantitative evaluation strategies for urban 3D model generation from remote sensing data [J]. Computer & Graphics, 2015, 49: 82-91

[57] The MathWorks. MATLAB function reference [M]. The Mathwork, 2007.