Gravel coverage rate measurement in synchronous chip seal based on deep convolutional neural network

Abstract

Synchronous chip seal is an advanced road constructing technology, and the gravel coverage rate is an important indicator of the construction quality. In this paper, a novel approach for gravel coverage rate measurement is proposed based on deep learning. Convolutional neural network (CNN) is used to segment the image of ground covered with gravels, and the gravel coverage rate is computed by the percentage of gravel pixels in the segmented image. The gravel coverage rate dataset for model training and testing is built. The performance of fully convolutional neural network (FCN) and U-Net model in the dataset is tested. A better model named GravelNet is constructed based on U-Net. The scaled exponential linear unit (SELU) is employed in the GravelNet to replace the popular combination of rectified linear unit (ReLU) and batch normalization (BN). Data augmentation and alpha dropout are performed to reduce overfitting. The experimental results demonstrate the effectiveness and accuracy of our proposed method. Our trained GravelNet achieves the mean gravel coverage rate error of 0.35% on test dataset.

References

[1] TempleW., ShahS., PaulH., AbadieC.. Transportation Research Record: Journal of the Transportation Research Board, 2002, 1795: 3

[2] GransbergD.. Transportation Research Record: Journal of the Transportation Research Board, 2005, 1933: 72

[3] GransbergD. D., KaracaI., BurkettW. R.. International Journal of Pavement Engineering, 2002, 3: 197

[4] PidwerbeskyB. D., WatersJ. C., GransbergD. D., StemprokR.. Land Transport New Zealand Research Report, 2006, 290: 65

[5] XuG., MaJ., LiuF., NiuX.. Automatic recognition of pavement surface crack based on BP neural network, International Conference on Computer and Electrical Engineering, 2008,

[6] WangZ., YanF., YaoJ.. Electronic Design Engineering, 2013, 21: 191

[7] WangZ., JiaM., HouZ., ChenZ.. Journal of Zhengzhou University (Engineering Science), 2015, 36: 80

[8] KrizhevskyA., SutskeverI., HintonG. E.. Advances in Neural Information Processing Systems, 2012, 25: 1097

[9] SimonyanK., ZissermanA.. Very Deep Convolutional Networks for Large–scale Image Recognition, International Conference on Learning Representations, 2015,

[10] SzegedyC., LiuW., JiaY., SermanetP., ReedS., AnguelovD., ErhanD., VanhouckeV., RabinovichA.. Going Deeper with Convolutions, The IEEE Conference on Computer Vision and Pattern Recognition, 2015,

[11] HeK., ZhangX., RenS., SunJ.. Deep Residual Learning for Image Recognition, IEEE Conference on Computer Vision and Pattern Recognition, 2016,

[12] HuangG., LiuZ., WeinbergerK. Q., van der MaatenL.. Densely Connected Convolutional Networks, The IEEE Conference on Computer Vision and Pattern Recognition, 2017,

[13] YinS., DengJ., ZhangD., DuJ.. Optoelectronics Letters, 2017, 13: 476

[14] SunY., LiangD., WangX., TangX.. Deepid3: Face Recognition with Very Deep Neural Networks, 2015,

[15] ChengJ., XuL., LüG., TangJ., MoJ., LüX., GaoZ.. Optoelectronics Letters, 2017, 13: 77

[16] LongJ., ShelhamerE., DarrellT.. Fully Convolutional Networks for Semantic Segmentation, 2015,

[17] RonnebergerO., FischerP., BroxT.. U–net: Convolutional Networks for Biomedical Image Segmentation, International Conference on Medical Image Computing and Computer–assisted Intervention, 2015,

[18] GlorotX., BordesA., BengioY.. Deep Sparse Rectifier Neural Networks, 14th International Conference on Artificial Intelligence and Statistics, 2011,

[19] IoffeS. a, SzegedyC.. Batch normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, 2015,

[20] KlambauerG., UnterthinerT., MayrA., HochreiterS.. Self–normalizing Neural Networks, Advances in Neural Information Processing Systems, 2017,

[21] SunS.. SELUs Visualized and Histogramed Comparisons among ReLU and Leaky ReLU, 2017,

[22] LguensatR., SunM., FabletR., MasonE., TandeoP., ChenG.. EddyNet: A Deep Neural Network for Pixel–Wise Classification of Oceanic Eddies, 2017,

[23] AkeretJ., ChangC., LucchiA., RefregierA.. Astronomy and computing, 2017, 18: 35

[24] ZeilerM. D., KrishnanD., TaylorG. W., FergusR.. Deconvolutional Networks, IEEE Conference on Computer Vision and Pattern Recognition, 2010,

[25] WongS. C., GattA., StamatescuV., McDonnellM. D.. Understanding Data Augmentation for Classification: When to Warp?, The International Conference on Digital Image Computing: Techniques and Applications, 2016,

[26] AbadiM., AgarwalA., BarhamP., BrevdoE., ChenZ., CitroC., et al.. Tensorflow: Large–scale Machine Learning on Heterogeneous Distributed Systems, 2016,

[27] KingmaD. P., BaJ.. Adam: A method for Stochastic Optimization, 2014,

[28] GlorotX., BengioY.. Understanding the Difficulty of Training Deep Feedforward Neural Networks, The 13th International Conference on Artificial Intelligence and Statistics, 2010,

[29] HintonG. E., SrivastavaN., KrizhevskyA., SutskeverI., SalakhutdinovR. R.. Improving Neural Networks by Preventing Co–adaptation of Feature Detectors, 2012,

Just Accepted

This article has successfully passed peer review and final editorial review, and will soon enter typesetting, proofreading and other publishing processes. The currently displayed version is the accepted final manuscript. The officially published version will be updated with format, DOI and citation information upon launch. We recommend that you pay attention to subsequent journal notifications and preferentially cite the officially published version. Thank you for your support and cooperation.