A Deep Learning Application for Building Damage Assessment Using Ultra-High-Resolution Remote Sensing Imagery in Turkey Earthquake

Abstract

Rapid building damage assessment following an earthquake is important for humanitarian relief and disaster emergency responses. In February 2023, two magnitude-7.8 earthquakes struck Turkey in quick succession, impacting over 30 major cities across nearly 300 km. A quick and comprehensive understanding of the distribution of building damage is essential for efficiently deploying rescue forces during critical rescue periods. This article presents the training of a two-stage convolutional neural network called BDANet that integrated image features captured before and after the disaster to evaluate the extent of building damage in Islahiye. Based on high-resolution remote sensing data from WorldView2, BDANet used pre-disaster imagery to extract building outlines; the image features before and after the disaster were then combined to conduct building damage assessment. We optimized these results to improve the accuracy of building edges and analyzed the damage to each building, and used population distribution information to estimate the population count and urgency of rescue at different disaster levels. The results indicate that the building area in the Islahiye region was 156.92 ha, with an affected area of 26.60 ha. Severely damaged buildings accounted for 15.67% of the total building area in the affected areas. WorldPop population distribution data indicated approximately 253, 297, and 1,246 people in the collapsed, severely damaged, and lightly damaged areas, respectively. Accuracy verification showed that the BDANet model exhibited good performance in handling high-resolution images and can be used to directly assess building damage and provide rapid information for rescue operations in future disasters using model weights.

Keywords

BDANet / Building damage assessment / Deep learning / Disaster assessment / Emergency rescue / Ultra-high-resolution remote sensing

References

[1] Brunner D, Lemoine G, Bruzzone L. Earthquake damage assessment of buildings using VHR optical and SAR imagery. IEEE Transactions on Geoscience and Remote Sensing, 2010, 48: 2403-2420

[2] Ci, T., Z. Liu, and Y. Wang. 2019. Assessment of the degree of building damage caused by disaster using convolutional neural networks in combination with ordinal regression. Remote Sensing 11(23): Article 2858.

[3] Ge, P.L., H. Gokon, and K. Meguro. 2020. A review on synthetic aperture radar-based building damage assessment in disasters. Remote Sensing of Environment 240: Article 111693.

[4] Gu Y, Yan FJ. Building extraction based on UNet++ network with different backbones. Journal of Chinese Academy of Sciences, 2022, 39(4): 512-523.

[5] Gupta, R., R. Hosfelt, S. Sajeev, N. Patel, B. Goodman, J. Doshi, E. Heim, H. Choset, and M.J. Gaston. 2019. xBD: A dataset for assessing building damage from satellite imagery. In Proceedings of the IEEE conference on computer vision and pattern recognition, 16–20 June 2019, Long Beach, CA, USA.

[6] Hansapinyo, C., P. Latcharote, and S. Limkatanyu. 2020. Seismic building damage prediction from GIS-based building data using artificial intelligence system. Frontiers in Built Environment 6: Article 576919.

[7] He, K., X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 27–30 June 2016, Las Vegas, NV, USA.

[8] Karimzadeh S, Feizizadeh B, Matsuoka MJI. From a GIS-based hybrid site condition map to an earthquake damage assessment in Iran: Methods and trends. International Journal of Disaster Risk Reduction, 2017, 22: 23-36

[9] Liu Y, Chen D, Ma A, Zhong Y, Fang F, Xu K. Multiscale U-shaped CNN building instance extraction framework with edge constraint for high-spatial-resolution remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59: 6106-6120

[10] Mangalathu S, Sun H, Nweke CC, Yi ZX, Burton HV. Classifying earthquake damage to buildings using machine learning. Earthquake Spectra, 2020, 36: 183-208

[11] Nex, F., D. Duarte, F.G. Tonolo, and N. Kerle. 2019. Structural building damage detection with deep learning: Assessment of a state-of-the-art CNN in operational conditions. Remote Sensing 11: Article 2765.

[12] Ronneberger, O., P. Fischer, and T. Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In: Proceedings of medical image computing and computer-assisted intervention—MICCAI 2015: 18th International conference, 5–9 October 2015, Munich, Germany.

[13] Roy AG, Navab N, Wachinger CJI. Recalibrating fully convolutional networks with spatial and channel “squeeze and excitation” blocks. IEEE Transactions on Medical Imaging, 2018, 38(2): 540-549

[14] Shen Y, Zhu S, Yang T, Chen C, Pan D, Chen J, Xiao L, Du Q. Bdanet: Multiscale convolutional neural network with cross-directional attention for building damage assessment from satellite images. IEEE Transactions on Geoscience and Remote Sensing, 2021, 60: 1-14.

[15] Shorten C, Khoshgoftaar TM. A survey on image data augmentation for deep learning. Journal of Big Data, 2019, 6(1): 1-48

[16] Silva V, Brzev S, Scawthorn C, Yepes C, Dabbeek J, Crowley H. A building classification system for multi-hazard risk assessment. International Journal of Disaster Risk Science, 2022, 13(2): 161-177

[17] Simonyan, K., and A. Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. https://arxiv.org/abs/1409.1556. Accessed 10 Apr 2015.

[18] Sorichetta A, Hornby GM, Stevens FR, Gaughan AE, Linard C, Tatem AJ. High-resolution gridded population datasets for Latin America and the Caribbean in 2010, 2015, and 2020. Scientific Data, 2015, 2: 1-12

[19] Suzuki S, Abe K. Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing, 1985, 30(1): 32-46

[20] Szegedy, C., W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 7–15 June 2015, Boston, MA, USA.

[21] Uprety, P., and F. Yamazaki. 2012. Building damage detection using SAR images in the 2010 Haiti earthquake. In: Proceedings of the 15th world conference on earthquake engineering 2012, 24–28 September 2012, Lisbon, Portugal.

[22] Wang NN, Zhao XF, Zhao P, Zhang Y, Zou Z, Ou JP. Automatic damage detection of historic masonry buildings based on mobile deep learning. Automation in Construction, 2019, 103: 53-66

[23] Weber, E., and H.J. Kané. 2020. Building disaster damage assessment in satellite imagery with multi-temporal fusion. https://arxiv.org/abs/2004.05525. Accessed 12 Apr 2020.

[24] Wu F, Gong L, Wang C, Zhang H, Zhang B, Xie L. Signature analysis of building damage with TerraSAR-X new staring spotlight mode data. IEEE Geoscience and Remote Sensing Letters, 2016, 13(11): 1696-1700

[25] Xu, J.Z., W. Lu, Z. Li, P. Khaitan, and V.J. Zaytseva. 2019. Building damage detection in satellite imagery using convolutional neural networks. https://arxiv.org/abs/1910.06444. Accessed 14 Oct 2019.

[26] Yamazaki F, Matsuoka M. Remote sensing technologies in post-disaster damage assessment. Journal of Earthquake and Tsunami, 2007, 1(3): 193-210

[27] Yun, S., D. Han, S.J. Oh, S. Chun, J. Choe, and Y. Yoo. 2019. Cutmix: Regularization strategy to train strong classifiers with localizable features. In: Proceedings of the IEEE/CVF international conference on computer vision, 27 October–2 November 2019, Seoul, Korea (South).

[28] Zhou Z, Rahman Siddiquee MM, Tajbakhsh N, Liang J Stoyanov D, Taylor Z, Carneiro G, Syeda-Mahmood T, Martel A, Maier-Hein L, Manuel J, Tavares RS Unet++: A nested u-net architecture for medical image segmentation. DLMIA 2018, ML-CDS 2018: Deep learning in medical image analysis and multimodal learning for clinical decision support, 2018, Cham: Springer 3-11

[29] Zhu, X., J. Liang, and A. Hauptmann. 2021. Msnet: A multilevel instance segmentation network for natural disaster damage assessment in aerial videos. In: Proceedings of the 2021 IEEE winter conference on applications of computer vision (WACV), 3–8 January 2021, Waikoloa, HI, USA.