A novel approach for assessing color harmony of historical buildings via street view image

Abstract

While new buildings continue to emerge in the process of urbanization, historical buildings, as valuable legacies carrying national historical memory, play an important role in the urban landscape. Previous studies have shown that color harmony is a crucial factor in coordinating urban landscapes. However, the evaluation of color harmony in historic areas and buildings lacks effective quantitative standards, often overlooking factors such as complementary color harmony and the compatibility of analogous colors. This study aims to build a new method to evaluate the color harmony of historical buildings through street view technology, semantic segmentation algorithms, quantification of color harmony methods based on image property detection and classification, questionnaire verification, and takes Shanghai’s historical buildings as an example to explore. Our study categorizes six types of color harmony indexes for Shanghai street-facing historic buildings into three levels, with the top tier serving as a benchmark for excellence and the lowest tier highlighting areas in need of urban environmental improvement. This study uniquely considers color compatibility within hue ranges and expanded relationship types like complementary harmony. This approach, applicable to cities globally, offers practical tools for urban planners and conservators in managing and preserving historic areas and buildings.

Keywords

Historic buildings / Historic area / Color harmony / Street view technology / Computer vision

References

[1] Abter, S.O., Abdullah, N.A.Z., 2017. An efficient color quantization using color histogram. 2017 Annual Conference on New Trends in Information and Communications Technology Applications (NTICT).

[2] Badrinarayanan, V., Kendall, A., Cipolla, R., 2017. SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 39, 2481- 2495.

[3] Bai, Z., Yang, K., Xie, L., Lee, J.L., Gao, X., 2020. A histogram equalization algorithm based on building a grey level binary tree dynamically. Optik 224, 165695.

[4] Chen, L., Kong, F., 2021. Quantitative method of regional color planning e field investigation on renewal design of jiangchuan street. In: Advances in Creativity, Innovation, Entrepreneurship and Communication of Design. Springer International Publishing, pp. 608-617.

[5] Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L., 2018. DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40, 834- 848.

[6] Cui, Z., 2020. Research on planning and design of urban architectural color in Changchun. E3S Web Conf. 165, 04029.

[7] Ding, M., 2021. Quantitative contrast of urban agglomeration colors based on image clustering algorithm: case study of the XiaZhang-Quan metropolitan area. Front. Arch. Res. 10 692- 700.

[8] Garcia-Codoñer, A., Verdú, J.L., Barchino, A.T., Guillén, R.V., Lluch, J.S., 2009. Colour as a structural variable of historical urban form. Color Res. Appl. 34, 253- 265.

[9] Han, X., Yu, Y., Liu, L., Li, M., Wang, L., Zhang, T., Tang, F., Shen, Y., Li, M., Yu, S., Peng, H., Zhang, J., Wang, F., Ji, X., Zhang, X., Hou, M., 2023. Exploration of street space architectural color measurement based on street view big data and deep learning-a case study of Jiefang North Road Street in Tianjin. PLoS One 18, e0289305.

[10] Jia, C., Wu, G., Kong, F., 2019. Image significance region detection based on global color clustering and contrast. 2019 IEEE 4th International Conference on Signal and Image Processing (ICSIP).

[11] Jiang, H., Lu, S., Xiao, Y., 2022. Method of urban color evaluation for historic and cultural areas in Shanghai based on street view technology. Urban Planning Forum 111- 118.

[12] Justus, A.N., 2021. Coloristics comparative analysis of the historical centers’ architecture of the cities in the south of the Tyumen region. Architecture, Construction, Transport 6- 16.

[13] Kansal, S., Purwar, S., Tripathi, R.K., 2018. Image contrast enhancement using unsharp masking and histogram equalization. Multimed. Tool. Appl. 77, 26919- 26938.

[14] Li, J., Tang, P., 2023. Multisource analysis of big data on street vitality using GIS mapping and deep learning: a case study of ding shu, China. CAADRIA proceedings 565- 574.

[15] Li, K.R., Yang, Y.Q., Zheng, Z.Q., 2020. Research on color harmony of building façades. Color Res. Appl. 45, 105- 119

[16] Moradi, F., Biloria, N., Prasad, M., 2023. Analyzing the agefriendliness of the urban environment using computer vision methods. Environ. Plan. B Urban Anal. City Sci. 50, 2294- 2308.

[17] Nguyen, L., Teller, J., 2017. Color in the urban environment: a user-oriented protocol for chromatic characterization and the development of a parametric typology. Color Res. Appl. 42, 131- 142.

[18] Sağlam, A., Akhan Baykan, N., 2019. Evaluating the attributes of remote sensing image pixels for fast k-meansclustering. Turk. J. Electr. Eng. Comput. Sci. 27, 4188- 4202.

[19] Wang, M., Vermeulen, F., 2021. Life between buildings from a street view image: what do big data analytics reveal about neighbourhood organisational vitality? Urban Stud. 58, 3118- 3139.

[20] Wang, Y., 2017. Study on colors of modern historical buildings of Wuhan university based on Munsell color system. Proceedings of the 3rd International Conference on Economics, Management, Law and Education (EMLE 2017).

[21] Wang, Z., Sun, H., Li, J., 2023. Research on architectural color and visual comfort in historic landscape areas. Buildings 13, 1004.

[22] Wattanasirichaigoon, N., 2020. Color scheme analysis of illustrations A computational approach to determine color harmony.

[23] Wei, X., Zhang, Y.E., 2020. Image segmentation algorithm based on dynamic particle swarm optimization and K-means clustering. Int. J. Comput. Appl. 42, 649- 654.

[24] Zhai, Y., Gong, R., Huo, J., Fan, B., 2023. Building façade color distribution, color Harmony and diversity in relation to street functions: using street view images and deep learning. ISPRS Int. J. Geo-Inf. 12, 224.

[25] Zhang, J., Fukuda, T., Yabuki, N., 2021a. Development of a cityscale approach for façade color measurement with building functional classification using deep learning and street view images. ISPRS Int. J. Geo-Inf. 10, 551.

[26] Zhang, J., Fukuda, T., Yabuki, N., 2021b. A large-scale measurement and quantitative analysis method of façade color in the urban street using deep learning. Proceedings of the 2020 DigitalFUTURES 93-102.

[27] Zhong, T., Ye, C., Wang, Z., Tang, G., Zhang, W., Ye, Y., 2021. Cityscale mapping of urban façade color using street-view imagery. Rem. Sens. 13, 1591.

[28] Zhou, Z., Zhong, T., Liu, M., Ye, Y., 2022. Evaluating building color harmoniousness in a historic district intelligently: an algorithmdriven approach using street-view images. Environ. Plan. B Urban Anal. City Sci. 50, 1838- 1857.

[29] Zhuang, Y., 2022. The color planning method of Shanghai New City based on big data and artificial intelligence. Wireless Commun. Mobile Comput. 2022, 3384002.

RIGHTS & PERMISSIONS

2024 2024 The Author(s). Publishing services by Elsevier B.V. on behalf of KeAi Communications Co. Ltd.

审图号：GS京（2024）1430号