Harmonizing street-view semantics and spatial predictors for dominant urban visual composition modelling

Abstract

Street-level visual experiences are underrepresented in top-down spatial datasets such as remote sensing and spatial footprints, which predominantly capture configurations from an overhead perspective. This study develops a framework to model and map urban visual dominance, defined through seven typologies based on Greenness, Openness, and Enclosure. A total of 12,631 Google Street View panoramas were semantically segmented with a pretrained ADE20K deep learning model to extract proportions of trees, buildings, and sky. These proportions were aggregated into 50 m hexagonal grids and classified into visual dominance classes through rule-based logic. To predict these classes beyond street-view coverage, three scenarios of spatial predictors (remote sensing indices, building footprints, and their combination) were evaluated using five machine learning algorithms. Logistic Regression with combined predictors performed best, achieving an accuracy of 0.503 and an AUC-ROC up to 0.85 for the Greenness class. External validation against GHSL settlement data across six urban sites showed soft accuracy scores ranging from 22.33% to 67.23%, with better performance in structured environments than in fragmented residential settings. These findings highlight both the promise and limitations of generalizing street-view visual information from two-dimensional spatial features, offering a scalable approach to bridge the spatial coverage gap and support more human-centered urban landscape analysis.

Keywords

Enclosure / Greenness / Openness / Remote sensing / Spatial footprints / Street-view

References

[1] Aikoh, T., Homma, R., & Abe, Y. (2023). Comparing conventional manual measurement of the green view index with modern automatic methods using google street view and semantic segmentation. Urban Forestry and Urban Greening, 80(October 2022), 127845. https://doi.org/10.1016/j.ufug.2023.127845

[2] Anguelov D, Dulong C, Filip D, Frueh C, Lafon S, Lyon R, Ogale A, Vincent L, Weaver J. Google street view: Capturing the world at street level. Computer, 2010, 43(6): 32-38.

[3] Atiqul Haq SM, Islam MN, Siddhanta A, Ahmed KJ, Chowdhury MTA. Public Perceptions of Urban Green Spaces: Convergences and Divergences. Frontiers in Sustainable Cities, 2021, 3(October): 1-15.

[4] Bernard J, Bocher E, Petit G, Palominos S. Sky view factor calculation in urban context: Computational performance and accuracy analysis of two open and free GIS tools. Climate, 2018, 6(3. 60

[5] Biljecki F, Ito K. Street view imagery in urban analytics and GIS: A review. Landscape and Urban Planning, 2021, 215(August. 104217

[6] Biswas G, Roy TK. Measuring objective walkability from pedestrian-level visual perception using machine learning and GSV in Khulna, Bangladesh. Geomatics and Environmental Engineering, 2023, 17(6): 5-34.

[7] Burdziej J. Using hexagonal grids and network analysis for spatial accessibility assessment in urban environments- A case study of public amenities in Toruń. Miscellanea Geographica, 2019, 23(2): 99-110.

[8] Cao R, Zhu J, Tu W, Li Q, Cao J, Liu B, Zhang Q, Qiu G. Integrating aerial and street view images for urban land use classification. Remote Sensing, 2018, 10(10): 1-23.

[9] Chen K, Tian M, Zhang J, Xu X, Yuan L. Evaluating the seasonal effects of building form and street view indicators on street-level land surface temperature using random forest regression. Building and Environment, 2023, 245(September. 110884

[10] Curtis JW, Curtis A, Mapes J, Szell AB, Cinderich A. Using google street view for systematic observation of the built environment: Analysis of spatio-temporal instability of imagery dates. International Journal of Health Geographics, 2013, 12: 1-10.

[11] Dirksen M, Ronda RJ, Theeuwes NE, Pagani GA. Sky view factor calculations and its application in urban heat island studies. Urban Climate, 2019, 30(May. 100498

[12] Fan Z, Biljecki F. Nighttime street view imagery: A new perspective for sensing urban lighting landscape. Sustainable Cities and Society, 2024, 116(June. 105862

[13] Fan Z, Feng CC, Biljecki F. Coverage and bias of street view imagery in mapping the urban environment. Computers, Environment and Urban Systems, 2025, 117(January. 102253

[14] Fang YN, Tian J, Namaiti A, Zhang S, Zeng J, Zhu X. Visual aesthetic quality assessment of the streetscape from the perspective of landscape-perception coupling. Environmental Impact Assessment Review, 2024, 106(February. 107535

[15] Fujiwara, K., Khomiakov, M., Yap, W., Ignatius, M., & Biljecki, F. (2024). Microclimate vision: Multimodal prediction of climatic parameters using street-level and satellite imagery. Sustainable Cities and Society, 114(July). https://doi.org/10.1016/j.scs.2024.105733

[16] Gaw, L. Y., Chen, S., Chow, Y. S., Lee, K., & Biljecki, F. (2022). Comparing street view imagery and aerial perspectives in the built environment. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 10(4/W3-2022), 49–56. https://doi.org/10.5194/isprs-annals-X-4-W3-2022-49-2022

[17] Gong Z, Ma Q, Kan C, Qi Q. Classifying street spaces with street view images for a spatial indicator of urban functions. Sustainability, 2019.

[18] Gu Y, Quintana M, Liang X, Ito K, Yap W, Biljecki F. Designing effective image-based surveys for urban visual perception. Landscape and Urban Planning, 2025, 260(April. 105368

[19] He, J., Zhang, J., Yao, Y., & Li, X. (2023). Extracting human perceptions from street view images for better assessing urban renewal potential. Cities, 134(November 2022), 104189. https://doi.org/10.1016/j.cities.2023.104189

[20] Huang, D., Jiang, B., & Yuan, L. (2022). Analyzing the effects of nature exposure on perceived satisfaction with running routes: An activity path-based measure approach. Urban Forestry and Urban Greening, 68(October 2021), 127480. https://doi.org/10.1016/j.ufug.2022.127480

[21] Huang L, Oki T, Muto S, Ogawa Y. Unveiling the non-linear influence of eye-level streetscape factors on walking preference: Evidence from Tokyo. ISPRS International Journal of Geo-Information, 2024, 13(4. 131

[22] Huang, Z., Tang, L., Qiao, P., He, J., & Su, H. (2024). Socioecological justice in urban street greenery based on green view index-A case study within the Fuzhou Third Ring Road. Urban Forestry and Urban Greening, 95(March). https://doi.org/10.1016/j.ufug.2024.128313

[23] Ito K, Bansal P, Biljecki F. Examining the causal impacts of the built environment on cycling activities using time-series street view imagery. Transportation Research Part A, 2023, 190(October. 104286

[24] Jabbar M, Yusoff MM, Shafie A. Assessing the role of urban green spaces for human well-being: A systematic review. GeoJournal, 2022, 87(5): 4405-4423.

[25] Jennings V, Bamkole O. The relationship between social cohesion and urban green space: An avenue for health promotion. International Journal of Environmental Research and Public Health, 2019.

[26] Jin B, Geng J, Ke S, Pan H. Analysis of spatial variation of street landscape greening and influencing factors: An example from Fuzhou city. China. Scientific Reports, 2023, 13(1): 1-12.

[27] Jing X, Li Z, Chen H, Zhang C. “Is What We See Always Real?” A Comparative Study of Two-Dimensional and Three-Dimensional Urban Green Spaces: The Case of Shenzhen’s Central District. Forests, 2024.

[28] Kang J, Körner M, Wang Y, Taubenböck H, Zhu XX. Building instance classification using street view images. ISPRS Journal of Photogrammetry and Remote Sensing, 2018, 145: 44-59.

[29] Kang Y, Kim J, Park J, Lee J. Assessment of perceived and physical walkability using street view images and deep learning technology. ISPRS International Journal of Geo-Information, 2023.

[30] Knoblauch S, Mukaratirwa RT, Pimenta PFP, de A Rocha AA, Yin MS, Randhawa S, Lautenbach S, Wilder-Smith A, Rocklöv J, Brady OJ, Biljecki F, Dambach P, Jänisch T, Resch B, Haddawy P, Bärnighausen T, Zipf A. Urban Aedes aegypti suitability indicators: A study in Rio de Janeiro, Brazil. The Lancet Planetary Health, 2025, 9(4. e264–e273

[31] Knoblauch S, Su Yin M, Chatrinan K, de Aragão Rocha AA, Haddawy P, Biljecki F, Lautenbach S, Resch B, Arifi D, Jänisch T, Morales I, Zipf A. High-resolution mapping of urban Aedes aegypti immature abundance through breeding site detection based on satellite and street view imagery. Scientific Reports, 2024, 14(1): 1-13.

[32] Kullmann K. Design with (human) nature: Recovering the creative instrumentality of social data in urban design. Journal of Urban Design, 2019, 24(2): 165-182.

[33] Lei B, Liu P, Liang X, Yan Y, Biljecki F. Developing the urban comfort index: Advancing liveability analytics with a multidimensional approach and explainable artificial intelligence. Sustainable Cities and Society, 2025, 120(January. 106121

[34] Li T, Zheng X, Wu J, Zhang Y, Fu X, Deng H. Spatial relationship between green view index and normalized differential vegetation index within the Sixth Ring Road of Beijing. Urban Forestry & Urban Greening, 2021, 62. 127153

[35] Li X, Zhang C, Li W, Ricard R, Meng Q, Zhang W. Assessing street-level urban greenery using Google Street View and a modified green view index. Urban Forestry & Urban Greening, 2015, 14(3): 675-685.

[36] Liang X, Chang JH, Gao S, Zhao T, Biljecki F. Evaluating human perception of building exteriors using street view imagery. Building and Environment, 2024, 263(April. 111875

[37] Lin, W., & Güneralp, B. (2024). Influence of urban-form and sociodemographic factors on street tree abundance transpire across scales in Houston, TX. Urban Forestry and Urban Greening, 94(December 2023), 128263. https://doi.org/10.1016/j.ufug.2024.128263

[38] Liu, P., Zhao, T., Luo, J., Lei, B., Frei, M., Miller, C., & Biljecki, F. (2023). Towards human-centric digital twins: Leveraging computer vision and graph models to predict outdoor comfort. Sustainable Cities and Society, 93(March). https://doi.org/10.1016/j.scs.2023.104480

[39] Liu Y, Wang Z, Ren S, Chen R, Shen Y, Biljecki F. Physical urban change and its socio-environmental impact: Insights from street view imagery. Computers, Environment and Urban Systems, 2025, 119(March. 102284

[40] Liu Z, Abd Malek MIB, Harun NZB, Ja`afar NHB, Song Y, Tang Y, Lyu Y. How do streetscape visual components affect public perception in post-renewed neighborhoods: A case study in Chengdu. Journal of Asian Architecture and Building Engineering, 2024, 00(00): 1-18.

[41] Lu Y, Sarkar C, Xiao Y. The effect of street-level greenery on walking behavior: Evidence from Hong Kong. Social Science and Medicine, 2018, 208(February): 41-49.

[42] Luo, J., Liu, P., Xu, W., Zhao, T., & Biljecki, F. (2025). A perception-powered urban digital twin to support human-centered urban planning and sustainable city development. Cities, 156(May 2024), 105473. https://doi.org/10.1016/j.cities.2024.105473

[43] Lynch KThe image of the city, 1960MIT Press

[44] Meenar M, Afzalan N, Hajrasouliha A. Analyzing Lynch’s city imageability in the digital age. Journal of Planning Education and Research, 2022, 42(4): 611-623.

[45] Ode Å, Hagerhall CM, Sang N. Analysing visual landscape complexity: Theory and application. Landscape Research, 2010, 35(1): 111-131.

[46] Ogawa Y, Oki T, Zhao C, Sekimoto Y, Shimizu C. Evaluating the subjective perceptions of streetscapes using street-view images. Landscape and Urban Planning, 2024, 247(March. 105073

[47] Pesaresi, M., & Politis, P. (2023). GHS-BUILT-C R2023A - GHS Settlement Characteristics, derived from Sentinel2 composite (2018) and other GHS R2023A data. https://doi.org/10.1080/17538947.2024.2390454

[48] Pradana MR, Dimyati M. Tracking urban sprawl: A systematic review and bibliometric analysis of spatio-temporal patterns using remote sensing and GIS. European Journal of Geography, 2024, 15(3): 190-203.

[49] Qi Z, Duan J, Su H, Fan Z, Lan W. Using crowdsourcing images to assess visual quality of urban landscapes: A case study of Xiamen Island. Ecological Indicators, 2023, 154(March. 110793

[50] Qiu W, Li W, Liu X, Huang X. Subjectively measured streetscape perceptions to inform urban design strategies for Shanghai. ISPRS International Journal of Geo-Information, 2021.

[51] Reed, E. S. (2018). Exploring the visual world. In: James J. Gibson and the Psychology of Perception. https://doi.org/10.2307/j.ctt1xp3nmm.13

[52] Rehan RM. Sustainable streetscape as an effective tool in sustainable urban design. HBRC Journal, 2013, 9(2): 173-186.

[53] Rui J. Measuring streetscape perceptions from driveways and sidewalks to inform pedestrian-oriented street renewal in Düsseldorf. Cities, 2023, 141(May. 104472

[54] Schiffer F. The physical nature of subjective experience and its interaction with the brain. Medical Hypotheses, 2019, 125(February): 57-69.

[55] Semeraro T, Scarano A, Buccolieri R, Santino A, Aarrevaara E. Planning of urban green spaces: An ecological perspective on human benefits. Land, 2021, 10(2): 1-26.

[56] Shahtahmassebi, A. R., Li, C., Fan, Y., Wu, Y., lin, Y., Gan, M., Wang, K., Malik, A., & Blackburn, G. A. (2021). Remote sensing of urban green spaces: A review. Urban Forestry and Urban Greening, 57(August 2020), 126946. https://doi.org/10.1016/j.ufug.2020.126946

[57] Song J, Zhu X, Yu X. Monitoring and mapping vegetation greenery in residential communities using street view images and a normalized vegetation greenery index: A case study in Beijing, China. Frontiers in Forests and Global Change, 2023, 6(May): 1-13.

[58] Sun D, Ji X, Gao W, Zhou F, Yu Y, Meng Y, Yang M, Lin J, Lyu M. The relation between green visual index and visual comfort in Qingdao coastal streets. Buildings, 2023, 13(2): 1-23.

[59] Taylor L, Hochuli DF. Defining greenspace: Multiple uses across multiple disciplines. Landscape and Urban Planning, 2017, 158: 25-38.

[60] Tiara S, Gamal A. The correlation between spatial configuration and user satisfaction: A case study of an activity-based vs a conventional office. International Journal on Advanced Science, Engineering and Information Technology, 2021, 11(2): 648-655.

[61] Tong M, She J, Tan J, Li M, Ge R, Gao Y. Evaluating street greenery by multiple indicators using street-level imagery and satellite images: A case study in Nanjing. China. Forests, 2020, 11(12): 1-21.

[62] Torkko J, Poom A, Willberg E, Toivonen T. How to best map greenery from a human perspective? Comparing computational measurements with human perception. Frontiers in Sustainable Cities, 2023.

[63] Vernon, S., Irwine, S., Patton, J., & Chapman, N. (2021). Landscape and visual impact assessment. Landscape Architect’s Pocket Book, 229–231. https://doi.org/10.4324/9781003119500-48

[64] Wang, J., Liu, W., & Gou, A. (2022). Numerical characteristics and spatial distribution of panoramic Street Green View index based on SegNet semantic segmentation in Savannah. Urban Forestry and Urban Greening, 69(October 2021), 127488. https://doi.org/10.1016/j.ufug.2022.127488

[65] Wang M, He Y, Meng H, Zhang Y, Zhu B, Mango J, Li X. Assessing street space quality using street view imagery and function-driven method: The case of Xiamen, China. ISPRS International Journal of Geo-Information, 2022.

[66] Wang R, Lu T, Wan C, Sun X, Jiang W. Measuring the effects of streetscape characteristics on perceived safety and aesthetic appreciation of pedestrians. Journal of Urban Planning and Development, 2023, 149(3): 5023020.

[67] Wang, S., Huang, X., Liu, P., Zhang, M., Biljecki, F., Hu, T., Fu, X., Liu, L., Liu, X., Wang, R., Huang, Y., Yan, J., Jiang, J., Chukwu, M., Reza Naghedi, S., Hemmati, M., Shao, Y., Jia, N., Xiao, Z., et al. (2024). Mapping the landscape and roadmap of geospatial artificial intelligence (GeoAI) in quantitative human geography: An extensive systematic review. International Journal of Applied Earth Observation and Geoinformation, 128(March). https://doi.org/10.1016/j.jag.2024.103734

[68] Wei J, Yue W, Li M, Gao J. Mapping human perception of urban landscape from street-view images: A deep-learning approach. International Journal of Applied Earth Observation and Geoinformation, 2022, 112(June. 102886

[69] Wu Z, Xu K, Li Y, Zhao X, Qian Y. Application of an integrated model for analyzing street greenery through image semantic segmentation and accessibility: A case study of Nanjing City. Forests, 2024.

[70] Xia, Y., Yabuki, N., & Fukuda, T. (2021a). Development of a system for assessing the quality of urban street-level greenery using street view images and deep learning. Urban Forestry and Urban Greening, 59(December 2020), 126995. https://doi.org/10.1016/j.ufug.2021.126995

[71] Xia Y, Yabuki N, Fukuda T. Sky view factor estimation from street view images based on semantic segmentation. Urban Climate, 2021, 40(May. 100999

[72] Xu H, Lu H, Liu S. Online Street View-Based Approach for Sky View Factor Estimation: A Case Study of Nanjing. China. Applied Sciences (Switzerland), 2024, 14(5): 1-17.

[73] Yang L, Liu J, Liang Y, Lu Y, Yang H. Spatially varying effects of street greenery on walking time of older adults. ISPRS International Journal of Geo-Information, 2021.

[74] Yosifof R, Fisher-Gewirtzman D. Hybrid quantitative mesoscale analyses for simulating pedestrians’ visual perceptions: Comparison of three New York City streets. Environment and Planning b: Urban Analytics and City Science, 2024, 51(1): 140-156.

[75] Yu M, Chen X, Zheng X, Cui W, Ji Q, Xing H. Evaluation of spatial visual perception of streets based on deep learning and spatial syntax. Scientific Reports, 2025, 15(1): 1-15.

[76] Zhao T, Liang X, Biljecki F, Tu W, Cao J, Li X, Yi S. Quantifying seasonal bias in street view imagery for urban form assessment: A global analysis of 40 cities. Computers, Environment and Urban Systems, 2025, 120(May. 102302

[77] Zhao, T., Liang, X., Tu, W., Huang, Z., & Biljecki, F. (2023). Sensing urban soundscapes from street view imagery. Computers, Environment and Urban Systems, 99(September 2022), 101915. https://doi.org/10.1016/j.compenvurbsys.2022.101915

[78] Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., & Torralba, A. (2017). Scene parsing through ADE20K dataset. Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017-Janua, 5122–5130. https://doi.org/10.1109/CVPR.2017.544

[79] Zhou B, Zhao H, Puig X, Xiao T, Fidler S, Barriuso A, Torralba A. Semantic understanding of scenes through the ADE20K dataset. International Journal of Computer Vision, 2019, 127(3): 302-321.

Funding

Rispro Indonesia - NTU Singapore Institute of Research for Sustainability and Innovation (INSPIRASI)(Grant 2924/E3/AL.04/2024)

RIGHTS & PERMISSIONS

The Author(s)