Design and achievement of cloud geodatabase for a sponge city

Abstract

Building a cloud geodatabase for a sponge city is crucial to integrate the geospatial information dispersed in various departments for multi-user high concurrent access and retrieval, high scalability and availability, efficient storage and management. In this study, Hadoop distributed computing framework, including Hadoop distributed file system and MapReduce (mapper and reducer), is firstly designed with a parallel computing framework to process massive spatial data. Then, access control with a series of standard application programming interfaces for different functions is designed, including spatial data storage layer, cloud geodatabase access layer, spatial data access layer and spatial data analysis layer. Subsequently, a retrieval model is designed, including direct addressing via file name, three-level concurrent retrieval and block data retrieval strategies. Main functions are realised, including real-time concurrent access, high-performance computing, communication, massive data storage, efficient retrieval and scheduling decisions on the multi-scale, multi-source and massive spatial data. Finally, the performance of Hadoop cloud geodatabases is validated and compared with that of the Oracle database. The cloud geodatabase for the sponge city can avoid redundant configuration of personnel, hardware and software, support the data transfer, model debugging and application development, and provide accurate, real-time, virtual, intelligent, reliable, elastically scalable, dynamic and on-demand cloud services of the basic and thematic geographic information for the construction and management of the sponge city.

Keywords

cloud geodatabase / sponge city / Hadoop / concurrent retrieval / access

References

[1] HouJ-w, LiL-t, HeJie. Detection of grapevine leafroll disease based on 11-index imagery and ant colony clustering algorithm [J]. Precision Agriculture, 2016, 17(4): 488-505

[2] HouJ-w, FanX-g, LiuR-tao. Optimal spatial allocation of irrigation water under uncertainty using the bilayer nested optimisation algorithm and geospatial technology [J]. International Journal of Geographical Information Science, 2016, 30(12): 2462-2485

[3] ZhouX-g, ChenJ, JiangJ, ZhuJ-j, LiZ-lin. Event-based incremental updating of spatiotemporal database [J]. Journal of Central South University of Technology, 2004, 11(2): 192-198

[4] LeiX-d, ZhaoY-l, ChenS-q, YuanX-li. Scheduling transactions in mobile distributed real-time database systems [J]. Journal of Central South University of Technology, 2008, 15: 545-551

[5] HouJ-w, MiW-b, LiL-tang. Spatial quality evaluation for drinking water based on GIS and ant colony clustering algorithm [J]. Journal of Central South University of Technology, 2014, 21(2): 1051-1057

[6] JanakiramanK K, OrgunM A, NayakA. Geospatial editing over a federated cloud geodatabase for the state of NSW [C]. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, 2010, San Jose, ACM: 144151

[7] VoraA, JainD, MavaniG, ShahS. Incorporating database management system in cloud [J]. International Journal of Scientific Research and Education, 2016, 5(11): 61-64

[8] LiW-y, LiuC, HongY, ZhangX-h, WanZ-m, SahariaM, SunW-w, YaoD-j, ChenW, ChenS, YangX-q, YueJing. A public cloud-based China’s landslide inventory database (CsLID): Development, zone, and spatiotemporal analysis for significant historical events, 1949–2011 [J]. Journal of Mountain Science, 2016, 13(7): 1275-1285

[9] DőrnemannT, JuhnkeE, FreislebenB. Ondemand resource provisioning for BPEL workflows using Amazon’s elastic computer cloud [C]. Processing of the 9th IEEE/ACM Int Symposium on Cluster Computing and the Grid, 2009, Shanghai, China, TEEE: 140147

[10] KangCCloud computing and its Applications in GIS [D], 2011, Ann Arbor, Clark University

[11] BalkićZ, ŠoštarićD, HorvatG. GeoHash and UUID identifier for multi-agent systems [M]//Agent and Multi-Agent Systems Technologies and Applications. Berlin, Springer, 2012, 7327: 290-298

[12] EldawyA, MokbelM F. SpatialHadoop: A MapReduce framework for spatial data [C]. IEEE International Conference on Data Engineering, 2016, Seoul, IEEE: 13521363

[13] SrivastavaP, BinhN T, KhareA. Content-based image retrieval using moments [C]. Context-Aware Systems and Applications. ICCASA 2013. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, 2014, 128: 228-237

[14] ZhangM-j, WangH-b, LuY, LiT, GuangY-d, LiuC, EdrosaE, LiH-t, RisheN. TerraFly GeoCloud: An online spatial data analysis and visualization system [J]. ACM Transactions on Embedded Computing Systems, 2010, 9(4): 1-24

[15] DingZ-m, GuoL-m, YangQi. RDB-KV: A cloud database framework for managing massive heterogeneous sensor stream data [C]. Second International Conference on Intelligent System Design and Engineering Application, 2011, Sanya, IEEE: 653656

[16] LeeD W, LiangS H L. Geopot: A Cloud-based geolocation data service for mobile applications [J]. International Journal of Geographical Information Science, 2011, 25(8): 1283-1301

[17] BhatM A, ShahR M, AhmadB. Cloud computing: a solution to geographical information systems (GIS) [J]. International Journal on Computer Science and Engineering, 2011, 3(2): 594-600

[18] YangC-w, GoodchildM, HuangQ-y, NebertD, RaskinR, XuY, BambacusM, FayD. Spatial cloud computing: How can the geospatial sciences use and help shape cloud computing [J]. International Journal of Digital Earth, 2011, 4(4): 305-329

[19] AjiA, SunX-l, VoH, LiuQ-l, LeeR, ZhangX-d, SaltzJ, WangF-sheng. Demonstration of Hadoop-GIS: A spatial data warehousing system over MapReduce [J]. Advances in Geographic Information Systems, 2013, 6(11): 528-531

[20] ChenD-l, ChenR-g, XieJiong. Research of the parallel spatial database proto system based on MPP architecture [J]. Journal of Geo-information Science, 2016, 18(2): 151-159

[21] LiuB-l, LiG, YouH, SuiM-r, WangS-tao. Evaluation of dynamic groundwater quality simulation based on Cloud-GIS: A case study in Harbin urban area, China [J]. Water Science & Technology: Water Supply, 2014, 14(6): 1095-1103

[22] WeiL-y, HsuaY-t, PengaW-c, LeeW-chien. Indexing spatial data in cloud data managements [J]. Pervasive and Mobile Computing, 2014, 15(12): 48-61

[23] MateusR C, SiqueiraT L L, TimesV C, CiferriR R, CiferriC D D A. Spatial data warehouses and spatial OLAP come towards the cloud: design and performance [J]. Distributed and Parallel Databases, 2015, 4: 1-37

[24] KuneR, KonugurthiP K, AgarwalA, ChillarigeR R, BuyyaR. XHAMI–extended HDFS and MapReduce interface for big data image processing applications in cloud computing environments [J]. Software: Practice and Experience, 2017, 47: 455-472

[25] WangY, LiuZ-l, LiaoH-yan. Improving the performance of GIS polygon overlay computation with MapReduce for spatial big data processing [J]. Cluster Computing, 2015, 18(2): 507-516

[26] YanJ-n, MaY, WangL-zhe. A cloud-based remote sensing data production system [J]. Future Generation Computer Systems, 2018, 86(9): 1154-1166

[27] LinF-c, ChungL-k, WangC-ju. Storage and processing of massive remote sensing images using a novel cloud computing platform [J]. GIScience & Remote Sensing, 2013, 50(3): 322-336

[28] WangP-y, WangJ-q, ChenYing. Rapid processing of remote sensing images based on cloud computing [J]. Future Generation Computer Systems, 2013, 29(8): 1963-1968

[29] ChenH-m, ChangK-c, LinT-hsi. A cloud-based system framework for performing online viewing, storage, and analysis on big data of massive BIMs [J]. Automation in Construction, 2016, 71: 34-48

[30] CaryA, YeshaY, AdjouadiM, RisheN. Leveraging cloud computing in geodatabase management [C]. IEEE International Conference on Granular Computing, 2010, San Jose, IEEE: 7378

[31] CafarellaM, ChangE, FikesA, HalevyA, HsiehW, LernerA, MadhavanJ, MuthukrishnanS. Data management projects at Google [J]. ACM Signod Record, 2008, 37(1): 34-38

[32] ZhengK, FuY-li. Research on vector spatial data storage schema based on Hadoop platform [J]. International Journal of Database Theory and Application, 2013, 6(5): 85-94

[33] XuX-l, ZhangQ-t, ZhouJ-lan. NC-MACPABE: Non-centered multi-authority proxy re-encryption based on CP-ABE for cloud storage systems [J]. Journal of Central South University, 2017, 24(4): 807-818

[34] RyotaH, KimioKMapQL: Map-based Ontology Query Language [C], 200818

[35] DuanL FThe research and application of cloud database technology for remote sensing data [D], 2014, Kaifeng, Henan University

[36] ZhangX-l, GaoW-y, LaiY-j, ChengY-tao. Flatness predictive model based on T-S cloud reasoning network implemented by DSP [J]. Journal of Central South University, 2017, 24(10): 2222-2230

[37] YaoG-s, DingY-s, HaoK-rong. Multi-objective workflow scheduling in cloud system based on cooperative multi-swarm optimization algorithm [J]. Journal of Central South University, 2017, 24(5): 1050-1062

[38] VijayaP, RajuG, RayS K. Artificial neural network-based merging score for Meta search engine [J]. Journal of Central South University, 2016, 23(10): 2604-2615