李仕佳
摘? 要:省級(jí)自然資源時(shí)空大數(shù)據(jù)云平臺(tái)立足于一網(wǎng)一庫一平臺(tái)N應(yīng)用的信息化總體規(guī)劃,在省政務(wù)網(wǎng)(一網(wǎng))環(huán)境下構(gòu)建一體化數(shù)據(jù)庫(一庫),支撐自然資源政務(wù)管理與服務(wù)平臺(tái)(一平臺(tái))、調(diào)查監(jiān)測及政務(wù)服務(wù)等應(yīng)用(N應(yīng)用)。該文以省級(jí)應(yīng)用為基礎(chǔ),探討時(shí)空大數(shù)據(jù)云平臺(tái)技術(shù)。通過超融合、海量數(shù)據(jù)存儲(chǔ)、云安全等技術(shù)構(gòu)筑云平臺(tái)基礎(chǔ),同時(shí)引入數(shù)據(jù)抽取、清洗、挖掘分析、可視化等數(shù)據(jù)處理技術(shù),以及分布式平行計(jì)算、SOA、微服務(wù)、容器等云化技術(shù),提升時(shí)空大數(shù)據(jù)云平臺(tái)的服務(wù)能力,為同類平臺(tái)建設(shè)提供借鑒。
關(guān)鍵詞:時(shí)空大數(shù)據(jù)? ?分布式并行計(jì)算? ?面向服務(wù)GIS技術(shù)? ?業(yè)務(wù)云化? ?微服務(wù)
中圖分類號(hào):P208? ? ? ? ? ? ? ? ? ? ? ? ? ?文獻(xiàn)標(biāo)識(shí)碼:A文章編號(hào):1672-3791(2021)07(b)-0001-03
Research and Application of Provincial Natural Resources Spatio-temporal Big Data Cloud Platform
LI Shijia
(STARGIS (Tianjin) Technology Development Co., Ltd., Tianjin, 300384 China)
Abstract: The provincial natural resources spatio-temporal big data cloud platform is based on the overall informatization planning of one network, one database and one platform (N application). And it constructs an integrated database (one database) under the provincial government network (one network) environment to support natural resources government management and service platform (one platform), investigation and monitoring, government service and other applications (N application). Based on provincial application, explore the time and space big data cloud platform technology. Build a cloud platform foundation through Hyper-converged, massive data storage, cloud security and other technologies, and introduce data processing technologies such as data extraction, cleaning, mining analysis, and visualization, as well as cloud technologies such as distributed parallel computing, SOA, microservices, and containers to improve service capabilities of time and space big data cloud platform and provide reference for the construction of similar platforms.
Key Words: Spatio-temporal big data; Distributed parallel computing; Service-oriented GIS technology; Business cloudization; Micro-service
業(yè)務(wù)信息化的推進(jìn)以數(shù)據(jù)為基礎(chǔ),與傳統(tǒng)靜態(tài)的、已知的數(shù)據(jù)相比,大數(shù)據(jù)是動(dòng)態(tài)的、未知的,時(shí)空數(shù)據(jù)是一種特殊類型的大數(shù)據(jù)[1]。時(shí)空大數(shù)據(jù)云平臺(tái)把各種分散的時(shí)空數(shù)據(jù)匯聚在平臺(tái)上,通過數(shù)據(jù)的多維融合、關(guān)聯(lián)分析和數(shù)據(jù)挖掘等過程,找出數(shù)據(jù)隱含的規(guī)律,幫助決策者做出快捷、全面、精準(zhǔn)和有效的預(yù)判,正如王家耀院士所說“數(shù)據(jù)隱含價(jià)值,計(jì)算發(fā)現(xiàn)價(jià)值,應(yīng)用實(shí)現(xiàn)價(jià)值”,時(shí)空大數(shù)據(jù)正日益成為治理體系和治理能力現(xiàn)代化的核心驅(qū)動(dòng)力。近年來,可視化分析、并行數(shù)據(jù)處理、Hadoop計(jì)算框架等技術(shù)不斷應(yīng)用到時(shí)空大數(shù)據(jù)業(yè)務(wù)中[2]。現(xiàn)階段,迫切需要利用云端運(yùn)算,對(duì)結(jié)構(gòu)復(fù)雜、數(shù)量龐大的數(shù)據(jù)進(jìn)行融合分析,轉(zhuǎn)化為有價(jià)值的信息。
1? 現(xiàn)狀分析
時(shí)空大數(shù)據(jù)來源廣泛,數(shù)據(jù)的豐富性和飛速發(fā)展的云計(jì)算技術(shù)為GIS提供了新的應(yīng)用模式,在這種形勢下,探索云平臺(tái)建設(shè)之路是必然的選擇,經(jīng)歷了基礎(chǔ)設(shè)施的梳理到整合,從數(shù)據(jù)聚合到按業(yè)務(wù)梳理,不斷地探索時(shí)空大數(shù)據(jù)云平臺(tái)技術(shù)實(shí)現(xiàn)之路[3]。為適應(yīng)當(dāng)前信息化要求,需要完成以下任務(wù):一是做好總體框架設(shè)計(jì),滿足未來發(fā)展需求;二是構(gòu)建高效基礎(chǔ)支撐層,滿足計(jì)算、存儲(chǔ)、I/O吞吐量、系統(tǒng)穩(wěn)定性等綜合要求;三是提升時(shí)空大數(shù)據(jù)挖掘分析能力,支撐更大范圍數(shù)據(jù)的快速分析和數(shù)據(jù)深入挖掘能力;四是以應(yīng)用為導(dǎo)向盤活時(shí)空大數(shù)據(jù),探索更深入的應(yīng)用。