《愛分析:2022云數據平臺白皮書-數字化轉型時代的企業數據新基建(57頁).pdf》由會員分享,可在線閱讀,更多相關《愛分析:2022云數據平臺白皮書-數字化轉型時代的企業數據新基建(57頁).pdf(57頁珍藏版)》請在三個皮匠報告上搜索。
1、?1?|?2022?7?2?|?寞?21?封?研?去?告?封?割?去?研?&?2000?ICT?撐?去?1?3?|?寞?務?1?GDP?20?1?GDP?3?6.7?務?研?研?研?研?研?封?研?告?研?封?-?去?務?研?ETL?研?研?研?務?告?研?撐練?IT?撐練?研?研?研?研?告?研?研?研?研?割?封?研?去?去?研?4?|?1.?研?6 1.1?夠?6 1.2?研?8 1.3?研?9 2.?研?18 2.1?18 2.2?去?研?研?28 3.?研?務?36 3.1?夠?37 3.2?39 3.3?&?40 3.4?去?42 4.?45 4.1?45 4.2?47 4.3?5
2、0?54?55?56?5?|?6?|?1.?研?務?封?告?務?割?封?1.1?封?務?封?去?研?導?割?割?研?太?去?夠?割?務?研?AI?IT?夠?研?7?|?2?研?夠?務?務?研?AI?務?研?研?研?研?研?研封?研?研?封?研?研?8?|?1.2?研?研?研?研?研?研?研?研?3?l?研?研?研?研?研?研?研?研?研?愿?研?研?l?研?研?研?研?/?務?研?NoSQL?研?研?封?AI?封?割?9?|?l?研?研?研?研?研?研?研?務?封?研?研?模?研?研?研?模?研?2018?5?21?封?研?封?2018?22?研?研?研?告?研?研?研?研?模?研?研?研?封
3、?研?l?研?研 API?研?研?研?研?1.3?研?研?研?研?研?研?研?模?研?研?務?研務?10?|?4?1.3.1 數據庫階段?研?研?研?Oracle?DB2?1970?去?1980?去夯?研?OLTP?研?研?研?研?研?11?|?研?研?IT?研?研?研?模?研?務?研?研?研?割?研?研?研?研?研?研?研?l?SQL?ACID?研?模?告?的?的?l?去?Oracle?IBM?IT?盡?OLTP?務?告?的?割?研?務?l?Oracle?IBM?DB2?1.3.2 數據倉庫階段 1990?去?E.F.Codd?1993?OLAP?研?研?去?12?|?研?OLAP?研?撐練
4、?OLAP?研?研?OLAP?OLAP?研?研?務?研?研?研?告?研?研?的?Oracle?DB2?研?的?的?MPP?研?IT?IT?IT?告?研?研?研?封?1980?去?Teradata?MPP?研?MPP?研?割?Teradata?Oracle?DB2?研?1990?去?MPP?研?研?務?2006?Greenplum?Vertica?x86?MPP?研?研?的?研?研?l?的?割?x86?的?SQL?ACID?13?|?l?MPP?Teradata?EMC?Greenplum?Vertica?盡?MPP?研?研?務?研?l?Teradata?EMC?Greenplum?HPE?Ve
5、rtica?1.3.3 大數據平臺階段 2005?野封?研?野封?研?研?研?研?研?研?研?務?研?CSV?XML?JSON?研?研?愿?研?研?研?寞?GB?TB?PB?EB?BI?研確?割?IT?研?告?MPP?研?的?的?割?研?Hadoop?去?研?研?研?告?IT?研?Hadoop?去?研?研?研?研?研?14?|?Hadoop?研?MPP?研?SQL-on-Hadoop?Hive?SparkSQL?研?NoSQL?研?HBase?HDFS?研?MPP?研?割?SQL-on-Hadoop?研?HDFS?的?研?研?SQLSQL-onon-HadoopHadoop?研?研?l?SQL
6、-on-Hadoop?的?的?的?的?告?HDFS?SQL-on-Hadoop?研?SQL?ACID?研?MPP?研?SQL-on-Hadoop?務?割?l?SQL-on-Hadoop?盡?夯?盡?去?告?務?去?l?Hive?SparkSQL?Cloudera?Impala?Facebook?Presto?1.3.4 云數據平臺階段 2015?研?研?研?研?研?告?研?去?割?寞?研?研?15?|?研?研?夠?去?務?務?研?撐?研務?研?研?研務?研?研?研?研?研?研?研?的?MPP?SQL-on-Hadoop?研?的?研?SQL-on-Hadoop?研?SQL?ACID?割?研?MP
7、P?研?研?研?研務?研?研?研?-?研?-?研?16?|?5?-?-?研?研?研?研?Hadoop?封?研?的?研?撐練?撐練?17?|?18?|?2.?研?研?告?研?研?研?研?的?練?MPP?SQL-on-Hadoop?去?研?寞?去?務?研務?研?研?研?研?研?去?研?研?太?研?2.1?撐練?務?研?愿?6?19?|?2.1.1 數據規模膨脹,數據基礎設施產生新“數據孤島”?研?研?研?2019?3219.89?8.82?886.39?2.43?研?封?研?PB?研?3000?7?研?研?研?研?研?MPPMPP?MPP?SQL?ACID?Oracle?DB2?研?研?研?的?夠
8、?封?研?研?告?研?MPP?研?的?MPP?20?|?10PB?研?3000?40?MPP?告?研?研?塑?研?PB?研?割?研?封?研?研?研?告?研?研?割?研?割?研?研?MPP?割?Hive?SparkSQL?SQL-on-Hadoop?的?告?SQL?ACID?割?MPP?封?務?MPP?研?研?MPP?SQL-on-Hadoop?SQL?ACID?割?研?告?割?寞?夠?寞?研?割告?的?割?務?去?盡?Hive?研?告?Hive?研?Oracle?Oracle?Hive?Hive 割?Oracle?去?務?確?研?研?研?去?研?研?l?的?的?21?|?l?SQLSQL?AC
9、IDACID?HadoopHadoop?HadoopHadoop?模?SQL?ACID?寞?Oracle?DB2?研?MPP?研?HDFS?Hadoop?寞?SQL-on-Hadoop?研?8?2.1.2 敏態特征凸顯,數據基礎設施彈性能力受挑戰?2014?Gartner?IT?IT?IT?IT?IT?割?IT?去?22?|?盡?盡?IT?盡?IaaS?研?Docker?Kubernetes?AIOps?PaaS?封?寞?IT?去?IT?IT?研?研?研?研?研?研務?務?研 IDC?2025?務?研?50%?割?IT?割?寞?研?研?研?23?|?9?告?研?MPP?SQL-on-Hadoo
10、p?割?封?MPP?的?IT?研?告?太?撐?寞?MPP?Greenplum?模?割?的?太?告?太?割?24?|?10?研?l?研?的?的?的?的?25?|?11?2.1.3 數據時效性要求提升,數據基礎設施查詢性能受限?T+1?T+0?研導?研?研?OLAP?撐練?告?研?研?SQL-on-Hadoop?研?OLAP撐練?26?|?12?研?研?Hive?SparkSQL?MPP?空?ODS?研?研?研?DWD?研?DWS?研?ADS?研?/DM?研?務?ADS?DM?研 API?研?研?研?T+1?模?研?研?割?研?研?務?Oracle?DB2?研?研?研?PB?告?研?T+1?研?研
11、務?告?研?SQL?10?研?研?l?撐練?撐練?SIMD?PB?研?MPP?SQL-on-Hadoop?研?撐練?研?27?|?13?2.1.4 智能化場景逐步成熟,數據基礎設施 AI 支持能力不足?導?導?研?研?封?研?研?研?研?封?研?務?In-Database?告?AI?AI?AI?AI?28?|?14?研?l?AutoML?去?AI?研?研?研?封?AI?2.2?研?研?去?務?去?研?去?研?研?29?|?2.2.1 云數據平臺的定義?研?去?研?ACID?SQL?Hadoop?的?撐練?封?15?l?研?的?的?研?的?l?的?的?的?研?30?|?l?ACIDACID?SQ
12、LSQL?HadoopHadoop?模?SQL?ACID?寞?Oracle?DB2?研?MPP?研?Hive?HDFS?Hadoop?寞?SQL-on-Hadoop?研?研?l?撐練?撐練?PB?研?MPP?SQL-on-Hadoop?研?撐練?研?l?AutoML?AI?AI?AI?封?l?研?研?研?研?研?研?研/?/?研?/?研?研?研?l?研?研?研 API?研?研?API?研?2.2.2 云數據平臺對數字化技術的“有機統一”?去?研?研?研?研?研?研?研?去?31?|?16?研?研?AI?務?研?AI?務?l?務?務?IT?IT?研?l?研?務?研?務?研?研?AI?封?研?務?
13、32?|?l?AIAI?務?務?AI?研?研?研?AI?17?2.2.3 以云數據平臺為核心的企業數字化轉型方案?研?研?Snowflake?2020?9?17?700?2020?11?Snowflake?830?33?|?研?EMC?研?去?研?Oushu?Database?研?研?去?研?Oushu?Database?研?Oushu?Lava?Oushu?LittleBoy?模?研?務?18?l?去?研?去?研?Oushu?DatabaseOushu?Database?Oushu?Database?OushuDB?去?研?ANSI-SQL?ACID?Hadoop?Oracle?Greenp
14、lum?Database?PostgreSQL?Hadoop?的?OushuDB?研?研務?研?34?|?去 SIMD?5-10?PB?研?BI?AI?l?研?研?Oushu?LavaOushu?Lava?Oushu?Lava?研?研?研?封?研?研?研?封?l?Oushu?LittleBoyOushu?LittleBoy?Oushu?LittleBoy?Oushu?LittleBoy?AutoML?務?割?研?去?務?35?|?36?|?3.?研?務?2.2.2?研?研?AI?告?研?務?模?夠?1.1 務?夠?夠?去?19?37?|?3.1?夠?愿?20?夠?l?封?研?l?務?夯?研?研
15、?BI?38?|?l?研?研?研?研?研?l?研?研?研?研?夠?schema?愿?研?割?研?研?割?研?研?務?l BIBI?BI?BI?BI?l?AI?AI?AI?太?空?AI?AI?封?研?務?l?愿?l?研?研?研?研?研?研?研?l?研?研?研?研?研?研?研?研?l?研?研?研?研?研?研?務?務?39?|?夠?愿?夠?3.2?夠?務?夯?21?務?研?研?研?研?40?|?l?研?研?研?研?T+1 模?的?研?PB?PB?l?研?研?研?研?研?研?太?研?研?研?l?研?研?研?研?研?研?研?l?研?研?研?研?研?研?研?割?l?l?AI?AI?研?AI?AI?AI?A
16、I?AI?封?AI?研?3.3?&?務?封?務?模?割?告?割?務?模?撐?41?|?22?&?研?l?IT?模?l?研?l?研?研?研?研?BI?務?研?l?研?研?研?研?研?研?研?l?研?研?ETL?研?研?Oushu?Lava?OushuDB?研?去 Hive?空?PB?研?撐練?模?42?|?l?研?研?研?研?研?太?研?研?研?研?研?研?l?研?研?研?研?研?研?研?愿?l AIAI?AI?AI?/?AI?AI?AI?研?LittleBoy?模?導?封?3.4?去?模?撐?去?確?23?研?夠?封?43?|?撐?撐?導?撐?封?割?去?去?去?撐?研?研?研?AI?去?確?
17、確?導?撐?44?|?45?|?4.?4.1?12?盡?2016?2019?套?13?A+H?2019?19?260?務?封?太?研?封?研?研?割?務?導?導?研?模?研?l Oracle?DB2?研?TB?研?ETL?研?l ODS?研?研?研?研?研?研?研?研?研?研?研?封?封?l?太?空?46?|?研?l?研?研?l?研?研?研?模?研?l?研?研?l?太?空?務?研?研?研?研?模?24?研?l?Oushu?Lava?HDFS?OushuDB?研?去 Oracle?DB2?研?PB?研?的?研?研?l?Lava?研?研?模?研?研?研?l?LittleBoy?模?導?導?封?47
18、?|?l?Lava?研?研?AI?封?研?AI?Rest?API?撐?撐?l Oushu?Lava?封?研?研?l OushuDB?研?研?l LittleBoy?4.2?盡?2018?盡?盡?7684?6463?4?盡?17?500?2003?290?2019?51?12?500?盡?盡?2003?12?2007?1?A?盡?盡?8?盡?1?盡?2016?封?盡?封?封?盡?48?|?盡?研?割?研?研?研?研?研?研?盡?務?去?研?盡?研?l?SQL?Server?Oracle?研?PB?研?ETL?研?l?研?練?研?研?割?研?l?太?空?告?封?/?研?盡?研?l?盡?割?研?研?
19、研?l?盡?研?研?研?研?l?研?研?l?研?研?AI?模?盡?務?研?研?研?研?研?研?盡模?夠?49?|?25?研?l?Ouhshu?Lava?OushuDB?研?去 SQL?Server?Oracle?研?PB?研?的?研?研?l?Lava?研?研?模?研?研?研?l?Lava?模?l?Lava?研?研?AI?封?研?AI?Rest?API?撐?撐?盡?l Oushu?Lava?研?研?研?l OushuDB?研?SQL?Server?Oracle?研?50%?50?|?4.3?31?盡?務?500?研?資?GSM?WCDMA?FDD-LTE?研?練?2019?1000?107?98
20、?送?送?封?研?1+2?研?研?+?+?研?研?研?的?研?封?導?研?研?l?研?Hadoop?Hive?2000?PB?研?ETL?研?5G?封?研?TB?51?|?l Hadoop?Hive?研?Hive?割?PB?研?T+3?研?割?研?l?研?務?研?研?l?太?空?研?l?T+1 模?的?研?-?PB?PB?l?研?告?l?研?模?研?研?l?太?空?封?盡?務?研?研?研?研?研?模?夠?52?|?26?研?l?Oushu?Lava?HDFS?Hive?研?OushuDB?研?去 Hive?空?PB?研?Hive?撐練?模?l?Lava?研?研?模?研?研?AI?Rest?API?l?LittleBoy?模?導?封?l?Lava?空?撐?撐?l OushuDB?Hive?研?T+1?l LittleBoy?l Oushu?Lava?研?研?研?研?研?研?研?封?53?|?&?54?|?務?務?務?55?|?&?研?研?56?|?務?愿?愿?割?撐?封?撐?告?割?模?務?割?割?割?去?盡 2022?