2019年使用TiDB進行實時數據分析.pdf

《2019年使用TiDB進行實時數據分析.pdf》由會員分享，可在線閱讀，更多相關《2019年使用TiDB進行實時數據分析.pdf（34頁珍藏版）》請在三個皮匠報告上搜索。

1、?TiDB?About Me?PingCAP?BigData Infra Team Lead?SQL on Hadoop?Data Sink?SQL?OLTP DBsServer EventsBI ToolsWeb Console?NoSQL?Hadoop?RDBMS?NoSQL?Update?DBA?Icon credit to Recep Kutuk,becris,K?Merge DeltaUnified ViewRefinedDatavs?TiDBTiDB?MySQL?SQL?ACID?TiDB?TiDBTiDBTiKV Cluster(Storage)MetadataTiKVTiKVT

2、iKVMySQL ClientsSyncerTiKVTiDBTSO/Data locationTiDB ClusterTiDB.DistSQL APIPDPDPD ClusterTiKVTiKVTiDBPD?Multi-Raft?Raft?/?RocksDB InstanceRegion 1:a-eRegion 3:k-oRegion 5:u-z.Region 4:p-tRocksDB InstanceRegion 1:a-eRegion 2:f-jRegion 4:p-t.Region 3:k-oRocksDB InstanceRegion 2:f-jRegion 5:u-zRegion 3

3、:k-o.RocksDB InstanceRegion 1:a-eRegion 2:f-jRegion 5:u-z.Region 4:p-tRaft group?CoprocessorTransactionMVCCRaftRocksDB?MySQL 5.7 MySQL 8.0?SQL?Schema?JSON?DBA?Maybe yes,maybe no?TiDB?SQL?Ad Hoc Query?Join?SQL?Data Science/Machine Learning?Hadoop?TiDB?TiSparkTiSpark?TiDB?Apache Spark?Apache Spark?Apa

4、che Zeppelin?Hive?R?TiDB?Join?TiDB?WIP?TiSparkSpark ExecSpark ExecSpark DriverSpark ExecTiKVTiKVTiKVTiKVTiSparkTiSparkTiSparkTiSparkTiKVPlacement Driver(PD)gRPCDistributed Storage LayergRPCretrieve data locationretrieve data from TiKV?DBA?Icon credit to Recep K?Maybe yes,maybe no?TiDB?IO?TiDB+TiSpar

5、k?/?/?T?V?/?L?A?C?/?F?A?/?F?V?R?M?P?EBTiFlashTiDBTiDBRegion 1TiKV Node 1Store 1Region 2Region 3Region 4Region 2TiKV Node 3Store 3Region 3Region 4Region 1Region 4TiKV Node 2Store 2Region 3Region 2Region 1TiFlash Node 1TiFlash Node 2TiFlash Extension ClusterTiKV ClusterTiSparkWorkerTiSparkWorker43?TiDBTiFlash?44?C?TiDBTiFlash?C?Why TiFlash here?+?DBA?Icon credit to Recep Kwith TiFlash ExtensionEverything comes with a price?NoSQL?TiDB?Hadoop?Hadoop?PB?Hadoop?/?-?Binlog?TiDB?MySQL?SQL?Spark?-?Thank You!