Talkingdata：物聯網大數據的高效處理（44頁）.pdf

1、? ? ?  + ?  TAOS Data, Inc. All rights reserved. ? ? ? ? ? ? ? ?  ?  TAOS Data, Inc. All rights reserved. ?/? ? ?P?S?O?I?  ?  TAOS Data, Inc. All rights reserved. ? ? ? ? ? P? ? e? ?d? ?c? ?S? ?a? ?  ? ? ? ? ? ? ?  ?eag?,? ? ? ?n?n? ? ?Z?r? ?g?b?g?K? ?n?i? E?

2、? ?r?R?d ?B?H?R? ?i?f? ? ? ?Mn?k?Mn? oDi? Z?n?C? ?B ? ?s? ?pS?K? ? ?  TAOS Data, Inc. All rights reserved.  ? ? ?0? ? ? .214?03? ?1? ? ?:? ? ? ? ? ? ? ? ? ? ? ?  TAOS Data, Inc. All rights reserved. ? ?  ?  TAOS Data, Inc. All rights reserved.  ? ? ? ? ? ? ? ? ? ? ? ? ?

3、 ? ? ?  TAOS Data, Inc. All rights reserved.   TAOS Data, Inc. All rights reserved.  ? ? ? ?SQL? ? ? ? ? ? ? ? ? TDengine   TAOS Data, Inc. All rights reserved.  ? Shell: Command Line Interface Visualization Tool Grafana Time-series Data Processing Engine TDengineTDengine An

4、alytics, ML Applications Python/Matlab/R Java/C/C+/Restful IoT Application Telegraf Kafka OPC Data Hub MQTT Server Web Based Management Tool Clustered  u ?0?8?i?D ? ?D?g? ?i?0? u ?n?e? ?2? u ?T? ?1? ?n? ?.? ? ?  TAOS Data, Inc. All rights reserved.  ? u ?p?R?f?B?K?a ? ?r?H?a?kf? ?B?a?

5、 ? u ?S?/?,?0?1/?,d? ?i?K?e?S?K? u ?5?5? ?s?S?K? ?.? ?  TAOS Data, Inc. All rights reserved.  ? u ?+?GV?RT?P?Q?O?A? ? u ?.?r? ? ?,? ? /?1?ua?n?+?.?o?S?hM? L? u ?l?C?t?b? ?tbe?gI?fE?J?b ?5?/?+? u ?y?15?5? ? +? /?u create database demo; use demo; create table t1(ts timestamp, degree float);

6、insert into t1 values(now, 28.5); insert into t1 values(now, 29.0); select * from t1; select avg(degree), count(*) from t1; ?  TAOS Data, Inc. All rights reserved.  /?C?L? ?C?E? ?C? ?P ? ?+? ? ? ?SM ?R? ? ?  ?  TAOS Data, Inc. All rights reserved. ? ?C? ? ?Q?  TAOS Data, Inc

7、. All rights reserved.  ? ?/?/ ?/? ? ? ? ? ? ? ? ?  TAOS Data, Inc. All rights reserved. ? ?  . . .  TAOS Data, Inc. All rights reserved. ? ? (? ?1?0? 2?8?0? ? ? ? ? ? C ? ? ? ? ? ? TDengineTDengine ? Q ? ?E?L? ? ? ? ? ?A? ?N?C? ? ?M? AS?T ?  ? ?%?CDH LZO ? TDengine ? TDengi

8、ne ? ? ? ? ?  TAOS Data, Inc. All rights reserved.  ?  TAOS Data, Inc. All rights reserved. ? ? ? ?+? Telegraf ? ? ? ? ? ? ? ? ? ? ? ? ? ? Telegraf ? ? ? ? ? TDengineTDengine ? ? ? ? ?   TAOS Data, Inc. All rights reserved. ? TDengineTDengine ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?  

9、TAOS Data, Inc. All rights reserved. TDengineTDengine?  ? ? ?I? ?A? ?+? ?A? ? ? A? ? C?HD ?+? ?B?E? ? C?HD +?/? ?  ?  TAOS Data, Inc. All rights reserved.  ?E?I? ? ?n?RA? ?HM?oiJ?e? ?RAD?D?E? ?vB?oi ?t?E? nR?oi? ?L? ?R?,?/?oiK ?y?p?T?K?I?D?  ? ?E?g?T?dP?Q? O h ?/?/? ? ? ? ?

10、?+?C? ?E?,? ? ?a S?dP  TAOS Data, Inc. All rights reserved.  ?  TAOS Data, Inc. All rights reserved.  ? ?e?U? ?a?e? ? ?M?t?M? ?e?M? ?e?e?M?e? ?e?M?P? ? ? ? ? ? ?C?e? ?D?e? ?  ?  TAOS Data, Inc. All rights reserved.  ?  TAOS Data, Inc. All rights reserved. ? ?

11、?  ?  TAOS Data, Inc. All rights reserved. appvnodemnode 1: insert 3: response 2: get meta-data 4: insert 5: ack 6: ack taosc  ? ? ? ?,? ? ? ?  ?  TAOS Data, Inc. All rights reserved.  ?T? ?R? ?K?V ?,? ? ? ?D?B?I? 012345 012345 ?  TAOS Data, Inc. All rights reserve

12、d.     WriteApp    memory disk Commit logVnode FILEFILE Peer Vnode Flush  ?  TAOS Data, Inc. All rights reserved.  ?  TAOS Data, Inc. All rights reserved. ?e? ? ?T? S?g?s? i?i?D? ? ?R?,?n?Td?  ?  TAOS Data, Inc. All rights reserved. u ?4-?8? u ?8?- ?

13、 ?L? B?L? ? u ?8?8?-? ?8?8?  ?  TAOS Data, Inc. All rights reserved. ? create database demo; use demo; create table t1 (ts timestamp, degree float); insert into t1 values(now, 28.5); select * from t1; ? ?  ?  TAOS Data, Inc. All rights reserved. ?(?g?a? ?S?(?l? ?Sl?g?l?i? ?a?M?l?

14、(?a?l?D? ?S?(? ?S? ?S?e?n? m?t?g?c?i?D? ?g?e?(? ?n?,? ?S?b?hh? ?n?s?T?S?  ?  TAOS Data, Inc. All rights reserved. create table thermometer (ts timestamp, degree float) tags(loc binary(20), type int); ? ? create table t1 using thermometer tags(beijing, 1); create table t2 using thermometer

15、tags(beijing, 2); create table t3 using thermometer tags(tianjin, 1); create table t4 using thermometer tags(tianjin, 2); create table t5 using thermometer tags(shanghai,1); ? ? select max(degree), min(degree) from thermometer where loc=beijing or loc=tianjin; ?,?5,  ?  TAOS Data, Inc. All

16、 rights reserved. ?D?l?p?T?vnm?a? w?e1?g? ?r?,? ?vn?t?m?t?m? ?d?o?i?ovn? select avg(degree) from t1 interval(5m); ?s? select avg(degree) from thermometer where loc=beijing interval(5m); ?s?  ? ?  TAOS Data, Inc. All rights reserved. m?,? ? ? ?5? ? ?1?5? ? ?5? ?5? ? ? ?,? ?p?x?c?g?L?o?d?l?r

17、?ut? S?x?lv?L?S?C?l?aAPsle?v?L?D ?D?v?uMnt?x?l? select avg(degree) from thermometer where loc=beijing interval(5m) sliding(1m); ?F?x?l?F?liW? create table d1 as select avg(degree) from thermometer where loc=beijing interval(5m) sliding(1m); ?F?x?f?l?F?liW?C?l?  ?  TAOS Data, Inc. All right

18、s reserved. ?  ?  TAOS Data, Inc. All rights reserved. ?3?1?K?2?DC?1?DC?1?K?A?M ?1?K?DC?P? ? ? ? ? ? ? ? DCT? ? DCT? ? ?  ?C?C?DB?S M?Q?COg?La? ed?, ?/?/?/?B? ? ? ?/?/?H?O M?c? ?  TAOS Data, Inc. All rights reserved.  ?  TAOS Data, Inc. All rights reserved. ? ? ? ? ? ?

19、 ?  TAOS Data, Inc. All rights reserved. ?C? o?b?C?b?C oS?bt?s?d? o:?D?,? ?p? ?p?w? ?V? ?D oS?S?o? o?au?eC?t?Q? ? o?m?t? ?l?Wd o?m?hS?uE?L? B?Wd?  ?  TAOS Data, Inc. All rights reserved. C?t? ?M?s? ?a?Ir? ?t?D?e?s? ? ?  ? ? ? ?  TAOS Data, Inc. All rights reserved. ?C?T?C? ?n? ?g?i? ? ?I? ?D?D?e?D? ?D? ?  ? ?2?.?1?0?1? ?  TAOS Data, Inc. All rights reserved.