kylin-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From liy...@apache.org
Subject [10/12] incubator-kylin git commit: doc for Kylin 0.7 Lambda Architecture
Date Fri, 03 Apr 2015 03:40:48 GMT
doc for Kylin 0.7 Lambda Architecture


Project: http://git-wip-us.apache.org/repos/asf/incubator-kylin/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-kylin/commit/77647fab
Tree: http://git-wip-us.apache.org/repos/asf/incubator-kylin/tree/77647fab
Diff: http://git-wip-us.apache.org/repos/asf/incubator-kylin/diff/77647fab

Branch: refs/heads/master
Commit: 77647fabcad502684ba18eaf399323634aa4af3c
Parents: fdbf549
Author: liyang@apache.org <yangli9@D-SHC-00801746.corp.ebay.com>
Authored: Fri Apr 3 04:24:35 2015 +0100
Committer: liyang@apache.org <yangli9@D-SHC-00801746.corp.ebay.com>
Committed: Fri Apr 3 04:24:35 2015 +0100

----------------------------------------------------------------------
 docs/TechInside/Kylin 0.7 Lambda Architecture.md  |  12 ++++++++++++
 docs/TechInside/Kylin_0.7_Lambda_Architecture.png | Bin 0 -> 56204 bytes
 2 files changed, 12 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-kylin/blob/77647fab/docs/TechInside/Kylin
0.7 Lambda Architecture.md
----------------------------------------------------------------------
diff --git a/docs/TechInside/Kylin 0.7 Lambda Architecture.md b/docs/TechInside/Kylin 0.7
Lambda Architecture.md
new file mode 100644
index 0000000..9ee40bc
--- /dev/null
+++ b/docs/TechInside/Kylin 0.7 Lambda Architecture.md	
@@ -0,0 +1,12 @@
+Kylin 0.7 Lambda Architecture
+===
+
+Start from 0.7, Kylin adopts a [Lambda Architecture](http://en.wikipedia.org/wiki/Lambda_architecture)
to support near real-time analysis from streaming input.
+
+* Data is separated into Young and Aged.
+* The young generation is batch loaded from streaming (e.g. every minute) and saved in a
real-time storage with inverted index.
+* Aged generation is batch loaded from real-time storage to historic storage daily or hourly.
Aged generation is stored as OLAP cube with pre-calculation.
+* A hybrid storage interface sits on top of the real-time and historic storage, and provides
a view of complete data set for SQL queries.
+* The combination of inverted index and OLAP cube enables subsecond query latencies on near
real-time data with huge history.
+
+![Kylin 0.7 Lambda Architecture](Kylin_0.7_Lambda_Architecture.png)

http://git-wip-us.apache.org/repos/asf/incubator-kylin/blob/77647fab/docs/TechInside/Kylin_0.7_Lambda_Architecture.png
----------------------------------------------------------------------
diff --git a/docs/TechInside/Kylin_0.7_Lambda_Architecture.png b/docs/TechInside/Kylin_0.7_Lambda_Architecture.png
new file mode 100644
index 0000000..df3775d
Binary files /dev/null and b/docs/TechInside/Kylin_0.7_Lambda_Architecture.png differ


Mime
View raw message