falcon-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From venkat...@apache.org
Subject [2/8] incubator-falcon git commit: FALCON-744 Document existing falcon data archival to cloud store. Contributed by Venkatesh Seetharam
Date Fri, 14 Nov 2014 02:54:47 GMT
FALCON-744 Document existing falcon data archival to cloud store. Contributed by Venkatesh
Seetharam


Project: http://git-wip-us.apache.org/repos/asf/incubator-falcon/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-falcon/commit/839d2507
Tree: http://git-wip-us.apache.org/repos/asf/incubator-falcon/tree/839d2507
Diff: http://git-wip-us.apache.org/repos/asf/incubator-falcon/diff/839d2507

Branch: refs/heads/master
Commit: 839d25077982699af5ee0167eece027d79e889bf
Parents: 40c3e94
Author: Venkatesh Seetharam <venkatesh@apache.org>
Authored: Thu Nov 13 17:52:17 2014 -0800
Committer: Venkatesh Seetharam <venkatesh@apache.org>
Committed: Thu Nov 13 17:52:17 2014 -0800

----------------------------------------------------------------------
 CHANGES.txt                                   |  3 +++
 docs/src/site/twiki/FalconDocumentation.twiki | 22 ++++++++++++++++++++++
 2 files changed, 25 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-falcon/blob/839d2507/CHANGES.txt
----------------------------------------------------------------------
diff --git a/CHANGES.txt b/CHANGES.txt
index 896116b..f313e63 100755
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -41,6 +41,9 @@ Trunk (Unreleased)
    FALCON-263 API to get workflow parameters. (pavan kumar kolamuri via Shwetha GS)
 
   IMPROVEMENTS
+   FALCON-744 Document existing falcon data archival to cloud store
+   (Venkatesh Seetharam)
+
    FALCON-869 Clean up required in the instance API calls. (Suhas Vasu)
 
    FALCON-878 Move falcon html files to HTML5. (Ajay Yadav via Srikanth Sundarrajan)

http://git-wip-us.apache.org/repos/asf/incubator-falcon/blob/839d2507/docs/src/site/twiki/FalconDocumentation.twiki
----------------------------------------------------------------------
diff --git a/docs/src/site/twiki/FalconDocumentation.twiki b/docs/src/site/twiki/FalconDocumentation.twiki
index 722a3bf..17dc25c 100644
--- a/docs/src/site/twiki/FalconDocumentation.twiki
+++ b/docs/src/site/twiki/FalconDocumentation.twiki
@@ -370,6 +370,28 @@ such as schema, storage format, etc.
 cluster, (no dirty reads)
 
 
+---+++ Archival as Replication
+
+Falcon allows users to archive data from on-premice to cloud, either Azure WASB or S3.
+It uses the underlying replication for archiving data from source to target. The archival
URI is
+specified as the overridden location for the target cluster.
+
+*Example:*
+<verbatim>
+    <clusters>
+        <cluster name="on-premise-cluster" type="source">
+            <validity start="2021-11-01T00:00Z" end="2021-12-31T00:00Z"/>
+        </cluster>
+        <cluster name="cloud-cluster" type="target">
+            <validity start="2011-11-01T00:00Z" end="2011-12-31T00:00Z"/>
+            <locations>
+                <location type="data"
+                          path="wasb://test@blah.blob.core.windows.net/data/${YEAR}-${MONTH}-${DAY}-${HOUR}"/>
+            </locations>
+        </cluster>
+    </clusters>
+</verbatim>
+
 ---+++ Relation between feed's retention limit and feed's late arrival cut off period:
 
 For reasons that are obvious, Falcon has an external validation that ensures that the user


Mime
View raw message