kylin-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lid...@apache.org
Subject svn commit: r1815406 - in /kylin/site: docs21/install/kylin_aws_emr.html feed.xml
Date Thu, 16 Nov 2017 03:18:45 GMT
Author: lidong
Date: Thu Nov 16 03:18:45 2017
New Revision: 1815406

URL: http://svn.apache.org/viewvc?rev=1815406&view=rev
Log:
Update Kylin EMR document to add hbase.rpc.timeout

Modified:
    kylin/site/docs21/install/kylin_aws_emr.html
    kylin/site/feed.xml

Modified: kylin/site/docs21/install/kylin_aws_emr.html
URL: http://svn.apache.org/viewvc/kylin/site/docs21/install/kylin_aws_emr.html?rev=1815406&r1=1815405&r2=1815406&view=diff
==============================================================================
--- kylin/site/docs21/install/kylin_aws_emr.html (original)
+++ kylin/site/docs21/install/kylin_aws_emr.html Thu Nov 16 03:18:45 2017
@@ -3204,6 +3204,25 @@
 
 <p>You can select “HDFS” or “S3” as the storage for HBase, depending
on whether you need Cube data be persisted after shutting down the cluster. EMR HDFS uses
the local disk of EC2 instances, which will erase the data when cluster is stopped, then Kylin
metadata and Cube data can be lost.</p>
 
+<p>If you use “S3” as HBase’s storage, you need customize its configuration
for “hbase.rpc.timeout”, because the bulk load to S3 is a copy operation, when data
size is huge, HBase region server need wait much longer time than on HDFS to finish.</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>[  {
+    "Classification": "hbase-site",
+    "Properties": {
+      "hbase.rpc.timeout": "3600000",
+      "hbase.rootdir": "s3://yourbucket/EMRROOT"
+    }
+  },
+  {
+    "Classification": "hbase",
+    "Properties": {
+      "hbase.emr.storageMode": "s3"
+    }
+  }
+]
+</code></pre>
+</div>
+
 <h3 id="install-kylin">Install Kylin</h3>
 
 <p>When EMR cluser is in “Waiting” status, you can SSH into its master  node,
download Kylin and then uncompress the tar ball:</p>

Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1815406&r1=1815405&r2=1815406&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Thu Nov 16 03:18:45 2017
@@ -19,8 +19,8 @@
     <description>Apache Kylin Home</description>
     <link>http://kylin.apache.org/</link>
     <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
-    <pubDate>Tue, 14 Nov 2017 05:59:23 -0800</pubDate>
-    <lastBuildDate>Tue, 14 Nov 2017 05:59:23 -0800</lastBuildDate>
+    <pubDate>Wed, 15 Nov 2017 19:16:44 -0800</pubDate>
+    <lastBuildDate>Wed, 15 Nov 2017 19:16:44 -0800</lastBuildDate>
     <generator>Jekyll v2.5.3</generator>
     
       <item>



Mime
View raw message