hbase-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From st...@apache.org
Subject svn commit: r1188434 - in /hbase/trunk: CHANGES.txt src/docbkx/configuration.xml src/main/resources/hbase-default.xml
Date Mon, 24 Oct 2011 22:56:56 GMT
Author: stack
Date: Mon Oct 24 22:56:56 2011
New Revision: 1188434

URL: http://svn.apache.org/viewvc?rev=1188434&view=rev
HBASE-4656 Note how dfs.support.append has to be enabled in clusters


Modified: hbase/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/hbase/trunk/CHANGES.txt?rev=1188434&r1=1188433&r2=1188434&view=diff
--- hbase/trunk/CHANGES.txt (original)
+++ hbase/trunk/CHANGES.txt Mon Oct 24 22:56:56 2011
@@ -686,6 +686,8 @@ Release 0.92.0 - Unreleased
    HBASE-2196  Support more than one slave cluster (Lars Hofhansl)
    HBASE-4429  Provide synchronous balanceSwitch()
    HBASE-4437  Update hadoop in 0.92 (0.20.205?)
+   HBASE-4656  Note how dfs.support.append has to be enabled in
+               clusters
    HBASE-2001  Coprocessors: Colocate user code with regions (Mingjie Lai via

Modified: hbase/trunk/src/docbkx/configuration.xml
URL: http://svn.apache.org/viewvc/hbase/trunk/src/docbkx/configuration.xml?rev=1188434&r1=1188433&r2=1188434&view=diff
--- hbase/trunk/src/docbkx/configuration.xml (original)
+++ hbase/trunk/src/docbkx/configuration.xml Mon Oct 24 22:56:56 2011
@@ -215,7 +215,18 @@ to ensure well-formedness of your docume
         <code>sync</code>. Hadoop 0.20.2, Hadoop, and Hadoop
 	DO NOT have this attribute.
         Currently only Hadoop versions or any release in excess of this
-        version has a durable sync
+        version has a durable sync.  You have to explicitly enable it though by
+        setting <varname>dfs.support.append</varname> equal to true on both
+        the client side -- in <filename>hbase-site.xml</filename> though it should
+        be on in your <filename>base-default.xml</filename> file -- and on the
+        serverside in <filename>hdfs-site.xml</filename> (You will have to restart
+        your cluster after setting this configuration).  Ignore the chicken-little
+        comment you'll find in the <filename>hdfs-site.xml</filename> in the
+        description for this configuration; it says it is not enabled because there
+        are <quote>... bugs in the 'append code' and is not supported in any production
+        cluster.</quote> because it is not true (I'm sure there are bugs but the
+        append code has been running in production at large scale deploys and is on
+        by default in the offerings of hadoop by commercial vendors)
         <footnote><para>Until recently only the
         <link xlink:href="http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20-append/">branch-0.20-append</link>
         branch had a working sync but no official release was ever made from this branch.
@@ -226,7 +237,7 @@ to ensure well-formedness of your docume
     <footnote><para>Praveen Kumar has written
             a complimentary article,
             <link xlink:href="http://praveen.kumar.in/2011/06/20/building-hadoop-and-hbase-for-hbase-maven-application-development/">Building
Hadoop and HBase for HBase Maven application development</link>.
+</para></footnote><footnote>Cloudera have <varname>dfs.support.append</varname>
set to true by default.</footnote>.</para>
 <para>Or use the
     <link xlink:href="http://www.cloudera.com/">Cloudera</link> or

Modified: hbase/trunk/src/main/resources/hbase-default.xml
URL: http://svn.apache.org/viewvc/hbase/trunk/src/main/resources/hbase-default.xml?rev=1188434&r1=1188433&r2=1188434&view=diff
--- hbase/trunk/src/main/resources/hbase-default.xml (original)
+++ hbase/trunk/src/main/resources/hbase-default.xml Mon Oct 24 22:56:56 2011
@@ -734,4 +734,13 @@
       simplify coprocessor failure analysis.
+  <property>
+    <name>dfs.support.append</name>
+    <value>true</value>
+    <description>Does HDFS allow appends to files?
+    This is an hdfs config. set in here so the hdfs client will do append support.
+    You must ensure that this config. is true serverside too when running hbase
+    (You will have to restart your cluster after setting it).
+  </description>

View raw message