hbase-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From st...@apache.org
Subject svn commit: r1036376 - in /hbase/branches/0.90/src: docbkx/book.xml main/java/org/apache/hadoop/hbase/mapreduce/HRegionPartitioner.java
Date Thu, 18 Nov 2010 09:58:22 GMT
Author: stack
Date: Thu Nov 18 09:58:21 2010
New Revision: 1036376

URL: http://svn.apache.org/viewvc?rev=1036376&view=rev
Log:
Add pointer to Aaron blog on ulimit.  Add note to hregionpartitioner about it not being suitable
for incremental bulk load

Modified:
    hbase/branches/0.90/src/docbkx/book.xml
    hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/mapreduce/HRegionPartitioner.java

Modified: hbase/branches/0.90/src/docbkx/book.xml
URL: http://svn.apache.org/viewvc/hbase/branches/0.90/src/docbkx/book.xml?rev=1036376&r1=1036375&r2=1036376&view=diff
==============================================================================
--- hbase/branches/0.90/src/docbkx/book.xml (original)
+++ hbase/branches/0.90/src/docbkx/book.xml Thu Nov 18 09:58:21 2010
@@ -336,6 +336,11 @@ Usually you'll want to use the latest ve
       will up the file descriptors for a user but for whatever reason,
       HBase is running as some other users.  HBase prints in its logs
       as the first line the ulimit its seeing.  Ensure its whats expected.
+    <footnote>
+    <para>A useful read setting config on you hadoop cluster isAaron Kimballs'
+    <link xlink:ref="http://www.cloudera.com/blog/2009/03/configuration-parameters-what-can-you-just-ignore/">Configuration
Parameters: What can you just ignore?</link>
+    </para>
+    </footnote>
       </para>
         <section xml:id="ulimit_ubuntu">
           <title><varname>ulimit</varname> on Ubuntu</title>

Modified: hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/mapreduce/HRegionPartitioner.java
URL: http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/mapreduce/HRegionPartitioner.java?rev=1036376&r1=1036375&r2=1036376&view=diff
==============================================================================
--- hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/mapreduce/HRegionPartitioner.java
(original)
+++ hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/mapreduce/HRegionPartitioner.java
Thu Nov 18 09:58:21 2010
@@ -36,6 +36,11 @@ import org.apache.hadoop.mapreduce.Parti
  * Keys are grouped according to the regions that currently exist
  * so that each reducer fills a single region so load is distributed.
  *
+ * <p>This class is not suitable as partitioner creating hfiles
+ * for incremental bulk loads as region spread will likely change between time of
+ * hfile creation and load time. See {@link LoadIncrementalHFiles}
+ * and <a href="http://hbase.apache.org/docs/current/bulk-loads.html">Bulk Load</a>.
+ *
  * @param <KEY>  The type of the key.
  * @param <VALUE>  The type of the value.
  */



Mime
View raw message