incubator-blur-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject [2/3] git commit: Adding some more docs to help deal with some gotchas.
Date Wed, 28 Aug 2013 23:46:55 GMT
Adding some more docs to help deal with some gotchas.


Branch: refs/heads/master
Commit: 3eae6f88b0f9f0b4b10c27385e862b647e190c82
Parents: 83bfb70
Author: Aaron McCurry <>
Authored: Wed Aug 28 15:44:13 2013 -0400
Committer: Aaron McCurry <>
Committed: Wed Aug 28 15:44:13 2013 -0400

 docs/cluster-setup.html | 22 ++++++++++++++++++++++
 1 file changed, 22 insertions(+)
diff --git a/docs/cluster-setup.html b/docs/cluster-setup.html
index 8657acc..36452b5 100644
--- a/docs/cluster-setup.html
+++ b/docs/cluster-setup.html
@@ -216,6 +216,28 @@ export BLUR_NUMBER_OF_CONTROLLER_SERVER_INSTANCES_PER_MACHINE=1</code></pre>
             <div class="page-header">
               <h1 id="shard">Shard Server Configuration</h1>
+<h3>Minimum Settings to Configure</h3>
+It is highly recommended that the ulimits are increase on the server specifically:
+<li>open files</li>
+<li>max user processes</li>
+In Hadoop the dfs.datanode.max.xcievers should be increased to at least 4096 if not more.
+<code class="bash">&lt;property&gt;
+    &lt;name&gt;dfs.datanode.max.xcievers&lt;/name&gt;
+    &lt;value&gt;4096&lt;/value&gt;
+In set the cache memory for the shard processes.  DO NOT over allocate this will

+likely crash your server.
+<pre><code class="bash">-XX:MaxDirectMemorySize=13g</code></pre>
+<div class="bs-callout bs-callout-warning"><h4>Caution</h4>
+Swap can kill java perform, you may want to consider disabling swap.</div>
             <h3 id="shard-blur-site"></h3>
               These are the default settings for the shard server that can be overridden
in the file. Consider increasing the various thread pool counts (*.thread.count).
Also the blur.max.clause.count sets the BooleanQuery max clause count for Lucene queries.

View raw message