accumulo-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ktur...@apache.org
Subject svn commit: r1428577 - /accumulo/trunk/bin/bootstrap_hdfs.sh
Date Thu, 03 Jan 2013 20:34:03 GMT
Author: kturner
Date: Thu Jan  3 20:34:03 2013
New Revision: 1428577

URL: http://svn.apache.org/viewvc?rev=1428577&view=rev
Log:
ACCUMULO-865 adjusted replication in bootstrap script

Modified:
    accumulo/trunk/bin/bootstrap_hdfs.sh

Modified: accumulo/trunk/bin/bootstrap_hdfs.sh
URL: http://svn.apache.org/viewvc/accumulo/trunk/bin/bootstrap_hdfs.sh?rev=1428577&r1=1428576&r2=1428577&view=diff
==============================================================================
--- accumulo/trunk/bin/bootstrap_hdfs.sh (original)
+++ accumulo/trunk/bin/bootstrap_hdfs.sh Thu Jan  3 20:34:03 2013
@@ -50,13 +50,21 @@ fi
 # Replicate to all slaves to avoid network contention on startup
 #
 NUM_SLAVES=`wc -l $ACCUMULO_HOME/conf/slaves | grep -P '^\d+(?= )' -o`
-$HADOOP_HOME/bin/hadoop fs -setrep -R $NUM_SLAVES $SYSTEM_CONTEXT_HDFS_DIR  > /dev/null
+
+#let each datanode service around 50 clients
+let "REP=$NUM_SLAVES/50"
+
+if [ $REP -lt 3 ]; then
+  REP=3
+fi
 
 #
 # Copy all jars in lib to the system context directory
 #
 hadoop fs -moveFromLocal $ACCUMULO_HOME/lib/*.jar $SYSTEM_CONTEXT_HDFS_DIR  > /dev/null
 
+$HADOOP_HOME/bin/hadoop fs -setrep -R $REP $SYSTEM_CONTEXT_HDFS_DIR  > /dev/null
+
 #
 # We need two of the jars in lib, copy them back out and remove them from the system context
dir
 #



Mime
View raw message