cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jbel...@apache.org
Subject svn commit: r944926 - /cassandra/trunk/src/java/org/apache/cassandra/hadoop/ColumnFamilyInputFormat.java
Date Sun, 16 May 2010 22:26:48 GMT
Author: jbellis
Date: Sun May 16 22:26:47 2010
New Revision: 944926

URL: http://svn.apache.org/viewvc?rev=944926&view=rev
Log:
add Collections.shuffle(splits) so Hadoop doesn't send all the jobs to the same nodes at once.
 patch by Joost Ouwerkerk; reviewed by jbellis for CASSANDRA-1096

Modified:
    cassandra/trunk/src/java/org/apache/cassandra/hadoop/ColumnFamilyInputFormat.java

Modified: cassandra/trunk/src/java/org/apache/cassandra/hadoop/ColumnFamilyInputFormat.java
URL: http://svn.apache.org/viewvc/cassandra/trunk/src/java/org/apache/cassandra/hadoop/ColumnFamilyInputFormat.java?rev=944926&r1=944925&r2=944926&view=diff
==============================================================================
--- cassandra/trunk/src/java/org/apache/cassandra/hadoop/ColumnFamilyInputFormat.java (original)
+++ cassandra/trunk/src/java/org/apache/cassandra/hadoop/ColumnFamilyInputFormat.java Sun
May 16 22:26:47 2010
@@ -120,7 +120,7 @@ public class ColumnFamilyInputFormat ext
         }
 
         assert splits.size() > 0;
-        
+        Collections.shuffle(splits, new Random(System.nanoTime()));
         return splits;
     }
 



Mime
View raw message