hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-11989) IntegrationTestLoadAndVerify cannot be configured anymore on distributed mode
Date Tue, 16 Sep 2014 08:43:34 GMT
Enis Soztutar created HBASE-11989:
-------------------------------------

             Summary: IntegrationTestLoadAndVerify cannot be configured anymore on distributed
mode
                 Key: HBASE-11989
                 URL: https://issues.apache.org/jira/browse/HBASE-11989
             Project: HBase
          Issue Type: Bug
          Components: test
            Reporter: Enis Soztutar
            Assignee: Enis Soztutar
             Fix For: 2.0.0, 0.98.7, 0.99.1


It seems that ITLoadAndverify now ignores most important parameters for running it in distributed
mode: 

{code}
hbase org.apache.hadoop.hbase.test.IntegrationTestLoadAndVerify -Dloadmapper.backrefs=50 -Dloadmapper.map.tasks=30
-Dloadmapper.num_to_write=10000000 -Dverify.reduce.tasks=30 -Dverify.scannercaching=10000
loadAndVerify
{code}
would still launch a job which writes 2000 keys, and runs with 2 mappers. 

Likely cause: HBASE-11253. 
{code}
diff --git hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
index 390b894..a1da601 100644
--- hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
+++ hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
@@ -123,10 +123,10 @@ public class IntegrationTestLoadAndVerify  extends IntegrationTestBase
 {
     util = getTestingUtil(getConf());
     util.initializeCluster(3);
     this.setConf(util.getConfiguration());
+    getConf().setLong(NUM_TO_WRITE_KEY, NUM_TO_WRITE_DEFAULT / 100);
+    getConf().setInt(NUM_MAP_TASKS_KEY, NUM_MAP_TASKS_DEFAULT / 100);
+    getConf().setInt(NUM_REDUCE_TASKS_KEY, NUM_REDUCE_TASKS_DEFAULT / 10);
     if (!util.isDistributedCluster()) {
-      getConf().setLong(NUM_TO_WRITE_KEY, NUM_TO_WRITE_DEFAULT / 100);
-      getConf().setInt(NUM_MAP_TASKS_KEY, NUM_MAP_TASKS_DEFAULT / 100);
-      getConf().setInt(NUM_REDUCE_TASKS_KEY, NUM_REDUCE_TASKS_DEFAULT / 10);
       util.startMiniMapReduceCluster();
     }
   }
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message