hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-11989) IntegrationTestLoadAndVerify cannot be configured anymore on distributed mode
Date Tue, 16 Sep 2014 19:23:36 GMT

     [ https://issues.apache.org/jira/browse/HBASE-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Enis Soztutar updated HBASE-11989:
----------------------------------
    Priority: Trivial  (was: Major)

> IntegrationTestLoadAndVerify cannot be configured anymore on distributed mode
> -----------------------------------------------------------------------------
>
>                 Key: HBASE-11989
>                 URL: https://issues.apache.org/jira/browse/HBASE-11989
>             Project: HBase
>          Issue Type: Bug
>          Components: test
>            Reporter: Enis Soztutar
>            Assignee: Enis Soztutar
>            Priority: Trivial
>             Fix For: 2.0.0, 0.98.7, 0.99.1
>
>         Attachments: hbase-11989_v1.patch
>
>
> It seems that ITLoadAndverify now ignores most important parameters for running it in
distributed mode: 
> {code}
> hbase org.apache.hadoop.hbase.test.IntegrationTestLoadAndVerify -Dloadmapper.backrefs=50
-Dloadmapper.map.tasks=30 -Dloadmapper.num_to_write=10000000 -Dverify.reduce.tasks=30 -Dverify.scannercaching=10000
loadAndVerify
> {code}
> would still launch a job which writes 2000 keys, and runs with 2 mappers. 
> Likely cause: HBASE-11253. 
> {code}
> diff --git hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
> index 390b894..a1da601 100644
> --- hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
> +++ hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
> @@ -123,10 +123,10 @@ public class IntegrationTestLoadAndVerify  extends IntegrationTestBase
 {
>      util = getTestingUtil(getConf());
>      util.initializeCluster(3);
>      this.setConf(util.getConfiguration());
> +    getConf().setLong(NUM_TO_WRITE_KEY, NUM_TO_WRITE_DEFAULT / 100);
> +    getConf().setInt(NUM_MAP_TASKS_KEY, NUM_MAP_TASKS_DEFAULT / 100);
> +    getConf().setInt(NUM_REDUCE_TASKS_KEY, NUM_REDUCE_TASKS_DEFAULT / 10);
>      if (!util.isDistributedCluster()) {
> -      getConf().setLong(NUM_TO_WRITE_KEY, NUM_TO_WRITE_DEFAULT / 100);
> -      getConf().setInt(NUM_MAP_TASKS_KEY, NUM_MAP_TASKS_DEFAULT / 100);
> -      getConf().setInt(NUM_REDUCE_TASKS_KEY, NUM_REDUCE_TASKS_DEFAULT / 10);
>        util.startMiniMapReduceCluster();
>      }
>    }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message