Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9221F114E7 for ; Tue, 16 Sep 2014 08:43:35 +0000 (UTC) Received: (qmail 38112 invoked by uid 500); 16 Sep 2014 08:43:34 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 38024 invoked by uid 500); 16 Sep 2014 08:43:34 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 38010 invoked by uid 99); 16 Sep 2014 08:43:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Sep 2014 08:43:34 +0000 Date: Tue, 16 Sep 2014 08:43:34 +0000 (UTC) From: "Enis Soztutar (JIRA)" To: dev@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HBASE-11989) IntegrationTestLoadAndVerify cannot be configured anymore on distributed mode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Enis Soztutar created HBASE-11989: ------------------------------------- Summary: IntegrationTestLoadAndVerify cannot be configured anymore on distributed mode Key: HBASE-11989 URL: https://issues.apache.org/jira/browse/HBASE-11989 Project: HBase Issue Type: Bug Components: test Reporter: Enis Soztutar Assignee: Enis Soztutar Fix For: 2.0.0, 0.98.7, 0.99.1 It seems that ITLoadAndverify now ignores most important parameters for running it in distributed mode: {code} hbase org.apache.hadoop.hbase.test.IntegrationTestLoadAndVerify -Dloadmapper.backrefs=50 -Dloadmapper.map.tasks=30 -Dloadmapper.num_to_write=10000000 -Dverify.reduce.tasks=30 -Dverify.scannercaching=10000 loadAndVerify {code} would still launch a job which writes 2000 keys, and runs with 2 mappers. Likely cause: HBASE-11253. {code} diff --git hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java index 390b894..a1da601 100644 --- hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java +++ hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java @@ -123,10 +123,10 @@ public class IntegrationTestLoadAndVerify extends IntegrationTestBase { util = getTestingUtil(getConf()); util.initializeCluster(3); this.setConf(util.getConfiguration()); + getConf().setLong(NUM_TO_WRITE_KEY, NUM_TO_WRITE_DEFAULT / 100); + getConf().setInt(NUM_MAP_TASKS_KEY, NUM_MAP_TASKS_DEFAULT / 100); + getConf().setInt(NUM_REDUCE_TASKS_KEY, NUM_REDUCE_TASKS_DEFAULT / 10); if (!util.isDistributedCluster()) { - getConf().setLong(NUM_TO_WRITE_KEY, NUM_TO_WRITE_DEFAULT / 100); - getConf().setInt(NUM_MAP_TASKS_KEY, NUM_MAP_TASKS_DEFAULT / 100); - getConf().setInt(NUM_REDUCE_TASKS_KEY, NUM_REDUCE_TASKS_DEFAULT / 10); util.startMiniMapReduceCluster(); } } {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)