Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 750FF949F for ; Sat, 10 Dec 2011 02:25:04 +0000 (UTC) Received: (qmail 76125 invoked by uid 500); 10 Dec 2011 02:25:03 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 76087 invoked by uid 500); 10 Dec 2011 02:25:03 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 76040 invoked by uid 99); 10 Dec 2011 02:25:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 Dec 2011 02:25:03 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 10 Dec 2011 02:25:02 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 4A49C10A824 for ; Sat, 10 Dec 2011 02:24:42 +0000 (UTC) Date: Sat, 10 Dec 2011 02:24:42 +0000 (UTC) From: "Phabricator (Updated) (JIRA)" To: issues@hbase.apache.org Message-ID: <1225432737.61141.1323483882305.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <909767668.28399.1322694820096.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HBASE-4916) LoadTest MR Job MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HBASE-4916: ------------------------------- Attachment: HBASE-4916.D741.1.patch cgist requested code review of "HBASE-4916 [jira] LoadTest MR Job". Reviewers: JIRA MR-based load tester with pluggable workloads This is a new load tester for HBase which supports pluggable workloads and more flexibility in configuring how the load is exercised. This load tester runs as a native map reduce job. Interfaces which define the workloads can be extended for specific testing. The intensity of a load can be controlled by the number of clients, number of threads and desired operations per second. Add a script to start a streaming map-reduce job where each map tasks runs an instance of the load tester for a partition of the key-space. Ensure that the load tester takes a parameter indicating the start key for write operations. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D741 AFFECTED FILES src/main/java/org/apache/hadoop/hbase/loadtest/CompositeOperationGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/DataGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/GetGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/GetOperation.java src/main/java/org/apache/hadoop/hbase/loadtest/KeyCounter.java src/main/java/org/apache/hadoop/hbase/loadtest/MixedWorkloadGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/Operation.java src/main/java/org/apache/hadoop/hbase/loadtest/OperationGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/PutGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/PutOperation.java src/main/java/org/apache/hadoop/hbase/loadtest/PutReGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/RandomDataGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/SeparateWorkloadGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/StatsCollector.java src/main/java/org/apache/hadoop/hbase/loadtest/VersionWorkloadGenerator.java src/main/java/org/apache/hadoop/hbase/loadtest/Workload.java src/main/java/org/apache/hadoop/hbase/mapreduce/Driver.java src/main/java/org/apache/hadoop/hbase/mapreduce/LoadTest.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/1587/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. > LoadTest MR Job > --------------- > > Key: HBASE-4916 > URL: https://issues.apache.org/jira/browse/HBASE-4916 > Project: HBase > Issue Type: Sub-task > Components: client, regionserver > Reporter: Nicolas Spiegelberg > Assignee: Christopher Gist > Fix For: 0.94.0 > > Attachments: HBASE-4916.D741.1.patch > > > Add a script to start a streaming map-reduce job where each map tasks runs an instance of the load tester for a partition of the key-space. Ensure that the load tester takes a parameter indicating the start key for write operations. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira