hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-4916) LoadTest MR Job
Date Sat, 10 Dec 2011 02:24:42 GMT

     [ https://issues.apache.org/jira/browse/HBASE-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Phabricator updated HBASE-4916:
-------------------------------

    Attachment: HBASE-4916.D741.1.patch

cgist requested code review of "HBASE-4916 [jira] LoadTest MR Job".
Reviewers: JIRA

  MR-based load tester with pluggable workloads

  This is a new load tester for HBase which supports pluggable workloads
  and more flexibility in configuring how the load is exercised. This load
  tester runs as a native map reduce job. Interfaces which define the
  workloads can be extended for specific testing. The intensity of a load
  can be controlled by the number of clients, number of threads and
  desired operations per second.

  Add a script to start a streaming map-reduce job where each map tasks runs an instance of
the load tester for a partition of the key-space. Ensure that the load tester takes a parameter
indicating the start key for write operations.

TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D741

AFFECTED FILES
  src/main/java/org/apache/hadoop/hbase/loadtest/CompositeOperationGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/DataGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/GetGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/GetOperation.java
  src/main/java/org/apache/hadoop/hbase/loadtest/KeyCounter.java
  src/main/java/org/apache/hadoop/hbase/loadtest/MixedWorkloadGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/Operation.java
  src/main/java/org/apache/hadoop/hbase/loadtest/OperationGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/PutGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/PutOperation.java
  src/main/java/org/apache/hadoop/hbase/loadtest/PutReGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/RandomDataGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/SeparateWorkloadGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/StatsCollector.java
  src/main/java/org/apache/hadoop/hbase/loadtest/VersionWorkloadGenerator.java
  src/main/java/org/apache/hadoop/hbase/loadtest/Workload.java
  src/main/java/org/apache/hadoop/hbase/mapreduce/Driver.java
  src/main/java/org/apache/hadoop/hbase/mapreduce/LoadTest.java

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/1587/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.

                
> LoadTest MR Job
> ---------------
>
>                 Key: HBASE-4916
>                 URL: https://issues.apache.org/jira/browse/HBASE-4916
>             Project: HBase
>          Issue Type: Sub-task
>          Components: client, regionserver
>            Reporter: Nicolas Spiegelberg
>            Assignee: Christopher Gist
>             Fix For: 0.94.0
>
>         Attachments: HBASE-4916.D741.1.patch
>
>
> Add a script to start a streaming map-reduce job where each map tasks runs an instance
of the load tester for a partition of the key-space. Ensure that the load tester takes a parameter
indicating the start key for write operations.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message