Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-dev@hadoop.apache.org
Message-ID: <1815842705.1229114744416.JavaMail.jira@brutus>
Date: Fri, 12 Dec 2008 12:45:44 -0800 (PST)
From: "Jonathan Gray (JIRA)" <jira@apache.org>
To: hbase-dev@hadoop.apache.org
Subject: [jira] Updated: (HBASE-1057) Example MR jobs to simulate bulk
 importing
In-Reply-To: <519721255.1229114144419.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HBASE-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray updated HBASE-1057:
---------------------------------

    Attachment: ImportTestMR_v1.java

MR job with tweakable parameters that bulk uploads rows with fixed-length and variable-length columns and values.

Currently requires a single line HDFS file as input and an HBase table that exists as output, though this uses the API directly and not TOF.  Someone better with MR might be able to remove these two requirements.

There are some commented out lines in the case that you want to use write batching.

Can be easily modified to use TOF instead.

> Example MR jobs to simulate bulk importing
> ------------------------------------------
>
>                 Key: HBASE-1057
>                 URL: https://issues.apache.org/jira/browse/HBASE-1057
>             Project: Hadoop HBase
>          Issue Type: New Feature
>            Reporter: Jonathan Gray
>            Assignee: Jonathan Gray
>            Priority: Trivial
>         Attachments: ImportTestMR_v1.java
>
>
> It's very useful to have standalone MR jobs that simulate production system load characteristics.  Specifically bulk importing as this has been uncovering OOME and long-running compaction issues.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.