hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeffrey Zhong (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-9775) Client write path perf issues
Date Fri, 18 Oct 2013 04:04:49 GMT

     [ https://issues.apache.org/jira/browse/HBASE-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jeffrey Zhong updated HBASE-9775:

    Attachment: hbase-9775.patch

I think I found one bug in the AsyncProcess hurts performance. Below is the code snippet:
      incTaskCounters(multiAction.getRegions(), loc.getServerName());
      Runnable runnable = Trace.wrap("AsyncProcess.sendMultiAction", new Runnable() {
            receiveMultiAction(initialActions, multiAction, loc, res, numAttempt, errorsByServer);
          } finally {
            decTaskCounters(multiAction.getRegions(), loc.getServerName());
Because receiveMultiAction use recursive way to resubmit failure edits. Therefore, we double
bump up the TaskCounter when error happens and the overlap timing is a retry internal which
is quite long time for client operations.

I attached a patch for your reference.

> Client write path perf issues
> -----------------------------
>                 Key: HBASE-9775
>                 URL: https://issues.apache.org/jira/browse/HBASE-9775
>             Project: HBase
>          Issue Type: Bug
>          Components: Client
>    Affects Versions: 0.96.0
>            Reporter: Elliott Clark
>            Priority: Critical
>         Attachments: Charts Search   Cloudera Manager - ITBLL.png, Charts Search   Cloudera
Manager.png, hbase-9775.patch, job_run.log, short_ycsb.png, ycsb_insert_94_vs_96.png
> Testing on larger clusters has not had the desired throughput increases.

This message was sent by Atlassian JIRA

View raw message