hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-15046) Perf test doing all mutation steps under row lock
Date Thu, 21 Jan 2016 00:56:39 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

stack updated HBASE-15046:
    Attachment: patched.workloadw.80percentwrites.json

Just a bit more detail showing that new write path is a little faster than what we had previous
when doing a ycsb loading, a 50/50 and an 80% writes test case. Attached are patched and unpatched
graphs. Also attached are the workloadw json output which shows better latency, more ops for
patched case. Not a significant difference but simpler write path should help going forward.

> Perf test doing all mutation steps under row lock
> -------------------------------------------------
>                 Key: HBASE-15046
>                 URL: https://issues.apache.org/jira/browse/HBASE-15046
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Performance
>            Reporter: stack
>            Assignee: stack
>         Attachments: 1.2.svg, 1.2.v2.svg, 50threads_ycsb.png, all_under_lock.patch, all_under_lock.svg,
call_times_0-1_and_1-3_ycsb.png, compare.png, gc.png, latencies.png, nopatch.png, notpatched.workloadw.80percentwrites.json,
ops.png, patched.png, patched.workloadw.80percentwrites.json, writes.png
> This issue is about perf testing a redo of the write pipeline so that rather than:
> * take rowlock
> * start mvcc
> * append to WAL
> * add to memstore
> * sync WAL
> * let go of rowlock
> * finish up mvcc
> instead.... try...
> * take rowlock
> * start mvcc
> * append to WAL
> * sync WAL
> * add to memstore
> * finish up mvcc
> * let go of rowlock
> The latter is more straight-forward undoing need of rolling back memstore if all does
not succeed.
> It might be slower though. This issue is a look-see/try it.
> The redo will also help address the parent issue in a more general way so we can do without
the special-casing done for branch-1.0 and branch-1.1 done in a sibling subtask.
> Other benefits are that the current write pipeline is copy/pasted in a few places  --
in append, increment and checkand* -- and a refactor will allow us to fix this duplication.

This message was sent by Atlassian JIRA

View raw message