hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hiroshi Ikeda (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15971) Regression: Random Read/WorkloadC slower in 1.x than 0.98
Date Wed, 15 Jun 2016 02:58:36 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15331029#comment-15331029
] 

Hiroshi Ikeda commented on HBASE-15971:
---------------------------------------

I meant LinkedTransferQueue implements BlockingQueue efficiently for simultaneous puts/takes.
TransferQueue adds extra methods, but I forget the details.

Anyway, LinkedTransferQueue is unbound, and we should do something or tasks might be queued
unlimitedly, causing out of memory. Even if we could use semaphores for that control, ConcurrentLinkedQueue
will be good enough after all, with more simple implementation (and lighter overhead).

> Regression: Random Read/WorkloadC slower in 1.x than 0.98
> ---------------------------------------------------------
>
>                 Key: HBASE-15971
>                 URL: https://issues.apache.org/jira/browse/HBASE-15971
>             Project: HBase
>          Issue Type: Sub-task
>          Components: rpc
>    Affects Versions: 2.0.0, 1.3.0
>            Reporter: stack
>            Assignee: stack
>            Priority: Critical
>             Fix For: 2.0.0, 1.3.0
>
>         Attachments: 098.hits.png, 098.png, HBASE-15971.branch-1.001.patch, HBASE-15971.branch-1.002.patch,
Screen Shot 2016-06-10 at 5.08.24 PM.png, Screen Shot 2016-06-10 at 5.08.26 PM.png, branch-1.hits.png,
branch-1.png, flight_recording_10172402220203_28.branch-1.jfr, flight_recording_10172402220203_29.09820.0.98.20.jfr,
handlers.fp.png, hits.fp.png, hits.patched1.0.vs.unpatched1.0.vs.098.png, run_ycsb.sh
>
>
> branch-1 is slower than 0.98 doing YCSB random read/workloadC. It seems to be doing about
1/2 the throughput of 0.98.
> In branch-1, we have low handler occupancy compared to 0.98. Hacking in reader thread
occupancy metric, is about the same in both. In parent issue, hacking out the scheduler, I
am able to get branch-1 to go 3x faster so will dig in here.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message