hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-5776) HTableMultiplexer
Date Sat, 22 Dec 2012 22:19:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13538928#comment-13538928
] 

Ted Yu commented on HBASE-5776:
-------------------------------

>From https://builds.apache.org/job/PreCommit-HBASE-Build/3673/testReport/org.apache.hadoop.hbase.client/TestHTableMultiplexer/testHTableMultiplexer/:
{code}
2012-12-22 20:46:24,273 INFO  [pool-1-thread-1] client.TestHTableMultiplexer(93): Flushed
put for  @ iteration 1
...
2012-12-22 20:46:24,383 DEBUG [HTableFlushWorker-asf011.sp2.ygridcore.net:35330-0] client.HTableMultiplexer$HTableFlushWorker(553):
Processed 1 put requests for asf011.sp2.ygridcore.net:35330 and 0 failed, latency for this
send: 208
{code}
We can see that client of HTableMultiplexer didn't get correct indication that the put was
flushed.
                
> HTableMultiplexer 
> ------------------
>
>                 Key: HBASE-5776
>                 URL: https://issues.apache.org/jira/browse/HBASE-5776
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Liyin Tang
>            Assignee: binlijin
>             Fix For: 0.96.0
>
>         Attachments: 5776-trunk-V3.patch, 5776-trunk-V4.patch, 5776-trunk-V5.patch, ASF.LICENSE.NOT.GRANTED--D2775.1.patch,
ASF.LICENSE.NOT.GRANTED--D2775.1.patch, ASF.LICENSE.NOT.GRANTED--D2775.2.patch, ASF.LICENSE.NOT.GRANTED--D2775.2.patch,
ASF.LICENSE.NOT.GRANTED--D2775.3.patch, ASF.LICENSE.NOT.GRANTED--D2775.4.patch, ASF.LICENSE.NOT.GRANTED--D2775.5.patch,
HBASE-5776-trunk.patch, HBASE-5776-trunk-V2.patch
>
>
> There is a known issue in HBase client that single slow/dead region server could slow
down the multiput operations across all the region servers. So the HBase client will be as
slow as the slowest region server in the cluster. 
>  
> To solve this problem, HTableMultiplexer will separate the multiput submitting threads
with the flush threads, which means the multiput operation will be a nonblocking operation.

> The submitting thread will shard all the puts into different queues based on its destination
region server and return immediately. The flush threads will flush these puts from each queue
to its destination region server. 
> Currently the HTableMultiplexer only supports the put operation.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message