hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-9887) Optimize client pause & back-off time
Date Mon, 25 Nov 2013 22:22:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13831983#comment-13831983
] 

stack commented on HBASE-9887:
------------------------------

I did similar test.   Small cluster.  30% of the time we succeeded on first retry, 15% on
second, 10% on 3rd, 5% on 4th, 13% on 5th, 10% on 6th, same on 7th...., 5% on 8th

My findings are different to yours spread more evenly across the retrys (sequentialWriting)

> Optimize client pause & back-off time
> -------------------------------------
>
>                 Key: HBASE-9887
>                 URL: https://issues.apache.org/jira/browse/HBASE-9887
>             Project: HBase
>          Issue Type: Brainstorming
>          Components: Client
>    Affects Versions: 0.98.0, 0.96.0
>            Reporter: Nicolas Liochon
>            Priority: Minor
>
> The client can log all the retries, with this setting
> {noformat}
> <property>
> <name>hbase.client.start.log.errors.counter</name>
> <value>0</value>
> </property>
> {noformat}
> We should use it to fix the pause time, as well as the back off.
> I need to to a complete test, but on 100m, with the default config, I saw something like
> 5% of the first retry were successful
> 5% of ALL the retries between 2 and 6 were successful
> 90% of the retries between 7 and 9 were successful
> So on this (too small) sample, the retries between 2 and 6 are nearly useless.
> I will do a more complete test as well.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message