hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phil Yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17274) Add a server level throttler for replication sources
Date Tue, 14 Feb 2017 10:19:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15865532#comment-15865532
] 

Phil Yang commented on HBASE-17274:
-----------------------------------

ReplicationThrottler is not designed for multi-thread cases. I think the most easy way is
to use Guava's RateLimiter(since 13.0) which is a thread-safe throttler. But we can not upgrade
Guava expect 2.0. So I am going to implement a similar work in HBase project.

> Add a server level throttler for replication sources
> ----------------------------------------------------
>
>                 Key: HBASE-17274
>                 URL: https://issues.apache.org/jira/browse/HBASE-17274
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: Phil Yang
>            Assignee: Phil Yang
>
> If we have many peers or some servers have many recovered queues, the total read size
per second from WALs will be very high.
> So we should add a server level throttler to limit the total speed of reading WALs.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message