hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phil Yang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-17274) Add a server level throttler for replication sources
Date Wed, 07 Dec 2016 08:50:58 GMT
Phil Yang created HBASE-17274:

             Summary: Add a server level throttler for replication sources
                 Key: HBASE-17274
                 URL: https://issues.apache.org/jira/browse/HBASE-17274
             Project: HBase
          Issue Type: Improvement
            Reporter: Phil Yang
            Assignee: Phil Yang

If we have many peers or some servers have many recovered queues, the total read size per
second from WALs will be very high, which will increase the pressure of GC, even maybe OOM
because we will read entries for 64MB to buffer in default.

So we should add a server level throttler to limit the speed of reading WALs, and limit the
total buffered entries for all ReplicationSources.

This message was sent by Atlassian JIRA

View raw message