hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17314) Limit total buffered size for all replication sources
Date Tue, 20 Dec 2016 15:24:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15764445#comment-15764445
] 

Ted Yu commented on HBASE-17314:
--------------------------------

+1
{code}
162	          LOG.info("Waiting all logs pushed to slave. Expected 50 , actual " + count);
{code}
"Waiting all" -> "Waiting for all"

Can be changed on commit.

> Limit total buffered size for all replication sources
> -----------------------------------------------------
>
>                 Key: HBASE-17314
>                 URL: https://issues.apache.org/jira/browse/HBASE-17314
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>            Reporter: Phil Yang
>            Assignee: Phil Yang
>         Attachments: HBASE-17314.branch-1.v01.patch, HBASE-17314.v01.patch, HBASE-17314.v02.patch,
HBASE-17314.v03.patch, HBASE-17314.v04.patch
>
>
> If we have many peers or some servers have many recovered queues, we will hold many entries
in memory which will increase the pressure of GC, even maybe OOM because we will read entries
for 64MB to buffer in default for one source.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message