hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Singhi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14938) Limit to and fro requests size from ZK in bulk loaded hfile replication
Date Wed, 23 Dec 2015 17:23:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069908#comment-15069908

Ashish Singhi commented on HBASE-14938:

Regarding Ted's approach, I checked with him offline, his understanding regarding this was
bq. The rationale is to control the amount of data to be replicated.
Ted, concern is regarding the amount of bulk loaded data we replicate to a peer cluster in
a single request. IMO that is a topic of discussion on another jira.

Attached patch based on the approach I mentioned in my very first comment.
Please review.

> Limit to and fro requests size from ZK in bulk loaded hfile replication
> -----------------------------------------------------------------------
>                 Key: HBASE-14938
>                 URL: https://issues.apache.org/jira/browse/HBASE-14938
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Ashish Singhi
>            Assignee: Ashish Singhi
>             Fix For: 2.0.0, 1.3.0
>         Attachments: HBASE-14938.patch
> In ZK the maximum allowable size of the data array is 1 MB. Until we have fixed HBASE-10295
we need to handle this.
> Approach to this problem will be discussed in the comments section.
> Note: We have done internal testing with more than 3k nodes in ZK yet to be replicated.

This message was sent by Atlassian JIRA

View raw message