hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Singhi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14938) Limit to and fro requests size from ZK in bulk loaded hfile replication
Date Tue, 22 Dec 2015 07:13:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067661#comment-15067661

Ashish Singhi commented on HBASE-14938:

I am planning to add a new configuration {{hbase.replication.max.znodes.per.request}} which
will control the number of znodes we send for create/delete to ZK in a single request default
being 5000.
For now we do not have any control on the number of znodes we can request from ZK in one request.
There is a open jira in ZK(ZOOKEEPER-2260) and work is in progress, once that is complete
we can control this part also, I will just add a TODO for this.

Any concern with above approach or do you have any other thoughts ?

> Limit to and fro requests size from ZK in bulk loaded hfile replication
> -----------------------------------------------------------------------
>                 Key: HBASE-14938
>                 URL: https://issues.apache.org/jira/browse/HBASE-14938
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Ashish Singhi
>            Assignee: Ashish Singhi
> In ZK the maximum allowable size of the data array is 1 MB. Until we have fixed HBASE-10295
we need to handle this.
> Approach to this problem will be discussed in the comments section.
> Note: We have done internal testing with more than 3k nodes in ZK yet to be replicated.

This message was sent by Atlassian JIRA

View raw message