Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 955F1189DC for ; Wed, 23 Dec 2015 17:23:48 +0000 (UTC) Received: (qmail 49562 invoked by uid 500); 23 Dec 2015 17:23:47 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 49482 invoked by uid 500); 23 Dec 2015 17:23:47 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 49279 invoked by uid 99); 23 Dec 2015 17:23:47 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Dec 2015 17:23:47 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id BC1982C1F69 for ; Wed, 23 Dec 2015 17:23:46 +0000 (UTC) Date: Wed, 23 Dec 2015 17:23:46 +0000 (UTC) From: "Ashish Singhi (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-14938) Limit to and fro requests size from ZK in bulk loaded hfile replication MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069908#comment-15069908 ] Ashish Singhi commented on HBASE-14938: --------------------------------------- Regarding Ted's approach, I checked with him offline, his understanding regarding this was different. bq. The rationale is to control the amount of data to be replicated. Ted, concern is regarding the amount of bulk loaded data we replicate to a peer cluster in a single request. IMO that is a topic of discussion on another jira. Attached patch based on the approach I mentioned in my very first comment. Please review. > Limit to and fro requests size from ZK in bulk loaded hfile replication > ----------------------------------------------------------------------- > > Key: HBASE-14938 > URL: https://issues.apache.org/jira/browse/HBASE-14938 > Project: HBase > Issue Type: Improvement > Reporter: Ashish Singhi > Assignee: Ashish Singhi > Fix For: 2.0.0, 1.3.0 > > Attachments: HBASE-14938.patch > > > In ZK the maximum allowable size of the data array is 1 MB. Until we have fixed HBASE-10295 we need to handle this. > Approach to this problem will be discussed in the comments section. > Note: We have done internal testing with more than 3k nodes in ZK yet to be replicated. -- This message was sent by Atlassian JIRA (v6.3.4#6332)