Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 17 Jul 2017 19:46:01 +0000 (UTC)
From: "Karan Mehta (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: <JIRA.13087712.1500320754000.266492.1500320761664@Atlassian.JIRA>
In-Reply-To: <JIRA.13087712.1500320754000@Atlassian.JIRA>
References: <JIRA.13087712.1500320754000@Atlassian.JIRA> <JIRA.13087712.1500320754737@jira-lw-us.apache.org>
Subject: [jira] [Created] (HBASE-18396) Encode ZNode names to reduce
 ZooKeeper jute buffer length requirements and thus reduce memory usage
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 17 Jul 2017 19:46:09 -0000

Karan Mehta created HBASE-18396:
-----------------------------------

             Summary: Encode ZNode names to reduce ZooKeeper jute buffer length requirements and thus reduce memory usage
                 Key: HBASE-18396
                 URL: https://issues.apache.org/jira/browse/HBASE-18396
             Project: HBase
          Issue Type: Improvement
    Affects Versions: 3.0.0
            Reporter: Karan Mehta


In our production environment, we hit the error {{ZooKeeper connectionLoss due to jute.maxbuffer len of 1M getting exceeded}}. Usually 1 MB is a lot, but in case of multi requests, it can exceed the maximum buffer length that is allocated.

This JIRA is a discussion for encoding various znode names. IMO, this will reduce the path lengths, thus reducing the size of buffer required as well as network packet size and also pack more requests in a single multi. As with encoding, this will introduce overhead, but we need to determine how feasible this idea is.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)