hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karan Mehta (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-18396) Encode ZNode names to reduce ZooKeeper jute buffer length requirements and thus reduce memory usage
Date Mon, 17 Jul 2017 19:46:01 GMT
Karan Mehta created HBASE-18396:
-----------------------------------

             Summary: Encode ZNode names to reduce ZooKeeper jute buffer length requirements
and thus reduce memory usage
                 Key: HBASE-18396
                 URL: https://issues.apache.org/jira/browse/HBASE-18396
             Project: HBase
          Issue Type: Improvement
    Affects Versions: 3.0.0
            Reporter: Karan Mehta


In our production environment, we hit the error {{ZooKeeper connectionLoss due to jute.maxbuffer
len of 1M getting exceeded}}. Usually 1 MB is a lot, but in case of multi requests, it can
exceed the maximum buffer length that is allocated.

This JIRA is a discussion for encoding various znode names. IMO, this will reduce the path
lengths, thus reducing the size of buffer required as well as network packet size and also
pack more requests in a single multi. As with encoding, this will introduce overhead, but
we need to determine how feasible this idea is.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message