hadoop-zookeeper-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henry Robinson <he...@cloudera.com>
Subject Re: Return data size in zkpython
Date Wed, 16 Dec 2009 02:41:47 GMT
Hi -

See https://issues.apache.org/jira/browse/ZOOKEEPER-627, and the attached
patch. I've upped the limit to a 1Mb buffer. Also I've added a fourth
parameter to zookeeper.get - if you set this integer parameter to the size
of the buffer you are expecting, zkpython will return no more than this many
bytes.

Thanks again for flagging this up.

cheers,
Henry

On Tue, Dec 15, 2009 at 4:43 PM, Henry Robinson <henry@cloudera.com> wrote:

> Hey Rich -
>
> That's a really dumb restriction :) I'll open a JIRA and get it fixed asap.
>
> Thanks for the report!
>
> Henry
>
>
> On Tue, Dec 15, 2009 at 4:38 PM, Rich Schumacher <rich.schu@gmail.com>wrote:
>
>> Hey all,
>>
>> I'm working on using ZooKeeper for an internal application at Digg.  I've
>> been using the zkpython package and I just noticed that the data I was
>> receiving from a zookeeper.get() call was being truncated.  After some quick
>> digging I found that zookeeper.c limits the data returned to 512 characters
>> (see
>> http://svn.apache.org/viewvc/hadoop/zookeeper/tags/release-3.2.2/src/contrib/zkpython/src/c/zookeeper.c?view=markupline
855).
>>
>> Is there a reason for this?  The only information regarding node size that
>> I've read is that it should not exceed 1MB so this limit seems a bit
>> arbitrary and restrictive.
>>
>> Thanks for the great work!
>>
>> Rich
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message