avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: file format stable?
Date Fri, 12 Mar 2010 18:56:50 GMT
Scott Carey wrote:
> * Large records -- the final block size has to be known before writing, currently this
is done by buffering in memory while writing.

A back-compatible format extension that would help here is, if the block 
size is negative, then its absolute value is the size of the next chunk 
in the block.  In other words, a block would continue until a chunk is 
found whose length is positive.


View raw message