hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: Redundant (?) lengths in SequenceFile
Date Mon, 26 Jun 2006 21:48:31 GMT
Eric Baldeschwieler wrote:
> Can we turn this around and assume that writables will be given a stream 
> and a length when they read?  That would also let us remove redundant 
> info...

Unless I misunderstand, that would make it harder to nest writables, 
since all containers would need to store the length.  Currently only 
top-level containers (SequenceFile and the RPC protocol) need to write 
lengths.  Even these are optional, used only to optimize things.


View raw message