hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Doug Cutting <cutt...@apache.org>
Subject Re: Question on Critical Region size for SequenceFile next/write - 0.15.1
Date Wed, 12 Dec 2007 22:37:55 GMT
Ted Dunning wrote:
> It seems reasonable that (de)-serialization could be done in threaded
> fashion and then just block on the (read) write itself.

That would require a buffer per thread, e.g., replacing Writer#buffer 
with a ThreadLocal of DataOutputBuffers.  The deflater-related objects 
would also need to accessed through ThreadLocals.  That could work.

Doug

Mime
View raw message