hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From George Datskos <george.dats...@jp.fujitsu.com>
Subject Re: Question related to Decompressor interface
Date Wed, 13 Feb 2013 00:58:28 GMT

> Can someone share some idea what the Hadoop source code of class 
> org.apache.hadoop.io.compress.BlockDecompressorStream, method 
> rawReadInt() is trying to do here?

The BlockDecompressorStream class is used for block-based decompression 
(e.g. snappy).  Each chunk has a header indicating how many bytes it is. 
That header is obtained by the rawReadInt method so it is expected to 
return a non-negative value (since you can't have a negative length).


View raw message