hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul Bhattacharjee <rahul.rec....@gmail.com>
Subject Re: Bzip2 vs Gzip
Date Wed, 18 Sep 2013 03:12:20 GMT
Yes , bzip2 is splittable.
Tradeoffs - I have not done much experimentation with codecs.

Thanks,
Rahul


On Wed, Sep 18, 2013 at 2:07 AM, Amit Sela <amits@infolinks.com> wrote:

> Hi all,
> I'm using hadoop 1.0.4 and using gzip to keep the logs processed by hadoop
> (logs are gzipped into block size files).
> I read that bzip2 is splittable. Is it so in hadoop 1.0.4 ? Does that mean
> that any input file bigger then block size will be split between maps ?
> What are the tradeoffs between the two ?
>
> Thanks.
>

Mime
View raw message