hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Best splittable compression for Hadoop 1.0.0
Date Sat, 15 Sep 2012 02:13:35 GMT
Serge,

I'd look at Avro DataFiles, with snappy or deflate compression
(tunable levels). It is documented at
http://avro.apache.org/docs/current/api/java/org/apache/avro/file/DataFileWriter.html.
Read more on Avro and why its good at http://avro.apache.org.

On Sat, Sep 15, 2012 at 12:22 AM, Serge Blazhiyevskyy
<Serge.Blazhiyevskyy@nice.com> wrote:
> Hi all,
>
>
> I am trying to investigate the best splittable format for hadoop 1.0.0
>
> Anybody have any recommendation?
>
>
> Thanks
> Serge



-- 
Harsh J

Mime
View raw message