hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zheng Shao <zs...@facebook.com>
Subject DefaultCodec vs. LZO
Date Fri, 23 Oct 2009 19:43:56 GMT
We are using Hadoop 0.20 and mapred.map.output.compression.Codec is set to DefaultCodec.
We tried LZO but the performance seems very similar to DefaultCodec.

I heard of a lot of good words about LZO. So did anybody compare LZO with DefaultCodec?
Is there a big difference?

We are running CentOS release 5.2 (Final).

Thanks,
Zheng


Mime
View raw message