hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juwei Shi <shiju...@gmail.com>
Subject reduce output compression of Terasort
Date Fri, 17 Feb 2012 06:37:11 GMT

I am benchmarking the cluster using the Terasort package of Hadoop 0.20.2.
I enabled compression for both map output (*mapred.compress.map.output*)
and reduce output (*mapred.output.compress*). I checked the parameter in
Job.xml, both are true. I can see that the compression for Map output
works, but it seems that the compression for reduce output does not work.
The output of the job on HDFS is also 1TB.


- Juwei

View raw message