hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Anchlia <mohitanch...@gmail.com>
Subject Compressing map only output
Date Tue, 01 May 2012 00:25:22 GMT
Is there a way to compress map only jobs to compress map output that gets
stored on hdfs as part-m-* files? In pig I used :

Would these work form plain map reduce jobs as well?

set output.compression.enabled true;

set output.compression.codec org.apache.hadoop.io.compress.SnappyCodec;

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message