hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prashant Kommireddi <prash1...@gmail.com>
Subject Re: Compressing map only output
Date Tue, 01 May 2012 00:44:25 GMT
Yes. These are hadoop properties - using "set" is just a way for Pig to set
those properties in your job conf.


On Mon, Apr 30, 2012 at 5:25 PM, Mohit Anchlia <mohitanchlia@gmail.com>wrote:

> Is there a way to compress map only jobs to compress map output that gets
> stored on hdfs as part-m-* files? In pig I used :
>
> Would these work form plain map reduce jobs as well?
>
>
> set output.compression.enabled true;
>
> set output.compression.codec org.apache.hadoop.io.compress.SnappyCodec;
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message