hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Anchlia <mohitanch...@gmail.com>
Subject Re: LZO with sequenceFile
Date Sun, 26 Feb 2012 07:14:33 GMT
Thanks. Does it mean LZO is not installed by default? How can I install LZO?

On Sat, Feb 25, 2012 at 6:27 PM, Shi Yu <shiyu@uchicago.edu> wrote:

> Yes, it is supported by Hadoop sequence file. It is splittable
> by default. If you have installed and specified LZO correctly,
> use these:
>
>
> org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputForma
> t.setCompressOutput(job,true);
>
> org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputForma
> t.setOutputCompressorClass(job,com.hadoop.compression.lzo.LzoC
> odec.class);
>
> org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputForma
> t.setOutputCompressionType(job,
> SequenceFile.CompressionType.BLOCK);
>
> job.setOutputFormatClass(org.apache.hadoop.mapreduce.lib.outpu
> t.SequenceFileOutputFormat.class);
>
>
> Shi
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message