hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edward Capriolo <edlinuxg...@gmail.com>
Subject Re: LzoCodec for hadoop 0.20.x
Date Sun, 10 Oct 2010 02:23:48 GMT
On Fri, Oct 8, 2010 at 6:34 PM, Ted Yu <yuzhihong@gmail.com> wrote:
> Hi,
> I am using hive trunk with default setting along with cdh3b2.
> I encounter the following exception:
>
> Caused by: java.lang.IllegalArgumentException: Compression codec
> com.hadoop.compression.lzo.LzoCodec not found.
>         at
> org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:96)
>         at
> org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:134)
>         at
> org.apache.hadoop.mapred.TextInputFormat.configure(TextInputFormat.java:41)
>         ... 27 more
> Caused by: java.lang.ClassNotFoundException:
> com.hadoop.compression.lzo.LzoCodec
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>
> I found the following source files:
> ./build/hadoopcore/hadoop-0.17.2.1/src/java/org/apache/hadoop/io/compress/LzoCodec.java
> ./build/hadoopcore/hadoop-0.18.3/src/core/org/apache/hadoop/io/compress/LzoCodec.java
> ./build/hadoopcore/hadoop-0.19.0/src/core/org/apache/hadoop/io/compress/LzoCodec.java
>
> My question is where is the LzoCodec.java for hadoop 0.20.x ?
>
> Thanks
>
Ted,
LZO was removed from 0.20 due to licensing issues. There are several
articles about patching LZO support into hadoop.

Mime
View raw message