hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From alx...@aim.com
Subject Re: problem with hadoop-snappy
Date Wed, 07 Nov 2012 01:42:48 GMT

 Yes, I have installed snappy-1.0.5.

Here is the output of 
 ls -l /usr/local/lib
total 1468
lrwxrwxrwx. 1 root root     52 Nov  5 16:00 libjvm.so -> /usr/java/jdk1.6.0_37/jre/lib/amd64/server/libjvm.so
-rw-r--r--. 1 root root 946358 Nov  3 17:44 liblzo2.a
-rwxr-xr-x. 1 root root    866 Nov  3 17:44 liblzo2.la
-rw-r--r--. 1 root root 371174 Nov  5 15:18 libsnappy.a
-rwxr-xr-x. 1 root root    957 Nov  5 15:18 libsnappy.la
lrwxrwxrwx. 1 root root     18 Nov  5 15:18 libsnappy.so -> libsnappy.so.1.1.3
lrwxrwxrwx. 1 root root     18 Nov  5 15:18 libsnappy.so.1 -> libsnappy.so.1.1.3
-rwxr-xr-x. 1 root root 169393 Nov  5 15:18 libsnappy.so.1.1.3


 

 

-----Original Message-----
From: Binglin Chang <decstery@gmail.com>
To: user <user@hadoop.apache.org>
Sent: Tue, Nov 6, 2012 5:34 pm
Subject: Re: problem with hadoop-snappy


Have you installed snappy library (which should have libsnappy.so in /usr/lib or /usr/local/lib)
first?





On Wed, Nov 7, 2012 at 5:30 AM,  <alxsss@aim.com> wrote:

When I used hadoop-1.0.4  without the installation of hadoop-snappy I saw in the logs

 WARN snappy.LoadSnappy: Snappy native library not loaded

So, it was my understanding that snappy is not included with hadoop-1.0.4. After removing
the libs I installed, I see again the same warning.

Any ideas how to fix this issue?

Thanks.
Alex.



 

 

 

-----Original Message-----
From: Binglin Chang <decstery@gmail.com>
To: user <user@hadoop.apache.org>
Sent: Mon, Nov 5, 2012 6:07 pm
Subject: Re: problem with hadoop-snappy


I think hadoop-1.0.4 already have snappy included, you should not using other third party
libraries.
 



On Tue, Nov 6, 2012 at 9:10 AM,  <alxsss@aim.com> wrote:

Hello,

I use hadoop-1.0.4  I have followed  instruction to install hadoop-snappy at 
http://code.google.com/p/hadoop-snappy/ 

When I run a mapred job I see

FATAL org.apache.hadoop.mapred.TaskTracker: Task: attempt_201211051656_0002_m_000000_3 - Killed
: org.apache.hadoop.io.compress.snappy.SnappyCompressor.compressBytesDirect()I

in task tracker log and the job fails.

Any ideas how to fix this issue.

Thanks in advance.
Alex.




 




 

Mime
View raw message