Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 70E15DF57 for ; Tue, 6 Nov 2012 21:31:10 +0000 (UTC) Received: (qmail 40708 invoked by uid 500); 6 Nov 2012 21:31:05 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 40623 invoked by uid 500); 6 Nov 2012 21:31:05 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 40616 invoked by uid 99); 6 Nov 2012 21:31:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Nov 2012 21:31:05 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of alxsss@aim.com designates 64.12.78.142 as permitted sender) Received: from [64.12.78.142] (HELO imr-ma06.mx.aol.com) (64.12.78.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Nov 2012 21:30:59 +0000 Received: from mtaomg-ma05.r1000.mx.aol.com (mtaomg-ma05.r1000.mx.aol.com [172.29.41.12]) by imr-ma06.mx.aol.com (8.14.1/8.14.1) with ESMTP id qA6LUY01009367 for ; Tue, 6 Nov 2012 16:30:34 -0500 Received: from core-mib002b.r1000.mail.aol.com (core-mib002.r1000.mail.aol.com [172.29.122.5]) by mtaomg-ma05.r1000.mx.aol.com (OMAG/Core Interface) with ESMTP id B0076E000091 for ; Tue, 6 Nov 2012 16:30:34 -0500 (EST) References: <8CF89D299ECF297-1F14-14CAB@webmail-m164.sysops.aol.com> To: user@hadoop.apache.org Subject: Re: problem with hadoop-snappy In-Reply-To: X-MB-Message-Source: WebUI MIME-Version: 1.0 From: alxsss@aim.com X-MB-Message-Type: User Content-Type: multipart/alternative; boundary="--------MB_8CF8A7D1719E3E1_1F14_678A5_webmail-m164.sysops.aol.com" X-Mailer: AOL Webmail 37130-STANDARD Received: from 216.145.54.7 by webmail-m164.sysops.aol.com (64.12.101.161) with HTTP (WebMailUI); Tue, 06 Nov 2012 16:30:34 -0500 Message-Id: <8CF8A7D17105E5D-1F14-1C777@webmail-m164.sysops.aol.com> X-Originating-IP: [216.145.54.7] Date: Tue, 6 Nov 2012 16:30:34 -0500 (EST) x-aol-global-disposition: G DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mx.aol.com; s=20110426; t=1352237434; bh=ObclTYzZDKZJS4p6OLlSeUZVaNmU8s0fNt57bfwwypI=; h=From:To:Subject:Message-Id:Date:MIME-Version:Content-Type; b=G3BvL9iAUz9e/3MCN4sdUlcsTLmo09r3/jsE0h0KzIlEtNFEqZoEcS0bJWuiNIIAb aAHlGmtGXC6R4Gl/lmoIootrZew/nOU0LviV4ifsQRyW5YDyO9qYfACwFFJoHA8t8I rsKgS4mqq4ul2WUeTgCSx/IToiXIVBGbmHh8OvMI= X-AOL-SCOLL-SCORE: 0:2:464213664:93952408 X-AOL-SCOLL-URL_COUNT: 0 x-aol-sid: 3039ac1d290c5099817a07ee X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. ----------MB_8CF8A7D1719E3E1_1F14_678A5_webmail-m164.sysops.aol.com Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="us-ascii" When I used hadoop-1.0.4 without the installation of hadoop-snappy I saw i= n the logs WARN snappy.LoadSnappy: Snappy native library not loaded So, it was my understanding that snappy is not included with hadoop-1.0.4. = After removing the libs I installed, I see again the same warning. Any ideas how to fix this issue? Thanks. Alex. =20 =20 =20 -----Original Message----- From: Binglin Chang To: user Sent: Mon, Nov 5, 2012 6:07 pm Subject: Re: problem with hadoop-snappy I think hadoop-1.0.4 already have snappy included, you should not using oth= er third party libraries. =20 On Tue, Nov 6, 2012 at 9:10 AM, wrote: Hello, I use hadoop-1.0.4 I have followed instruction to install hadoop-snappy a= t=20 http://code.google.com/p/hadoop-snappy/=20 When I run a mapred job I see FATAL org.apache.hadoop.mapred.TaskTracker: Task: attempt_201211051656_0002= _m_000000_3 - Killed : org.apache.hadoop.io.compress.snappy.SnappyCompresso= r.compressBytesDirect()I in task tracker log and the job fails. Any ideas how to fix this issue. Thanks in advance. Alex. =20 ----------MB_8CF8A7D1719E3E1_1F14_678A5_webmail-m164.sysops.aol.com Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset="us-ascii" When I use= d hadoop-1.0.4  without the i= nstallation of hadoop-snappy I saw= in the logs

 WARN snappy.LoadSnappy: Snappy native library not lo= aded

So, it was my understanding that snappy i= s not included with hadoop-1.0.4. After removing the libs = I installed, I see again the same warning.

Any ideas how to fix this issue?

Thanks.
Alex.



-----Original Message-----
From: Binglin Chang <decstery@gmail.com>
To: user <user@hadoop.apache.org>
Sent: Mon, Nov 5, 2012 6:07 pm
Subject: Re: problem with hadoop-snappy
I think hadoop-1.0.4 already have snappy included, you should not using oth= er third party libraries.
 
=

= On Tue, Nov 6, 2012 at 9:10 AM, <alxsss@aim.com> wrote:
Hello,

I use hadoop-1.0.4  I have followed  instruction to i= nstall hadoop-snappy at
http://code.google.com/p/hadoop-snappy/

When I run a mapred job I see

FATAL org.apache.hadoop.mapred.TaskTracker: Task: attempt_201211051656_0002= _m_000000_3 - Killed : org.apache.hadoop.io.compress.snappy.SnappyCompresso= r.compressBytesDirect()I

in task tracker log and the job fails.

Any ideas how to fix this issue.

Thanks in advance.
Alex.


----------MB_8CF8A7D1719E3E1_1F14_678A5_webmail-m164.sysops.aol.com--