Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5BADDD07F for ; Thu, 25 Oct 2012 23:11:30 +0000 (UTC) Received: (qmail 36247 invoked by uid 500); 25 Oct 2012 23:11:25 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 36077 invoked by uid 500); 25 Oct 2012 23:11:25 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 36011 invoked by uid 99); 25 Oct 2012 23:11:25 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Oct 2012 23:11:25 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of dipeshsoftware@gmail.com designates 209.85.210.176 as permitted sender) Received: from [209.85.210.176] (HELO mail-ia0-f176.google.com) (209.85.210.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 Oct 2012 23:10:40 +0000 Received: by mail-ia0-f176.google.com with SMTP id h11so2019008iae.35 for ; Thu, 25 Oct 2012 16:10:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=4lNjCaUOPsjRKaT8vVtFlFhB3c51XCeiF0bGltwhanQ=; b=UHnUc8L2BL0RA7EVc3CZr2sipHcQhzVoCoRgr/ujjqxJl4tIgs/CjI5vr/FHefXmwZ JQTbAn9rLpcuzE6kwAKWG7cGIphZXBlxoRvkJU6TbolbG0zYE15apCJS11nO5xCZStcc 1PvB+rgkRIJoX2DRiiqFydTdPZviyIYUDzQlKfpiy/DGrQN+jiU+pcpfFJwskTmkAiaX RGfl7oB+q5ffquFzguZruYMXyD08mSr/OAdnk83b61/tEcK2XBlywic+QgjLqNKGjdnk 4Wt5H86UZpzuYTs/iztQXiL/bBC2taBLVAGTnB4hEkAF3jvnI5YEf6tPpmtihnTmJyIT p/5g== MIME-Version: 1.0 Received: by 10.43.134.70 with SMTP id ib6mr17827291icc.37.1351206618546; Thu, 25 Oct 2012 16:10:18 -0700 (PDT) Received: by 10.64.148.14 with HTTP; Thu, 25 Oct 2012 16:10:18 -0700 (PDT) Date: Thu, 25 Oct 2012 16:10:18 -0700 Message-ID: Subject: Unsatisfied link error - how to load native library without copying it in /lib/native folder From: Dipesh Khakhkhar To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf307f38b084433004ccea4e8b X-Virus-Checked: Checked by ClamAV on apache.org --20cf307f38b084433004ccea4e8b Content-Type: text/plain; charset=ISO-8859-1 Hi, I am a new hadoop user and have few very basic questions (they might sound very stupid to many people so please bear with me). I am running a MR task and my launcher program needs to load a library using System.loadLibrary(somelibrary). This works fine if I put this library in lib/native/Linux-amd64-64. I tried the following - 1. provided -files=/path_to_directory_containging_my_library 2. provided the following in mapred-site.xml (didn't try it in core-site.xml or hdfs-site.xml) -Djava.library.path=//path_to_directory_containging_my_library I'm using hadoop 1.0.3 and this is a single node cluster for testing purpose. I have a production environment where I'm running 4 data nodes and currently I'm copying this file in lib/native/Linux-amd64-64 folder in each node's hadoop installation. A related question regarding providing jars required for running the whole M/R application - currently I have edited hadoop-classpath variable in hadoop-env.sh. For cluster if I provide -libjars option will that work without editing classpath? I require this jar's classes before launching M/R jobs. Also how can I provide my application jar ( i.e. bin/hadoop jar myjar com.x.x.ProgramName ) in the data nodes? Currently I'm copying it in the lib directory of hadoop installation. Thanks in advance for answering my queries. Thanks. --20cf307f38b084433004ccea4e8b Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi,

I am a new hadoop user and have fe= w very basic questions (they might sound very stupid to many people so plea= se bear with me).

I am running a MR task and my launcher program needs to load a library usin= g System.loadLibrary(somelibrary). This works fine if I put this library in= lib/native/Linux-amd64-64. I tried the following -

1. provided -files=3D/path_to_dire= ctory_containging_my_library=A0
2. provided the following in mapred-site.xml= (didn't try it in core-site.xml or hdfs-site.xml)

-Djava.library.path=3D//path_to_directory_containging_my_library=A0

I'm using hadoop 1.0.3 and thi= s is a single node cluster for testing purpose.

I have a production=A0environment=A0where I'm running 4 data nodes and = currently I'm copying this file in=A0=A0lib/native/Linux-amd64-64 folde= r in each node's hadoop installation.

A related question regarding provi= ding jars required for running the whole M/R application - currently I have= edited hadoop-classpath variable in hadoop-env.sh. For cluster if I provid= e -libjars option will that work without editing classpath? I require this = jar's classes before launching M/R jobs.=A0

Also how can I provide my application jar ( i.e. bin/hadoop jar myjar com.x= .x.ProgramName ) =A0in the data nodes? Currently I'm copying it in the = lib directory of hadoop installation.

Thanks in advance for answering my= queries.

Thanks.
--20cf307f38b084433004ccea4e8b--