Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 84034 invoked from network); 3 Nov 2008 18:45:41 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 3 Nov 2008 18:45:41 -0000 Received: (qmail 4533 invoked by uid 500); 3 Nov 2008 18:45:42 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 4492 invoked by uid 500); 3 Nov 2008 18:45:42 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 4479 invoked by uid 99); 3 Nov 2008 18:45:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Nov 2008 10:45:41 -0800 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Nov 2008 18:44:32 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 5FF61234C266 for ; Mon, 3 Nov 2008 10:44:44 -0800 (PST) Message-ID: <144953879.1225737884392.JavaMail.jira@brutus> Date: Mon, 3 Nov 2008 10:44:44 -0800 (PST) From: "Ahad Rana (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-4577) Add Jar "lib" directory to TaskRunner's library.path setting to allow JNI libraries to be deployed via JAR file In-Reply-To: <2001514261.1225737764311.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahad Rana updated HADOOP-4577: ------------------------------ Status: Patch Available (was: Open) > Add Jar "lib" directory to TaskRunner's library.path setting to allow JNI libraries to be deployed via JAR file > ----------------------------------------------------------------------------------------------------------------- > > Key: HADOOP-4577 > URL: https://issues.apache.org/jira/browse/HADOOP-4577 > Project: Hadoop Core > Issue Type: Improvement > Components: mapred > Affects Versions: 0.18.1 > Environment: Hadoop 18.1 Cluster with custom JNI shared libraries deployed in lib directory of deployment JAR. > Reporter: Ahad Rana > Assignee: Ahad Rana > Fix For: 0.18.3 > > > It is extremely convenient to be able to deploy JNI libraries utilized in a custom map-reduce job via the job's JAR file. The TaskRunner already establishes a precedent by automatically adding any jar files contained in the "lib" directory of the job jar to the child map/reduce process's classpath. Following this convention, it should also be possible to deploy custom JNI libraries in the same lib directory. This involves adding the path to the job jar's lib directory to the VM's library.path setting (after the jar has been expanded in the job cache directory). This does not elimintate the need add dependent shared libraries that may be referenced by the JNI libraries to the system's LD_LIBRARY_PATH variable. In our deployment configuration, we usually pre-install third party shared libraries across the cluster and only deploy our custom JNI libraries via the job jar. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.