Return-Path: X-Original-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 54B0398A0 for ; Thu, 27 Oct 2011 07:50:56 +0000 (UTC) Received: (qmail 66565 invoked by uid 500); 27 Oct 2011 07:50:55 -0000 Delivered-To: apmail-hadoop-mapreduce-issues-archive@hadoop.apache.org Received: (qmail 66501 invoked by uid 500); 27 Oct 2011 07:50:55 -0000 Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-issues@hadoop.apache.org Delivered-To: mailing list mapreduce-issues@hadoop.apache.org Received: (qmail 66202 invoked by uid 99); 27 Oct 2011 07:50:55 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Oct 2011 07:50:55 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Oct 2011 07:50:52 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 5D44D32267B for ; Thu, 27 Oct 2011 07:48:32 +0000 (UTC) Date: Thu, 27 Oct 2011 07:48:32 +0000 (UTC) From: "Arun C Murthy (Commented) (JIRA)" To: mapreduce-issues@hadoop.apache.org Message-ID: <840182581.23408.1319701712383.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <338429595.12711.1319537792197.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (MAPREDUCE-3259) ContainerLocalizer should get the proper java.library.path from LinuxContainerExecutor MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/MAPREDUCE-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136869#comment-13136869 ] Arun C Murthy commented on MAPREDUCE-3259: ------------------------------------------ Ok, the talk about apps confused me. Now I see the real issue: ContainerLocalizer needs this set for UGI etc. We shouldn't change MapReduceChildJVM, the changes to LCE.startLocalizer seem fine. > ContainerLocalizer should get the proper java.library.path from LinuxContainerExecutor > -------------------------------------------------------------------------------------- > > Key: MAPREDUCE-3259 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-3259 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2, nodemanager > Affects Versions: 0.23.0, 0.24.0 > Reporter: Kihwal Lee > Assignee: Kihwal Lee > Priority: Blocker > Fix For: 0.23.0, 0.24.0 > > Attachments: MAPREDUCE-3259.patch.txt, mapreduce-3259.patch, mapreduce-3259.patch.txt > > > As seen in MAPREDUCE-2915, java.library.path is not being passed when the LCE spawns a JVM for ContainerLocalizer. > However, unlike branch-0.20-security, the task runtime in 0.23 is unaffected by this. This is because tasks' run-time environment is specified in the launch script by client. Setting LD_LIBRARY_PATH is the primary way of specifying the locations of required native library in this case. The config property, mapreduce.admin.user.env is always set in the job environment and the default value is to add the path to the hadoop native library to LD_LABRARY_PATH. > For JVM's being launched by the hadoop system scripts, java.library.path is set. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira