Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CC264177B9 for ; Wed, 22 Oct 2014 11:50:39 +0000 (UTC) Received: (qmail 67168 invoked by uid 500); 22 Oct 2014 11:50:39 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 67128 invoked by uid 500); 22 Oct 2014 11:50:39 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 67115 invoked by uid 99); 22 Oct 2014 11:50:39 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Oct 2014 11:50:39 +0000 Date: Wed, 22 Oct 2014 11:50:39 +0000 (UTC) From: "Hudson (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-2720) Windows: Wildcard classpath variables not expanded against resources contained in archives MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179829#comment-14179829 ] Hudson commented on YARN-2720: ------------------------------ SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/720/]) YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch. (cnauroth: rev 6637e3cf95b3a9be8d6b9cd66bc849a0607e8ed5) * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java * hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileUtil.java * hadoop-yarn-project/CHANGES.txt * hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Classpath.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/WindowsSecureContainerExecutor.java > Windows: Wildcard classpath variables not expanded against resources contained in archives > ------------------------------------------------------------------------------------------ > > Key: YARN-2720 > URL: https://issues.apache.org/jira/browse/YARN-2720 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager > Reporter: Craig Welch > Assignee: Craig Welch > Fix For: 2.6.0 > > Attachments: YARN-2720.2.patch, YARN-2720.3.patch, YARN-2720.4.patch > > > On windows there are limitations to the length of command lines and environment variables which prevent placing all classpath resources into these elements. Instead, a jar containing only a classpath manifest is created to provide the classpath. During this process wildcard references are expanded by inspecting the filesystem. Since archives are extracted to a different location and linked into the final location after the classpath jar is created, resources referred to via wildcards which exist in localized archives (.zip, tar.gz) are not added to the classpath manifest jar. Since these entries are removed from the final classpath for the container they are not on the container's classpath as they should be. -- This message was sent by Atlassian JIRA (v6.3.4#6332)