hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2720) Windows: Wildcard classpath variables not expanded against resources contained in archives
Date Wed, 22 Oct 2014 11:50:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179829#comment-14179829
] 

Hudson commented on YARN-2720:
------------------------------

SUCCESS: Integrated in Hadoop-Yarn-trunk #720 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/720/])
YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained
in archives. Contributed by Craig Welch. (cnauroth: rev 6637e3cf95b3a9be8d6b9cd66bc849a0607e8ed5)
* hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileUtil.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileUtil.java
* hadoop-yarn-project/CHANGES.txt
* hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Classpath.java
* hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/WindowsSecureContainerExecutor.java


> Windows: Wildcard classpath variables not expanded against resources contained in archives
> ------------------------------------------------------------------------------------------
>
>                 Key: YARN-2720
>                 URL: https://issues.apache.org/jira/browse/YARN-2720
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Craig Welch
>            Assignee: Craig Welch
>             Fix For: 2.6.0
>
>         Attachments: YARN-2720.2.patch, YARN-2720.3.patch, YARN-2720.4.patch
>
>
> On windows there are limitations to the length of command lines and environment variables
which prevent placing all classpath resources into these elements.  Instead, a jar containing
only a classpath manifest is created to provide the classpath.  During this process wildcard
references are expanded by inspecting the filesystem.  Since archives are extracted to a different
location and linked into the final location after the classpath jar is created, resources
referred to via wildcards which exist in localized archives  (.zip, tar.gz) are not added
to the classpath manifest jar.  Since these entries are removed from the final classpath for
the container they are not on the container's classpath as they should be.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message