hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-129) Simplify classpath construction for mini YARN tests
Date Wed, 07 Nov 2012 15:23:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492416#comment-13492416

Tom White commented on YARN-129:

The test failure is unrelated - see MAPREDUCE-4774.

bq. Tom, does this work when running tests from Maven? Asking because, if I recall correctly,
Maven heavily uses classloaders and if they are used for the project classpath most likely
the JVM java.class.path wont have the project classpath.

Yes it does. I checked and the JVM java.class.path is being set correctly by the Maven test
> Simplify classpath construction for mini YARN tests
> ---------------------------------------------------
>                 Key: YARN-129
>                 URL: https://issues.apache.org/jira/browse/YARN-129
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: client
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: YARN-129.patch, YARN-129.patch, YARN-129.patch
> The test classpath includes a special file called 'mrapp-generated-classpath' (or similar
in distributed shell) that is constructed at build time, and whose contents are a classpath
with all the dependencies needed to run the tests. When the classpath for a container (e.g.
the AM) is constructed the contents of mrapp-generated-classpath is read and added to the
classpath, and the file itself is then added to the classpath so that later when the AM constructs
a classpath for a task container it can propagate the test classpath correctly.
> This mechanism can be drastically simplified by propagating the system classpath of the
current JVM (read from the java.class.path property) to a launched JVM, but only if running
in the context of the mini YARN cluster. Any tests that use the mini YARN cluster will automatically
work with this change. Although any that explicitly deal with mrapp-generated-classpath can
be simplified.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message