hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3505) yarn APPLICATION_CLASSPATH needs to be overridable
Date Tue, 24 Jan 2012 18:50:41 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192365#comment-13192365
] 

Hudson commented on MAPREDUCE-3505:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #428 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/428/])
    Merge -r 1235390:1235391 from trunk to branch. FIXES: MAPREDUCE-3505

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1235397
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/resources/yarn-default.xml

                
> yarn APPLICATION_CLASSPATH needs to be overridable
> --------------------------------------------------
>
>                 Key: MAPREDUCE-3505
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3505
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Bruno Mahé
>            Assignee: Ahmed Radwan
>              Labels: bigtop
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3505.patch, MAPREDUCE-3505_rev2.patch
>
>
> Right now MRApps sets the classpath to just being mrapp-generated-classpath, its content
and a hardcoded list of directories.
> If I understand correctly mrapp-generated-classpath is only there for testing and may
change or disappear at any time
> The list of hardcoded directories is defined in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
at line 92.
> For convenience, here is its current content:
> {noformat}
>   /**
>    * Classpath for typical applications.
>    */
>   public static final String[] APPLICATION_CLASSPATH =
>       new String[] {
>         "$HADOOP_CONF_DIR",
>         "$HADOOP_COMMON_HOME/share/hadoop/common/*",
>         "$HADOOP_COMMON_HOME/share/hadoop/common/lib/*",
>         "$HADOOP_HDFS_HOME/share/hadoop/hdfs/*",
>         "$HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*",
>         "$YARN_HOME/modules/*",
>         "$YARN_HOME/lib/*"
>       };
> {noformat}
> Not all deployment scenarii fit in this layout and therefore we need a standardized way
to customize this class path.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message