hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-5459) Update the doc of running MRv1 examples jar on YARN
Date Thu, 03 Oct 2013 14:00:51 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785212#comment-13785212

Hudson commented on MAPREDUCE-5459:

FAILURE: Integrated in Hadoop-Mapreduce-trunk #1567 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1567/])
MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN. Contributed by Zhijie
Shen. (acmurthy: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1528626)
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm

> Update the doc of running MRv1 examples jar on YARN
> ---------------------------------------------------
>                 Key: MAPREDUCE-5459
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5459
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>             Fix For: 2.1.2-beta
>         Attachments: MAPREDUCE-5459.1.patch
> In addition to adding two env vars: HADOOP_USER_CLASSPATH_FIRST and HADOOP_CLASSPATH,
we still need to add
> {code}
>     <property>
>         <name>mapreduce.job.user.classpath.first</name>
>         <value>true</value>
>     </property>
> {code}
> in mapred-site.xml to make sure that the MRv1 examples jar runs correctly on YARN. Some
examples will use Java reflection to find the classes in the examples jar dynamically when
they are running. With this configuration, the MRv1 examples jar will appear before the MRv2
examples jar in CLASSPATH of the processes in YARN containers. Therefore, the classes found
via reflection will be picked from MRv1 examples jar instead of MRv2 examples jar as well.
> MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm needs to be updated to document this.

This message was sent by Atlassian JIRA

View raw message