hadoop-mapreduce-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From acmur...@apache.org
Subject svn commit: r1528626 - in /hadoop/common/trunk/hadoop-mapreduce-project: CHANGES.txt hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
Date Wed, 02 Oct 2013 21:08:27 GMT
Author: acmurthy
Date: Wed Oct  2 21:08:27 2013
New Revision: 1528626

URL: http://svn.apache.org/r1528626
Log:
MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN. Contributed by Zhijie
Shen.

Modified:
    hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
    hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm

Modified: hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt?rev=1528626&r1=1528625&r2=1528626&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt (original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt Wed Oct  2 21:08:27 2013
@@ -265,6 +265,9 @@ Release 2.1.2 - UNRELEASED
     isSplittable(FileSystem, Path) api and ensuring semantic compatibility.
     (Robert Kanter via acmurthy)
 
+    MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN.
+    (Zhijie Shen via acmurthy)
+
 Release 2.1.1-beta - 2013-09-23
 
   INCOMPATIBLE CHANGES

Modified: hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm?rev=1528626&r1=1528625&r2=1528626&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
(original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/apt/MapReduce_Compatibility_Hadoop1_Hadoop2.apt.vm
Wed Oct  2 21:08:27 2013
@@ -96,12 +96,21 @@ Apache Hadoop MapReduce - Migrating from
 
 * {Malicious}
 
- For the users who are going to try <<<hadoop-examples-1.x.x.jar>>> on
YARN,
- please note that <<<hadoop -jar hadoop-examples-1.x.x.jar>>> will still
use
- <<<hadoop-mapreduce-examples-2.x.x.jar>>>, which is installed together
with
- other MRv2 jars. By default Hadoop framework jars appear before the users'
- jars in the classpath, such that the classes from the 2.x.x jar will still be
- picked. Users should either remove <<<hadoop-mapreduce-examples-2.x.x.jar>>>
- from the classpath or set <<<HADOOP_USER_CLASSPATH_FIRST=true>>> and
- <<<HADOOP_CLASSPATH=...:hadoop-examples-1.x.x.jar>>> to run their target
- examples jar.
+  For the users who are going to try <<<hadoop-examples-1.x.x.jar>>> on
YARN,
+  please note that <<<hadoop -jar hadoop-examples-1.x.x.jar>>> will still
use
+  <<<hadoop-mapreduce-examples-2.x.x.jar>>>, which is installed together
with
+  other MRv2 jars. By default Hadoop framework jars appear before the users'
+  jars in the classpath, such that the classes from the 2.x.x jar will still be
+  picked. Users should remove <<<hadoop-mapreduce-examples-2.x.x.jar>>>
+  from the classpath of all the nodes in a cluster. Otherwise, users need to
+  set <<<HADOOP_USER_CLASSPATH_FIRST=true>>> and
+  <<<HADOOP_CLASSPATH=...:hadoop-examples-1.x.x.jar>>> to run their target
+  examples jar, and add the following configuration in <<<mapred-site.xml>>>
to
+  make the processes in YARN containers pick this jar as well.
+
++---+
+    <property>
+        <name>mapreduce.job.user.classpath.first</name>
+        <value>true</value>
+    </property>
++---+



Mime
View raw message