hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aajis...@apache.org
Subject hadoop git commit: MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
Date Thu, 22 Dec 2016 19:49:11 GMT
Repository: hadoop
Updated Branches:
  refs/heads/trunk 38e66d4d6 -> 22befbd58


MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A
Chundatt.


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/22befbd5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/22befbd5
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/22befbd5

Branch: refs/heads/trunk
Commit: 22befbd585f65934e1d9ae5782a8f961192c0750
Parents: 38e66d4
Author: Akira Ajisaka <aajisaka@apache.org>
Authored: Fri Dec 23 04:48:04 2016 +0900
Committer: Akira Ajisaka <aajisaka@apache.org>
Committed: Fri Dec 23 04:48:04 2016 +0900

----------------------------------------------------------------------
 .../hadoop-common/src/site/markdown/ClusterSetup.md     |  1 +
 .../hadoop-common/src/site/markdown/SingleCluster.md.vm | 12 ++++--------
 2 files changed, 5 insertions(+), 8 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hadoop/blob/22befbd5/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md b/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
index 56b43e6..e2ccbf0 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
@@ -156,6 +156,7 @@ This section deals with important parameters to be specified in the given
config
 | `yarn.nodemanager.remote-app-log-dir` | */logs* | HDFS directory where the application
logs are moved on application completion. Need to set appropriate permissions. Only applicable
if log-aggregation is enabled. |
 | `yarn.nodemanager.remote-app-log-dir-suffix` | *logs* | Suffix appended to the remote log
dir. Logs will be aggregated to ${yarn.nodemanager.remote-app-log-dir}/${user}/${thisParam}
Only applicable if log-aggregation is enabled. |
 | `yarn.nodemanager.aux-services` | mapreduce\_shuffle | Shuffle service that needs to be
set for Map Reduce applications. |
+| `yarn.nodemanager.env-whitelist` | Environment properties to be inherited by containers
from NodeManagers | For mapreduce application in addition to the default values HADOOP\_MAPRED_HOME
should to be added. Property value should JAVA\_HOME,HADOOP\_COMMON\_HOME,HADOOP\_HDFS\_HOME,HADOOP\_CONF\_DIR,CLASSPATH\_PREPEND\_DISTCACHE,HADOOP\_YARN\_HOME,HADOOP\_MAPRED\_HOME
|
 
   * Configurations for History Server (Needs to be moved elsewhere):
 

http://git-wip-us.apache.org/repos/asf/hadoop/blob/22befbd5/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm b/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
index 4825e00..fb4df9a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
@@ -190,14 +190,6 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions]
                 <name>mapreduce.framework.name</name>
                 <value>yarn</value>
             </property>
-            <property>
-                <name>mapreduce.admin.user.env</name>
-                <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value>
-            </property>
-            <property>
-                <name>yarn.app.mapreduce.am.env</name>
-                <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value>
-            </property>
         </configuration>
 
     `etc/hadoop/yarn-site.xml`:
@@ -207,6 +199,10 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions]
                 <name>yarn.nodemanager.aux-services</name>
                 <value>mapreduce_shuffle</value>
             </property>
+            <property>
+                <name>yarn.nodemanager.env-whitelist</name>
+                <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value>
+            </property>
         </configuration>
 
 2.  Start ResourceManager daemon and NodeManager daemon:


---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org


Mime
View raw message