hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei Yan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-9870) Mixed configurations for JVM -Xmx in hadoop command
Date Tue, 13 Aug 2013 20:04:48 GMT
Wei Yan created HADOOP-9870:

             Summary: Mixed configurations for JVM -Xmx in hadoop command
                 Key: HADOOP-9870
                 URL: https://issues.apache.org/jira/browse/HADOOP-9870
             Project: Hadoop Common
          Issue Type: Bug
            Reporter: Wei Yan

When we use hadoop command to launch a class, there are two places setting the -Xmx configuration.

*1*. The first place is located in file {{hadoop-common-project/hadoop-common/src/main/bin/hadoop}}.
Here $JAVA_HEAP_MAX is configured in hadoop-config.sh ({{hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh}}).
The default value is "-Xmx1000m".

*2*. The second place is set with $HADOOP_OPTS in file {{hadoop-common-project/hadoop-common/src/main/bin/hadoop}}.
Here $HADOOP_CLIENT_OPTS is set in hadoop-env.sh ({{hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh}})

Currently the final default java command looks like:
{code}java -Xmx1000m .... -Xmx512m CLASS_NAME ARGUMENTS"{code}

And if users also specify the -Xmx in the $HADOOP_CLIENT_OPTS, there will be three -Xmx configurations.

The hadoop setup tutorial only discusses hadoop-env.sh, and it looks that users should not
make any change in hadoop-config.sh.

We should let hadoop smart to choose the right one before launching the java command, instead
of leaving for jvm to make the decision.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message