hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-383) Modify datanode configs to specify minimum JVM heapsize
Date Thu, 17 Jul 2014 19:25:05 GMT

     [ https://issues.apache.org/jira/browse/HDFS-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Allen Wittenauer resolved HDFS-383.
-----------------------------------

    Resolution: Fixed

This was fixed with the introduction of HADOOP_DATANODE_OPTS and related env vars.  See also
HADOOP-9902.

> Modify datanode configs to specify minimum JVM heapsize
> -------------------------------------------------------
>
>                 Key: HDFS-383
>                 URL: https://issues.apache.org/jira/browse/HDFS-383
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Robert Chansler
>
> >Y! 1524346
> Currently the Hadoop DataNodes are running with the option -Xmx1000m. They
> should and/or be running with the option -Xms1000m (if 1000m is correct; it
> seems high?)
> This turns out to be a sticky request. The place where Hadoop DFS is getting
> the definition of how to define that 1000m is the hadoop-env file. Read the
> code from bin/hadoop, which is used to start all hadoop processes:
> ) JAVA_HEAP_MAX=-Xmx1000m 
> ) 
> ) # check envvars which might override default args
> ) if [ "$HADOOP_HEAPSIZE" != "" ]; then
> )   #echo "run with heapsize $HADOOP_HEAPSIZE"
> )   JAVA_HEAP_MAX="-Xmx""$HADOOP_HEAPSIZE""m"
> )   #echo $JAVA_HEAP_MAX
> ) fi
> And here's the entry from hadoop-env.sh:
> ) # The maximum amount of heap to use, in MB. Default is 1000.
> ) export HADOOP_HEAPSIZE=1000
> The problem is that I believe we want to specify -Xms for datanodes ONLY. But
> the same script is used to start datanodes, tasktrackers, etc. This isn't
> trivially a matter of distributing different config files, the options provided
> are coded into the bin/hadoop executable. So this is an enhancement request.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message