hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-13734) Add Heapsize variables for HDFS daemons
Date Fri, 13 Jul 2018 17:49:00 GMT

    [ https://issues.apache.org/jira/browse/HDFS-13734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16543508#comment-16543508

Allen Wittenauer commented on HDFS-13734:

> While still possible through adding the -Xmx to HDFS_DAEMON_OPTS, this is not intuitive
for this relatively common setting.

While I can appreciate the feeling, it leads to users configuring a lot more environment variables
than they need since _OPTS is almost always configured as well.  (Especially with zero hints
in the *-env.sh files that this is mostly unnecessary syntactic sugar.)  In addition, it adds
Yet More Shell Code and increases the support burden.  There is also the slippery slope problem:
 if there is a dedicate var for heap should there be a dedicate var for other java params
as well? What is the barrier?

It was always my intent to deprecate the equivalent MR and YARN variables for the exact same
reasons but I just never got around to it.

> Add Heapsize variables for HDFS daemons
> ---------------------------------------
>                 Key: HDFS-13734
>                 URL: https://issues.apache.org/jira/browse/HDFS-13734
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>          Components: datanode, journal-node, namenode
>    Affects Versions: 3.0.3
>            Reporter: Brandon Scheller
>            Priority: Major
> Currently there are no variables to set HDFS daemon heapsize differently. While still
possible through adding the -Xmx to HDFS_*DAEMON*_OPTS, this is not intuitive for this relatively
common setting.
> YARN currently has these separate YARN_*DAEMON*_HEAPSIZE variables supported so it seems
natural for HDFS too.
> It also looks like HDFS use to have this for namenode with HADOOP_NAMENODE_INIT_HEAPSIZE
> This JIRA is to have these configurations added/supported

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message