hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-161) DataNode will create missing dfs.data.dir directories contrary to docs
Date Sun, 29 Apr 2012 12:42:48 GMT

    [ https://issues.apache.org/jira/browse/HDFS-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264522#comment-13264522

Harsh J commented on HDFS-161:

[~nemon] - There are better ways to managing configurations on a per-instance level than doing
those things. There are several configuration management tools out there you can consume.

I'd personally consider that a bad practice cause when it comes to a time where you're (or
someone else is) going to look at the dfs.datanode.data.dir list to debug an issue on the
cluster, it would only mislead with some false values until you realize.

FWIW in here, I think the doc ought to be fixed instead. There's numerous times this 'feature'
has come handy in my experience.
> DataNode will create missing dfs.data.dir directories contrary to docs
> ----------------------------------------------------------------------
>                 Key: HDFS-161
>                 URL: https://issues.apache.org/jira/browse/HDFS-161
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node, documentation
>            Reporter: Todd Lipcon
>            Priority: Minor
>              Labels: newbie
> The documentation (and HADOOP-340) seems to indicate that if a data dir listed in dfs.data.dir
does not exist, it will be ignored. In fact, if the hadoop user has access to (essentially)
mkdir -p the data dir it will do so.
> I'd like to add another configuration parameter, perhaps dfs.data.dir.create with default
true (to not break any existing tutorials). If this is set to false then data dirs that do
not exist will not implicitly be created.
> The motivation for this is the same as HADOOP-340 - we have different disk configs in
our cluster and hadoop is creating data dirs where we do not want them.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message