incubator-ambari-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Wagle (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AMBARI-2868) YARN NodeManager directories when passes as comma separated directories - agent create a single directory including comma.
Date Sun, 11 Aug 2013 19:05:47 GMT

    [ https://issues.apache.org/jira/browse/AMBARI-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13736384#comment-13736384
] 

Siddharth Wagle commented on AMBARI-2868:
-----------------------------------------

NN - good
RM - none
JN - dfs.journalnode.edits.dir - the path where the JournalNode daemon will store its local
state
This is the absolute path on the JournalNode machines where the edits and other local state
used by the JNs will be stored. You may only use a single path for this configuration.

[~mahadev]
Should be fine.
                
> YARN NodeManager directories when passes as comma separated directories - agent create
a single directory including comma.
> --------------------------------------------------------------------------------------------------------------------------
>
>                 Key: AMBARI-2868
>                 URL: https://issues.apache.org/jira/browse/AMBARI-2868
>             Project: Ambari
>          Issue Type: Bug
>          Components: agent
>    Affects Versions: 1.4.0
>            Reporter: Siddharth Wagle
>            Assignee: Siddharth Wagle
>             Fix For: 1.4.0
>
>         Attachments: AMBARI-2868.patch
>
>
> Looks like here is what happens:
> {code}
> $nm_local_dirs = hdp_default("yarn-site/yarn.nodemanager.local-dirs", "$hadoop_tmp_dir/nm-local-dir")
> {code}
> This code takes in the nm local directories as comman separated files, but its never
split around the comma's.
> When using multiple directories for  NodeManager local directories here is what I saw
on NM:
> {code}
> root@ip-10-80-149-186 yarn]# pwd
> /grid/0/hadoop/yarn,/grid/1/hadoop/yarn
> {code}
> A directory with a comma was created. This causes NM to go unhealthy which causes the
jobs to fail - and all.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message