hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.
Date Tue, 25 Oct 2016 15:06:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15605561#comment-15605561
] 

Naganarasimha G R commented on YARN-5765:
-----------------------------------------

Thanks [~haibochen], for giving some insights on the chmod command, was not aware of it, 
So at first glance As initially suggested it would be be ideal to set umask as {{ umask(0027);}}
would ideal than chmod in {{create_validate_dir}} but before making the system call *mkdir*
.This will ensure that if the cluster has been configured with a restrictive umask "e.g.:
umask 077" still the directories are set with proper rights. or another approach i can think
of is setting in this way but not sure whether it works ...
{code}
} else {
 // Explicitly set permission after creating the directory in case
 // umask has been set to a restrictive value, i.e., 0077.
 perm = perm | S_ISGID;
 if (chmod(npath, perm) != 0) {
  int permInt = perm & (S_IRWXU | S_IRWXG | S_IRWXO);
  fprintf(LOGFILE, "Can't chmod %s to the required permission %o - %s\n",
	                npath, permInt, strerror(errno));
   return -1;
}
{code}
Thoughts ? 

> LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.
> --------------------------------------------------------------------------------------
>
>                 Key: YARN-5765
>                 URL: https://issues.apache.org/jira/browse/YARN-5765
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.8.0, 3.0.0-alpha1
>            Reporter: Haibo Chen
>            Assignee: Haibo Chen
>            Priority: Blocker
>
> LinuxContainerExecutor creates usercache/\{userId\}/appcache/\{appId\} with wrong group
owner, causing Log aggregation and ShuffleHandler to fail because node manager process does
not have permission to read the files under the directory.
> This can be easily reproduced by enabling LCE and submitting a MR example job. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message