hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Templeton (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6261) YARN queue mapping fails for users with no group
Date Thu, 02 Mar 2017 00:26:45 GMT

    [ https://issues.apache.org/jira/browse/YARN-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891360#comment-15891360

Daniel Templeton commented on YARN-6261:

Thanks for the patch, [~pvillard].  Unfortunately, the {{getGroups()}} method makes no distinction
between a user with no groups and a failure retrieving a user from the cache.  I think the
cheapest way to deal with that is to add a log message that explain why the group mapping
is not being applied.  Seems like it should be warn or info, probably warn.  It's a scenario
that's undesirable and should be addressed no matter which reason it fails.  The better solution
would be to update the API to throw different exceptions, but that could be a pretty big change.

> YARN queue mapping fails for users with no group
> ------------------------------------------------
>                 Key: YARN-6261
>                 URL: https://issues.apache.org/jira/browse/YARN-6261
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Pierre Villard
>            Assignee: Pierre Villard
> *Issue:* 
> Since Hadoop group mapping can be overridden (to get groups from an AD for example),
it is possible to be in a situation where a user does not have any group (because the user
is not in the AD but only defined locally):
> {noformat}
> $ hdfs groups zeppelin
> zeppelin:
> {noformat}
> In this case, if the YARN Queue Mapping is configured and contains at least one mapping
of {{MappingType.GROUP}}, it won't be possible to get a queue for the job submitted by such
a user and the job won't be submitted at all.
> *Expected result:* 
> In case a user does not have any group and no mapping is defined for this user, the default
queue should be assigned whatever the queue mapping definition is.
> *Workaround:* 
> A workaround is to define a group mapping of {{MappingType.USER}} for the given user
before defining any mapping of {{MappingType.GROUP}}.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message