hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashwin Shankar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent
Date Fri, 07 Aug 2015 01:11:47 GMT

    [ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661153#comment-14661153

Ashwin Shankar commented on YARN-3176:

It depends on the use case, if a user has lots of queues, and wants the default value to be
take effect, then based on your proposal he has to configure
maxRunningApps="default" for every one of them, which can be painful. Also I don't think we
want to inherit queue properties like minshare, weight which are queue specific properties
and won't make sense inheriting.
My 2 cents : in the example you described above( grandparent -> parent -> child), if
you think that's a corner case and if its just about configuring one queue, would it work
for you to just set maxApp at parent to >50, so that child queue can run 50 apps ?
[~kasha@cloudera.com], [~asuresh] thoughts on all of this ?

> In Fair Scheduler, child queue should inherit maxApp from its parent
> --------------------------------------------------------------------
>                 Key: YARN-3176
>                 URL: https://issues.apache.org/jira/browse/YARN-3176
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Siqi Li
>            Assignee: Siqi Li
>         Attachments: YARN-3176.v1.patch, YARN-3176.v2.patch
> if the child queue does not have a maxRunningApp limit, it will use the queueMaxAppsDefault.
This behavior is not quite right, since queueMaxAppsDefault is normally a small number, whereas
some parent queues do have maxRunningApp set to be more than the default

This message was sent by Atlassian JIRA

View raw message