hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting
Date Sat, 09 Nov 2013 03:32:19 GMT

    [ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13817985#comment-13817985
] 

Sandy Ryza commented on YARN-807:
---------------------------------

Attaching a rebased patch.  It also modifies getAppsInQueue to only return IDs, not the full
scheduler application. I'd prefer not to have this depend on YARN-1317.  If they're both ready
at close to the same time, I'm happy to have YARN-1317 go in first and do the work of rebasing
this on top of it.

> When querying apps by queue, iterating over all apps is inefficient and limiting 
> ---------------------------------------------------------------------------------
>
>                 Key: YARN-807
>                 URL: https://issues.apache.org/jira/browse/YARN-807
>             Project: Hadoop YARN
>          Issue Type: Improvement
>    Affects Versions: 2.0.4-alpha
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: YARN-807-1.patch, YARN-807.patch
>
>
> The question "which apps are in queue x" can be asked via the RM REST APIs, through the
ClientRMService, and through the command line.  In all these cases, the question is answered
by scanning through every RMApp and filtering by the app's queue name.
> All schedulers maintain a mapping of queues to applications.  I think it would make more
sense to ask the schedulers which applications are in a given queue. This is what was done
in MR1. This would also have the advantage of allowing a parent queue to return all the applications
on leaf queues under it, and allow queue name aliases, as in the way that "root.default" and
"default" refer to the same queue in the fair scheduler.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message