hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling
Date Thu, 30 Apr 2015 23:59:07 GMT

    [ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522518#comment-14522518
] 

Wangda Tan commented on YARN-3547:
----------------------------------

[~xinxianyin], just added you to contributor list so that you can assign JIRAs to yourself.

Looked at your patch, now it make the "pendingApps" to be apps participate scheduling. It's
an ArrayList so every add/remove takes O(n). I think it's better to make it to be a Set to
do faster add/remove.

> FairScheduler: Apps that have no resource demand should not participate scheduling
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-3547
>                 URL: https://issues.apache.org/jira/browse/YARN-3547
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler
>            Reporter: Xianyin Xin
>            Assignee: Xianyin Xin
>         Attachments: YARN-3547.001.patch, YARN-3547.002.patch
>
>
> At present, all of the 'running' apps participate the scheduling process, however, most
of them may have no resource demand on a production cluster, as the app's status is running
other than waiting for resource at the most of the app's lifetime. It's not a wise way we
sort all the 'running' apps and try to fulfill them, especially on a large-scale cluster which
has heavy scheduling load. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message