hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3547) Apps that have no resource demand should not participate scheduling
Date Mon, 27 Apr 2015 14:04:38 GMT

    [ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514170#comment-14514170

Jason Lowe commented on YARN-3547:

This looks like a duplicate of YARN-2176.  There is some discussion in that JIRA on how to
approach implementing it for both the capacity scheduler and fair scheduler.  At first glance
I'm not sure the proposed patch in this JIRA would work, as I believe requests can be present
with #containers=0 which would foil the sched.getAppSchedulingInfo().getAllResourceRequests().size()
!= 0 check.

> Apps that have no resource demand should not participate scheduling
> -------------------------------------------------------------------
>                 Key: YARN-3547
>                 URL: https://issues.apache.org/jira/browse/YARN-3547
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: scheduler
>            Reporter: Xianyin Xin
>         Attachments: YARN-3547.001.patch
> At present, all of the 'running' apps participate the scheduling process, however, most
of them may have no resource demand on a production cluster, as the app's status is running
other than waiting for resource at the most of the app's lifetime. It's not a wise way we
sort all the 'running' apps and try to fulfill them, especially on a large-scale cluster which
has heavy scheduling load. 

This message was sent by Atlassian JIRA

View raw message