hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xuekang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7535) We should display origin value of demand in fair scheduler page
Date Mon, 27 Nov 2017 10:01:19 GMT

    [ https://issues.apache.org/jira/browse/YARN-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16266598#comment-16266598

xuekang commented on YARN-7535:

I understand that a queue cannot use more resource than its max resources, but demand is not
The users should know how many resources their apps are requesting, and the YARN admin should
know how many extra resources should be added to the queue, if the demand is always larger
than the max resources. Now, when the demand is larger than the max value,  the demand value
in the RM web UI  is just a limit instead of a real demand, which is unreasonable.

> We should display origin value of demand in fair scheduler page
> ---------------------------------------------------------------
>                 Key: YARN-7535
>                 URL: https://issues.apache.org/jira/browse/YARN-7535
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>            Reporter: YunFan Zhou
>            Assignee: YunFan Zhou
> The value of *demand* of leaf queue that we now view on the fair scheduler page shows
only the value of *maxResources* when the demand value is greater than *maxResources*. It
doesn't reflect the real situation. Most of the time, when we expand the queue, we often rely
on seeing the current demand real value.
> {code:java}
> private void updateDemandForApp(FSAppAttempt sched, Resource maxRes) {
>     sched.updateDemand();
>     Resource toAdd = sched.getDemand();
>     if (LOG.isDebugEnabled()) {
>       LOG.debug("Counting resource from " + sched.getName() + " " + toAdd
>           + "; Total resource consumption for " + getName() + " now "
>           + demand);
>     }
>     demand = Resources.add(demand, toAdd);
>     demand = Resources.componentwiseMin(demand, maxRes);
>   }
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message