hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "YunFan Zhou (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7535) We should display origin value of demand in fair scheduler page
Date Sun, 26 Nov 2017 13:46:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16266004#comment-16266004

YunFan Zhou commented on YARN-7535:

Hi, [~yufeigu] [~templedf]

I'm sorry to bother you, but recently I was wondering why the demand of the queue cannot exceed
*maxResources*. Is it a scheduling optimization need or a semantic consideration?

If it is a scheduling optimization requirement, I think it is necessary to show the real value
when the *demand *value of the queue is displayed on the web page.

If it's a semantic consideration, can you give me a place where you can find the exact definition?


YunFan Zhou

> We should display origin value of demand in fair scheduler page
> ---------------------------------------------------------------
>                 Key: YARN-7535
>                 URL: https://issues.apache.org/jira/browse/YARN-7535
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>            Reporter: YunFan Zhou
> The value of *demand* of leaf queue that we now view on the fair scheduler page shows
only the value of *maxResources* when the demand value is greater than *maxResources*. It
doesn't reflect the real situation. Most of the time, when we expand the queue, we often rely
on seeing the current demand real value.
> {code:java}
> private void updateDemandForApp(FSAppAttempt sched, Resource maxRes) {
>     sched.updateDemand();
>     Resource toAdd = sched.getDemand();
>     if (LOG.isDebugEnabled()) {
>       LOG.debug("Counting resource from " + sched.getName() + " " + toAdd
>           + "; Total resource consumption for " + getName() + " now "
>           + demand);
>     }
>     demand = Resources.add(demand, toAdd);
>     demand = Resources.componentwiseMin(demand, maxRes);
>   }
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message