hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-890) The roundup for memory values on resource manager UI is misleading
Date Tue, 10 Sep 2013 21:29:54 GMT

    [ https://issues.apache.org/jira/browse/YARN-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13763533#comment-13763533

Zhijie Shen commented on YARN-890:

The patch can ensure the UI shows the configured resource.

Just think out loud. The problem happens because totalMB = allocatedMB + availableMB, and
availableMB is rounded up, which only happens to CapacityScheduler. [~tdhavle], would you
please confirm the problem only happens with CapacityScheduler?

While it makes sense to round up resource request, why do we need to round up available memory?
Let's say we have 100MB available, and the number will be rounded up to 1024MB. Should we
allow to allocate another 1024MB container?

In addition, availableMB seems to be only used by web now.
> The roundup for memory values on resource manager UI is misleading
> ------------------------------------------------------------------
>                 Key: YARN-890
>                 URL: https://issues.apache.org/jira/browse/YARN-890
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>            Reporter: Trupti Dhavle
>            Assignee: Xuan Gong
>         Attachments: Screen Shot 2013-07-10 at 10.43.34 AM.png, YARN-890.1.patch
> From the yarn-site.xml, I see following values-
> <property>
> <name>yarn.nodemanager.resource.memory-mb</name>
> <value>4192</value>
> </property>
> <property>
> <name>yarn.scheduler.maximum-allocation-mb</name>
> <value>4192</value>
> </property>
> <property>
> <name>yarn.scheduler.minimum-allocation-mb</name>
> <value>1024</value>
> </property>
> However the resourcemanager UI shows total memory as 5MB 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message