hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-890) The roundup for memory values on resource manager UI is misleading
Date Thu, 03 Oct 2013 07:10:14 GMT

    [ https://issues.apache.org/jira/browse/YARN-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784878#comment-13784878

Zhijie Shen commented on YARN-890:

bq. Is there a similar round up in the actual allocation code, which may cause additional
containers to be allocated to a queue ?

Checked this before. It seems it's only for web UI.

bq.  or should it just be rounding down at registration ?

It sounds make sense. Allocated memory will always be a multiple of  minimum-allocation-mb,
therefore, the available memory will be so as well.

In this sense, minimum-allocation-mb is somehow considered as 1 unit memory. We allocate n
units memory to a container, the cluster remains m units container, blah blah... Probably,
we can simplify the internal memory description. Just think out loud.

> The roundup for memory values on resource manager UI is misleading
> ------------------------------------------------------------------
>                 Key: YARN-890
>                 URL: https://issues.apache.org/jira/browse/YARN-890
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>            Reporter: Trupti Dhavle
>            Assignee: Xuan Gong
>         Attachments: Screen Shot 2013-07-10 at 10.43.34 AM.png, YARN-890.1.patch, YARN-890.2.patch
> From the yarn-site.xml, I see following values-
> <property>
> <name>yarn.nodemanager.resource.memory-mb</name>
> <value>4192</value>
> </property>
> <property>
> <name>yarn.scheduler.maximum-allocation-mb</name>
> <value>4192</value>
> </property>
> <property>
> <name>yarn.scheduler.minimum-allocation-mb</name>
> <value>1024</value>
> </property>
> However the resourcemanager UI shows total memory as 5MB 

This message was sent by Atlassian JIRA

View raw message