hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siqi Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1415) In scheduler UI, including used memory in "Memory Total" seems to be inaccurate
Date Thu, 12 Dec 2013 23:58:08 GMT

    [ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13846938#comment-13846938
] 

Siqi Li commented on YARN-1415:
-------------------------------

According to the tests in TestQueueMetric.java, AvailableMB is never deducted when allocating
memory to applications. It actually means the total available memory of the cluster. Therefore,
totalMB displayed in the UI should only include AvailableMB.


> In scheduler UI, including used memory in "Memory Total" seems to be inaccurate
> -------------------------------------------------------------------------------
>
>                 Key: YARN-1415
>                 URL: https://issues.apache.org/jira/browse/YARN-1415
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager, scheduler
>            Reporter: Siqi Li
>             Fix For: 2.1.0-beta
>
>         Attachments: 1.png, 2.png
>
>
> "Memory Total" is currently a sum of availableMB, allocatedMB, and reservedMB. 
> It seems that the term "availableMB" actually means "total memory", since it doesn't
get decreased when some jobs use a certain amount of memory.
> Hence, the Memory Total should not include allocatedMB, or availableMB doesn't get updated
properly.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message