hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siqi Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1415) In scheduler UI, including used memory in "Memory Total" seems to be inaccurate
Date Fri, 15 Nov 2013 22:05:22 GMT

    [ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13824154#comment-13824154
] 

Siqi Li commented on YARN-1415:
-------------------------------

The first image shows that no job is running, and total memory is 1.9 TB
The second image shows that a simple wordcount job is running, and using 49 GB memory. However,
the total memory also got increased by 49 GB.
The same issue will occur when some jobs reserve a certain amount of memory. It will get added
into the total memory.

> In scheduler UI, including used memory in "Memory Total" seems to be inaccurate
> -------------------------------------------------------------------------------
>
>                 Key: YARN-1415
>                 URL: https://issues.apache.org/jira/browse/YARN-1415
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager, scheduler
>            Reporter: Siqi Li
>             Fix For: 2.1.0-beta
>
>         Attachments: 1.png, 2.png
>
>
> "Memory Total" is currently a sum of availableMB, allocatedMB, and reservedMB. 
> It seems that the term "availableMB" actually means "total memory", since it doesn't
get decreased when some jobs use a certain amount of memory.
> Hence, the Memory Total should not include allocatedMB, or availableMB doesn't get updated
properly.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message