hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siqi Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely
Date Wed, 25 Sep 2013 22:41:03 GMT

    [ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778188#comment-13778188
] 

Siqi Li commented on YARN-1221:
-------------------------------

inside the reserve method, there are two methods got called
{noformat}
getMetrics().reserveResource(application.getUser(), container.getResource());
getMetrics().reserveResource(app.getUser(), container.getResource());
{noformat}
application.getUser() and app.getUser() return the same user. Therefore, the same metrics
get increased twice.

However, inside the unreserve method, there is only one method got called
{noformat}
getMetrics().unreserveResource(application.getUser(), rmContainer.getContainer().getResource());
{noformat}
In conclusion, the reserved memory gets increased twice and decreased only once.

As for the displayed total memory, it should equal to available memory. Since, the available
memory is actually the total memory, and it will not decrease when some memory is allocated
to mr jobs
                
> With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely
> -----------------------------------------------------------------------------
>
>                 Key: YARN-1221
>                 URL: https://issues.apache.org/jira/browse/YARN-1221
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager, scheduler
>    Affects Versions: 2.1.0-beta
>            Reporter: Sandy Ryza
>         Attachments: YARN1221_v1.patch.txt
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message