hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely
Date Wed, 25 Sep 2013 23:11:03 GMT

    [ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778208#comment-13778208
] 

Sandy Ryza commented on YARN-1221:
----------------------------------

bq. The reason I removed the code above is that there is no corresponding unreserve method
got called.
Good catch.  But that shouldn't affect the amount shown in the web UI, because the metrics
for which there is double counting are the leaf queue metrics, whereas the value in the web
UI is based only off of the root queue metrics.  Is that not right?

bq. As far as I saw from the webUI, the available memory never get decremented when it allocates
memory to mr jobs.
Where are you seeing the available memory reported on the web UI?

To be clear, I'm referring to what's shown under the "Cluster Metrics" section when you go
to http://<rmhost>:<port>/cluster
                
> With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely
> -----------------------------------------------------------------------------
>
>                 Key: YARN-1221
>                 URL: https://issues.apache.org/jira/browse/YARN-1221
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager, scheduler
>    Affects Versions: 2.1.0-beta
>            Reporter: Sandy Ryza
>         Attachments: YARN1221_v1.patch.txt
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message