hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mahadev konar (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3059) QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released
Date Tue, 11 Oct 2011 19:53:12 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125331#comment-13125331
] 

Mahadev konar commented on MAPREDUCE-3059:
------------------------------------------

Devaraj,
 Why cant we just calculate these metrics in the RM itself? We do not have to send such metrics
from NM to RM and aggregate them. Its much easier to calculate the metrics in the RM itself
(probably per queue as well). Anything I am missing?
                
> QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released
> -----------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3059
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3059
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Karam Singh
>            Assignee: Devaraj K
>            Priority: Blocker
>             Fix For: 0.23.0
>
>
> QueueMetrics for ResourceManager do not have any metrics for aggregate containers-allocated
and containers-released.
> We need the aggregates of containers-allocated and containers-released to figure out
the rate at which RM is dishing out containers. NodeManager do have containers-launched and
container-released metrics, but this is not across all nodes; so to get the cluster level
aggregate, we need to preprocess NM metrics from all nodes - which is troublesome.
> Currently, we do have AllocatedContainers and PendingContainers which reflect the running
containers given out to AMs, and containers waiting for allocation respectively.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message