hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Inigo Goiri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat
Date Mon, 13 Apr 2015 22:04:12 GMT

    [ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493172#comment-14493172
] 

Inigo Goiri commented on YARN-3481:
-----------------------------------

To make YARN aware of the actual use of resources in the machines and not only allocation,
the RM should track the actual utilization. Right now, the ContainerMonitor collects the CPU
and the memory utilization for each container (YARN-3122 and YARN-2984). We want to collect
this information in the NodeStatusUpdater and report it to the RM in the NodeStatus. This
would add a Resource (availableResources) to the heartbeat.

Thoughts?

> Report NM aggregated container resource utilization in heartbeat
> ----------------------------------------------------------------
>
>                 Key: YARN-3481
>                 URL: https://issues.apache.org/jira/browse/YARN-3481
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager, resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Inigo Goiri
>            Priority: Minor
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> To allow the RM take better scheduling decisions, it should be aware of the actual utilization
of the containers. The NM would aggregate the ContainerMetrics and report it in every heartbeat.
> Related to YARN-1012 but aggregated to reduce the heartbeat overhead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message