hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat
Date Fri, 01 May 2015 04:51:06 GMT

    [ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522766#comment-14522766
] 

Vinod Kumar Vavilapalli commented on YARN-3481:
-----------------------------------------------

bq. Vinod Kumar Vavilapalli, it looks like YARN-2965 is very similar to this. Actually, this
also looks like a clone to YARN-1012. Anyway, from what I understand, those JIRAs want to
send utilization metrics in the heartbeat and that's pretty much what I'm targeting here.
My current prototype extends ContainersMonitorImpl and puts this information into the NodeHealthStatus.
I think I could do that in any of those JIRAs. 
Okay, I am going to assign YARN-1012 to you and close this as dup. Will also make YARN-3534
a sub-task of YARN-1011.

> Report NM aggregated container resource utilization in heartbeat
> ----------------------------------------------------------------
>
>                 Key: YARN-3481
>                 URL: https://issues.apache.org/jira/browse/YARN-3481
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager, resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Inigo Goiri
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> To allow the RM take better scheduling decisions, it should be aware of the actual utilization
of the containers. The NM would aggregate the ContainerMetrics and report it in every heartbeat.
> Related to YARN-1012 but aggregated to reduce the heartbeat overhead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message