hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Vasudev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3534) Report node resource utilization
Date Thu, 30 Apr 2015 10:13:06 GMT

    [ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521261#comment-14521261

Varun Vasudev commented on YARN-3534:

Thanks for the path [~elgoiri]! Is it possible for you to split up the patch into two - one
to record the memory and cpu utilization in NodeResourceMonitorImpl and one for the RPC changes.
If you could file a separate JIRA for the NodeResourceMonitorImpl changes that you have made(they
are definitely required and should go in), that would be ideal.

I'm not sure if we should use RPC  to expose the stats. Using RPC restricts the stats to a
limited number of services whereas using REST lets a larger number of services access the
stats - which is why YARN-3332 wants to use REST to expose the NM stats. Using REST should
also make it easier to add more stats with respect to utilization.

> Report node resource utilization
> --------------------------------
>                 Key: YARN-3534
>                 URL: https://issues.apache.org/jira/browse/YARN-3534
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Inigo Goiri
>            Assignee: Inigo Goiri
>         Attachments: YARN-3534-1.patch, YARN-3534-2.patch, YARN-3534-3.patch, YARN-3534-3.patch
>   Original Estimate: 336h
>  Remaining Estimate: 336h
> YARN should be aware of the resource utilization of the nodes when scheduling containers.
For this, this task will implement the NodeResourceMonitor and send this information to the
Resource Manager in the heartbeat.

This message was sent by Atlassian JIRA

View raw message