hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Inigo Goiri (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3534) Report node resource utilization
Date Thu, 23 Apr 2015 05:34:38 GMT

    [ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508490#comment-14508490
] 

Inigo Goiri commented on YARN-3534:
-----------------------------------

[~sunilg], my plan is to send the same entity as in YARN-3482: ResourceUtilization. For now,
it will have memory in MB and Virtual Cores as a float. We can extend this for other resources.
In terms of the collection of the utilization, this will be monitored by the NodeResourceMonitor
(currently empty) which will mimic the behavior of the ContainerMonitor which uses two configuration
parameters: (1) if we monitor the resources of the node and (2) how often the resources are
monitored.

I'm in the last stages of testing it and tomorrow I'll post a patch with this change. The
structure was already there so it's a matter of adding the communication part..


> Report node resource utilization
> --------------------------------
>
>                 Key: YARN-3534
>                 URL: https://issues.apache.org/jira/browse/YARN-3534
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>    Affects Versions: 2.7.0
>            Reporter: Inigo Goiri
>            Assignee: Inigo Goiri
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> YARN should be aware of the resource utilization of the nodes when scheduling containers.
For this, this task will implement the NodeResourceMonitor and send this information to the
Resource Manager in the heartbeat.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message