hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lei Guo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node
Date Tue, 10 Mar 2015 22:56:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355891#comment-14355891

Lei Guo commented on YARN-3332:

Any consideration to support plug-in for customized resource statistics collection in NM?
We may need other type resource information for scheduling purpose later, for example, GPU
related information. 

> [Umbrella] Unified Resource Statistics Collection per node
> ----------------------------------------------------------
>                 Key: YARN-3332
>                 URL: https://issues.apache.org/jira/browse/YARN-3332
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Vinod Kumar Vavilapalli
>         Attachments: Design - UnifiedResourceStatisticsCollection.pdf
> Today in YARN, NodeManager collects statistics like per container resource usage and
overall physical resources available on the machine. Currently this is used internally in
YARN by the NodeManager for only a limited usage: automatically determining the capacity of
resources on node and enforcing memory usage to what is reserved per container.
> This proposal is to extend the existing architecture and collect statistics for usage
b​eyond​ the existing use­cases.
> Proposal attached in comments.

This message was sent by Atlassian JIRA

View raw message