hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3003) Provide API for client to retrieve label to node mapping
Date Tue, 20 Jan 2015 19:10:35 GMT

    [ https://issues.apache.org/jira/browse/YARN-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284224#comment-14284224

Wangda Tan commented on YARN-3003:

Thanks for providing your thoughts!

To Naga's first point:
I think performance is one concern (as mentioned by Varun, we may need to rewrite some part
of code to make it's efficient). And we need more solid use case / input for that. For first
step, we can focus on simply receive a set of labels as input and return a labels->nodes

To second point, I think it's important to keep it in memory, not much extra memory needed
to keep such mapping in memory.

And thanks for [~varun_saxena] working on this, one suggestion is, could you split it to two
parts, one is adding getLabelsToNodes API and implementation to NodeLabelsManager. Another
one is adding API and implementation to YarnClient. (latter one will depends on previous one).
Sounds good?

> Provide API for client to retrieve label to node mapping
> --------------------------------------------------------
>                 Key: YARN-3003
>                 URL: https://issues.apache.org/jira/browse/YARN-3003
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: client, resourcemanager
>            Reporter: Ted Yu
>            Assignee: Varun Saxena
>         Attachments: YARN-3003.001.patch
> Currently YarnClient#getNodeToLabels() returns the mapping from NodeId to set of labels
associated with the node.
> Client (such as Slider) may be interested in label to node mapping - given label, return
the nodes with this label.

This message was sent by Atlassian JIRA

View raw message