hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Varun Vasudev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4081) Add support for multiple resource types in the Resource class
Date Thu, 27 Aug 2015 07:45:47 GMT

    [ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716228#comment-14716228

Varun Vasudev commented on YARN-4081:

Thanks for the feedback Srikanth!

bq. why use a Map. Is there a rough idea how many different resources one may want to encode?

I would like the resource types supported to be configured and not set in code. There's a
proposal attached in the parent JIRA that goes into more detail on this. We've seen tickets
filed on YARN for adding disk, network, and HDFS bandwidth as resource types. I would prefer
it if we can let users just configure the types they want to use and allow them to add arbitrary
resource types for scheduling(for example schedule based on the number of licenses available
on a node). Is there an alternate structure you would prefer for me to use?

bq. Ditto for encapsulating strings in URIs
In the proposal, I propose using URIs as the identifier for the resource type(similar to what
Kubernetes uses).

bq. ResourceInformation wrapper over doubles
I'm didn't understand this - are you asking why we're using ResourceInformation instead of
using doubles?

> Add support for multiple resource types in the Resource class
> -------------------------------------------------------------
>                 Key: YARN-4081
>                 URL: https://issues.apache.org/jira/browse/YARN-4081
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: YARN-4081-YARN-3926.001.patch
> For adding support for multiple resource types, we need to add support for this in the
Resource class.

This message was sent by Atlassian JIRA

View raw message