hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-3409) Add constraint node labels
Date Fri, 27 Mar 2015 16:51:53 GMT

     [ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wangda Tan updated YARN-3409:
-----------------------------
    Description: 
Specify only one label for each node (IAW, partition a cluster) is a way to determinate how
resources of a special set of nodes could be shared by a group of entities (like teams, departments,
etc.). Partitions of a cluster has following characteristics:
- Cluster divided to several disjoint sub clusters.
- ACL/priority can apply on partition (Only market team / marke team has priority to use the
partition).
- Percentage of capacities can apply on partition (Market team has 40% minimum capacity and
Dev team has 60% of minimum capacity of the partition).

Constraints are orthogonal to partition, they’re describing attributes of node’s hardware/software
just for affinity. Some example of constraints:
- glibc version
- JDK version
- Type of CPU (x86_64/i686)
- Type of OS (windows, linux, etc.)

With this, application can be able to ask for resource has (glibc.version >= 2.20 &&
JDK.version >= 8u20 && x86_64).


  was:
Specify only one label for each node (IAW, partition a cluster) is a way to determinate how
resources of a special set of nodes could be shared by a group of entities (like teams, departments,
etc.). Partitions of a cluster has following characteristics:
- ACL/priority (Only market team / marke team has priority to use the partition).
Percentage of capacities (Market team has 40% minimum capacity and Dev team has 60% of minimum
capacity of the partition).
- One node can only belong to one partition.
- One resource request can only ask for one partition

Constraints are orthogonal to partition, they’re describing attributes of node’s hardware/software
just for affinity. Some example of constraints:
- glibc version
- JDK version
- Type of CPU (x86_64/i686)
- Type of OS (windows, linux, etc.)

With this, application can be able to ask for resource has (glibc.version >= 2.20 &&
JDK.version >= 8u20 && x86_64).



> Add constraint node labels
> --------------------------
>
>                 Key: YARN-3409
>                 URL: https://issues.apache.org/jira/browse/YARN-3409
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api, client, resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Wangda Tan
>
> Specify only one label for each node (IAW, partition a cluster) is a way to determinate
how resources of a special set of nodes could be shared by a group of entities (like teams,
departments, etc.). Partitions of a cluster has following characteristics:
> - Cluster divided to several disjoint sub clusters.
> - ACL/priority can apply on partition (Only market team / marke team has priority to
use the partition).
> - Percentage of capacities can apply on partition (Market team has 40% minimum capacity
and Dev team has 60% of minimum capacity of the partition).
> Constraints are orthogonal to partition, they’re describing attributes of node’s
hardware/software just for affinity. Some example of constraints:
> - glibc version
> - JDK version
> - Type of CPU (x86_64/i686)
> - Type of OS (windows, linux, etc.)
> With this, application can be able to ask for resource has (glibc.version >= 2.20
&& JDK.version >= 8u20 && x86_64).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message