hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiwei Yang (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-8013) Support APP-TAG namespace for allocation tags
Date Tue, 03 Apr 2018 02:47:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423400#comment-16423400
] 

Weiwei Yang edited comment on YARN-8013 at 4/3/18 2:46 AM:
-----------------------------------------------------------

Hi [~kkaranasos]

Thanks, I've fixed the checkstyle issues in v7 patch, just uploaded. The failing UT {{TestIncreaseAllocationExpirer}}
is not caused by this patch, it runs fine on my laptop (looks like an intermittent failure).
{quote}I think we should instead make it Self by default in the PlacementConstraints and never
let it be null.
{quote}
Agree, we should avoid null values any more. I will file another Jira to get this fixed.


was (Author: cheersyang):
Hi [~kkaranasos]

Thanks, I've fixed the checkstyle issues in v7 patch, just uploaded. The failing UT \{{TestIncreaseAllocationExpirer}}
is not caused by this patch, it runs fine on my laptop (looks like an intermittent failure).

> Support APP-TAG namespace for allocation tags
> ---------------------------------------------
>
>                 Key: YARN-8013
>                 URL: https://issues.apache.org/jira/browse/YARN-8013
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>            Priority: Major
>         Attachments: YARN-8013.001.patch, YARN-8013.002.patch, YARN-8013.003.patch, YARN-8013.004.patch,
YARN-8013.005.patch, YARN-8013.006.patch, YARN-8013.007.patch
>
>
> YARN-1461 adds *Application Tag* concept to Yarn applications, user is able to annotate
application with multiple tags to classify apps. We can leverage this to represent a namespace
for a certain group of apps. So instead of calling *app-label*, propose to call it *app-tag*.
> A typical use case is,
> There are a lot of TF jobs running on Yarn, and some of them are consuming resources
heavily. So we want to limit number of PS on each node for such BIG players but ignore those
SMALL ones. To achieve this, we can do following steps:
>  # Add application tag "big-tf" to these big TF jobs
>  # For each PS request, we add "ps" source tag and map it to constraint "{color:#d04437}notin,
node, tensorflow/ps{color}" or "{color:#d04437}cardinality, node, tensorflow/ps{color}{color:#d04437},
0, 2{color}" for finer grained controls.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message