hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Panagiotis Garefalakis (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-5468) Scheduling of long-running applications
Date Wed, 03 Aug 2016 00:04:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405052#comment-15405052
] 

Panagiotis Garefalakis edited comment on YARN-5468 at 8/3/16 12:03 AM:
-----------------------------------------------------------------------

Attaching a patch to showcase above proposal. 

In this first patch we are introducing allocation tags and three placement constraints: affinity,
anti-affinity, cardinality. We are planning to consolidate those in a single constraint in
the 2nd version of the patch. For the time being we do not support time constraints.

In the current version the requests are accommodated in an online, greedy fashion.

We extend distribute-shell application Client and AM to demonstrate inter-job placement constraints.
Some unit-tests are also included to show the supported constraints (affinity, anti-affinity,
and cardinality) in Node and Rack level.


was (Author: pgaref):
Attaching a patch to showcase above proposal. 

In this first patch we are introducing allocation tags and three placement constraints: affinity,
anti-affinity, cardinality. We are planning to consolidate those in a single constraint in
the 2nd version of the patch. For the time being we do not support time constraints.

We extend distribute-shell Client and AM to demonstrate affinity inter-job constraints. Some
unit-tests are also included to show the supported constraints (affinity, anti-affinity, and
cardinality) in Node and Rack level.

> Scheduling of long-running applications
> ---------------------------------------
>
>                 Key: YARN-5468
>                 URL: https://issues.apache.org/jira/browse/YARN-5468
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: capacityscheduler, fairscheduler
>            Reporter: Konstantinos Karanasos
>            Assignee: Konstantinos Karanasos
>         Attachments: YARN-5468.prototype.patch
>
>
> This JIRA is about the scheduling of applications with long-running tasks.
> It will include adding support to the YARN for a richer set of scheduling constraints
(such as affinity, anti-affinity, cardinality and time constraints), and extending the schedulers
to take them into account during placement of containers to nodes.
> We plan to have both an online version that will accommodate such requests as they arrive,
as well as a Long-running Application Planner that will make more global decisions by considering
multiple applications at once.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message