hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carlo Curino (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2248) Capacity Scheduler changes for moving apps between queues
Date Thu, 07 Aug 2014 18:08:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089538#comment-14089538

Carlo Curino commented on YARN-2248:

I work with [~subru] on this... We can run this further on our test clusters (to increase
our confidence level before commit), we have a Gridmix harness that among other thing ends
up exercising this (once clean we will release as part of YARN-1051). 

More generally, I agree that merging is the two is the best approach and committing in 2.6.0
sounds good. 

> Capacity Scheduler changes for moving apps between queues
> ---------------------------------------------------------
>                 Key: YARN-2248
>                 URL: https://issues.apache.org/jira/browse/YARN-2248
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacityscheduler
>            Reporter: Janos Matyas
>            Assignee: Janos Matyas
>             Fix For: 2.6.0
>         Attachments: YARN-2248-1.patch, YARN-2248-2.patch, YARN-2248-3.patch
> We would like to have the capability (same as the Fair Scheduler has) to move applications
between queues. 
> We have made a baseline implementation and tests to start with - and we would like the
community to review, come up with suggestions and finally have this contributed. 
> The current implementation is available for 2.4.1 - so the first thing is that we'd need
to identify the target version as there are differences between 2.4.* and 3.* interfaces.
> The story behind is available at http://blog.sequenceiq.com/blog/2014/07/02/move-applications-between-queues/
and the baseline implementation and test at:
> https://github.com/sequenceiq/hadoop-common/blob/branch-2.4.1/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/a/ExtendedCapacityScheduler.java#L924
> https://github.com/sequenceiq/hadoop-common/blob/branch-2.4.1/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/a/TestExtendedCapacitySchedulerAppMove.java

This message was sent by Atlassian JIRA

View raw message