hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Payne (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler
Date Tue, 01 Dec 2015 19:22:11 GMT

     [ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eric Payne updated YARN-3769:
-----------------------------
    Attachment: YARN-3769-branch-2.6.001.patch

Attaching {{YARN-3769-branch-2.6.001.patch}} for backport to branch-2.6.

TestLeafQueue unit test for multiple apps by multiple users had to be modified specifically
to allow for all apps to be active at the same time since the way active apps is calculated
is different between 2.6 and 2.7.

> Consider user limit when calculating total pending resource for preemption policy in
Capacity Scheduler
> -------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-3769
>                 URL: https://issues.apache.org/jira/browse/YARN-3769
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacityscheduler
>    Affects Versions: 2.6.0, 2.7.0, 2.8.0
>            Reporter: Eric Payne
>            Assignee: Eric Payne
>             Fix For: 2.7.3
>
>         Attachments: YARN-3769-branch-2.002.patch, YARN-3769-branch-2.6.001.patch, YARN-3769-branch-2.7.002.patch,
YARN-3769-branch-2.7.003.patch, YARN-3769-branch-2.7.005.patch, YARN-3769-branch-2.7.006.patch,
YARN-3769-branch-2.7.007.patch, YARN-3769.001.branch-2.7.patch, YARN-3769.001.branch-2.8.patch,
YARN-3769.003.patch, YARN-3769.004.patch, YARN-3769.005.patch
>
>
> We are seeing the preemption monitor preempting containers from queue A and then seeing
the capacity scheduler giving them immediately back to queue A. This happens quite often and
causes a lot of churn.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message