hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.
Date Wed, 16 Jul 2014 16:22:05 GMT

    [ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063679#comment-14063679
] 

Vinod Kumar Vavilapalli commented on YARN-2285:
-----------------------------------------------

>From the look of it, it sounds like this isn't tied to preemption. It looks like this
was a bug that exists even when preemption is not enabled. Can we validate that?

> Preemption can cause capacity scheduler to show 5,000% queue capacity.
> ----------------------------------------------------------------------
>
>                 Key: YARN-2285
>                 URL: https://issues.apache.org/jira/browse/YARN-2285
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: capacityscheduler
>    Affects Versions: 2.5.0
>         Environment: Turn on CS Preemption.
>            Reporter: Tassapol Athiapinya
>            Assignee: Wangda Tan
>            Priority: Minor
>         Attachments: preemption_5000_percent.png
>
>
> I configure queue A, B to have 1%, 99% capacity respectively. There is no max capacity
for each queue. Set high user limit factor.
> Submit app 1 to queue A. AM container takes 50% of cluster memory. Task containers take
another 50%. Submit app 2 to queue B. Preempt task containers of app 1 out. Turns out capacity
of queue B increases to 99% but queue A has 5000% used.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message