hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1434) Single Job can affect fairshare of others
Date Mon, 25 Nov 2013 05:18:36 GMT

    [ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13831180#comment-13831180

Sandy Ryza commented on YARN-1434:

Srikanth, this would happen if the AM can return containers faster than the RM can assign
them.  The AM would then, as Carlo said, continually be the one that "deserves" a container.

It should definitely be possible to make this problem show up under the right circumstances.
 When I have time I will try to verify whether YARN-1010 fully eliminates the problem.

> Single Job can affect fairshare of others
> -----------------------------------------
>                 Key: YARN-1434
>                 URL: https://issues.apache.org/jira/browse/YARN-1434
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>            Reporter: Carlo Curino
>            Priority: Minor
> A job receiving containers and deciding not to use them and yielding them back in the
next heartbeat could significantly affect the amount of resources given to other jobs. 
> This is because by yielding containers back the job appears always to be under-capacity
(more than others) so it is picked to be the next to receive containers.
> Observed by Robert Grandl, to be independently confirmed.

This message was sent by Atlassian JIRA

View raw message