hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srikanth Kandula (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1434) Single Job can affect fairshare of others
Date Fri, 22 Nov 2013 17:26:36 GMT

    [ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13830129#comment-13830129
] 

Srikanth Kandula commented on YARN-1434:
----------------------------------------

Sandy Ryza,

I get it up to the "receive the next container that the RM allocates".  But, why would this
starve other AMs? Shouldn't the RM offer some other containers to these other jobs if the
cluster is idle? 

I can see how some containers may be just tossing back and forth between the RM and the picky
job. But do not see why other jobs receive less share than they would because of the picky
job.

> Single Job can affect fairshare of others
> -----------------------------------------
>
>                 Key: YARN-1434
>                 URL: https://issues.apache.org/jira/browse/YARN-1434
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>            Reporter: Carlo Curino
>            Priority: Minor
>
> A job receiving containers and deciding not to use them and yielding them back in the
next heartbeat could significantly affect the amount of resources given to other jobs. 
> This is because by yielding containers back the job appears always to be under-capacity
(more than others) so it is picked to be the next to receive containers.
> Observed by Robert Grandl, to be independently confirmed.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message