hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1724) Race condition in Fair Scheduler when continuous scheduling is turned on
Date Tue, 18 Feb 2014 04:25:19 GMT

    [ https://issues.apache.org/jira/browse/YARN-1724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903769#comment-13903769
] 

Karthik Kambatla commented on YARN-1724:
----------------------------------------

Sorting here helps with balancing load better between nodes. Given not all containers run
for the same duration, round-robin alone wouldn't lead to balanced load. 

> Race condition in Fair Scheduler when continuous scheduling is turned on 
> -------------------------------------------------------------------------
>
>                 Key: YARN-1724
>                 URL: https://issues.apache.org/jira/browse/YARN-1724
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: YARN-1724-1.patch, YARN-1724.patch
>
>
> If nodes resource allocations change during
>         Collections.sort(nodeIdList, nodeAvailableResourceComparator);
> we'll hit:
> java.lang.IllegalArgumentException: Comparison method violates its general contract!



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message