hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ratandeep Ratti (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2252) Intermittent failure for testcase TestFairScheduler.testContinuousScheduling
Date Mon, 07 Jul 2014 01:17:33 GMT

    [ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14053280#comment-14053280
] 

Ratandeep Ratti commented on YARN-2252:
---------------------------------------

Wei,  while analyzing this failure, I stumbled upon another potential problem.
The method SchedulerApplication.getCurrentConsumption() is not synchronized, this may lead
to visibility (staleness) problems

> Intermittent failure for testcase TestFairScheduler.testContinuousScheduling
> ----------------------------------------------------------------------------
>
>                 Key: YARN-2252
>                 URL: https://issues.apache.org/jira/browse/YARN-2252
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: trunk-win
>            Reporter: Ratandeep Ratti
>            Assignee: Wei Yan
>              Labels: hadoop2, scheduler, yarn
>
> This test-case is failing sporadically on my machine. I think I have a plausible explanation
 for this.
> It seems that when the Scheduler is being asked for resources, the resource requests
that are being constructed have no preference for the hosts (nodes).
> The two mock hosts constructed, both have a memory of 8192 mb.
> The containers(resources) being requested each require a memory of 1024mb, hence a single
node can execute both the resource requests for the application.
> In the end of the test-case it is being asserted that the containers (resource requests)
be executed on different nodes, but since we haven't specified any preferences for nodes when
requesting the resources, the scheduler (at times) executes both the containers (requests)
on the same node.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message