hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3231) FairScheduler changing queueMaxRunningApps on the fly will cause all pending job stuck
Date Tue, 24 Feb 2015 19:04:07 GMT

    [ https://issues.apache.org/jira/browse/YARN-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335253#comment-14335253
] 

Ming Ma commented on YARN-3231:
-------------------------------

Siqi, the newly added {{updateRunnabilityOnRefreshQueues}} has similar code as {{updateRunnabilityOnAppRemoval}}
to trim {{appsNowMaybeRunnable}}. Will it be useful to put that into a separate function that
both {{updateRunnabilityOnRefreshQueues}} and {{updateRunnabilityOnAppRemoval}} can use? On
a separate note, it might be useful to add some test case for userMaxApps change.

> FairScheduler changing queueMaxRunningApps on the fly will cause all pending job stuck
> --------------------------------------------------------------------------------------
>
>                 Key: YARN-3231
>                 URL: https://issues.apache.org/jira/browse/YARN-3231
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Siqi Li
>            Assignee: Siqi Li
>            Priority: Critical
>         Attachments: YARN-3231.v1.patch
>
>
> When a queue is piling up with a lot of pending jobs due to the maxRunningApps limit.
We want to increase this property on the fly to make some of the pending job active. However,
once we increase the limit, all pending jobs were not assigned any resource, and were stuck
forever.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message