hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chen He (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-2263) CSQueueUtils.computeMaxActiveApplicationsPerUser may cause deadlock for nested MapReduce jobs
Date Tue, 08 Jul 2014 16:00:05 GMT
Chen He created YARN-2263:
-----------------------------

             Summary: CSQueueUtils.computeMaxActiveApplicationsPerUser may cause deadlock
for nested MapReduce jobs
                 Key: YARN-2263
                 URL: https://issues.apache.org/jira/browse/YARN-2263
             Project: Hadoop YARN
          Issue Type: Bug
    Affects Versions: 2.4.1, 0.23.10
            Reporter: Chen He


computeMaxActiveApplicationsPerUser() has a lower bound "1". For a nested MapReduce job which
files new mapreduce jobs in its mapper/reducer, it will cause job stuck.

public static int computeMaxActiveApplicationsPerUser(
      int maxActiveApplications, int userLimit, float userLimitFactor) {
    return Math.max(
        (int)Math.ceil(
            maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),
        1);
  }





--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message