hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sandy Ryza (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-624) Support gang scheduling in the AM RM protocol
Date Mon, 29 Apr 2013 20:28:15 GMT
Sandy Ryza created YARN-624:

             Summary: Support gang scheduling in the AM RM protocol
                 Key: YARN-624
                 URL: https://issues.apache.org/jira/browse/YARN-624
             Project: Hadoop YARN
          Issue Type: Sub-task
          Components: api, scheduler
    Affects Versions: 2.0.4-alpha
            Reporter: Sandy Ryza
            Assignee: Sandy Ryza

Per discussion on YARN-392 and elsewhere, gang scheduling, in which a scheduler runs a set
of tasks when they can all be run at the same time, would be a useful feature for YARN schedulers
to support.

Currently, AMs can approximate this by holding on to containers until they get all the ones
they need.  However, this lends itself to deadlocks when different AMs are waiting on the
same containers.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message