hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology
Date Sat, 08 Jun 2013 19:16:22 GMT

     [ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Junping Du updated YARN-18:
---------------------------

    Attachment: YARN-18-v7.patch

In v7 patch, abstract topology related logic within Schedulers (Fifo, Capacity and Fair) into
delegation classes to get rid of creating new Schedulers with NodeGroup extension. Also, improve
some naming issues like remove "Abstract" in Factory class, etc.
                
> Make locatlity in YARN's container assignment and task scheduling pluggable for other
deployment topology
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-18
>                 URL: https://issues.apache.org/jira/browse/YARN-18
>             Project: Hadoop YARN
>          Issue Type: New Feature
>    Affects Versions: 2.0.3-alpha
>            Reporter: Junping Du
>            Assignee: Junping Du
>              Labels: features
>         Attachments: HADOOP-8474-ContainerAssignmentTaskScheduling-pluggable.patch, MAPREDUCE-4309.patch,
MAPREDUCE-4309-v2.patch, MAPREDUCE-4309-v3.patch, MAPREDUCE-4309-v4.patch, MAPREDUCE-4309-v5.patch,
MAPREDUCE-4309-v6.patch, MAPREDUCE-4309-v7.patch, Pluggable topologies with NodeGroup for
YARN.pdf, YARN-18.patch, YARN-18-v2.patch, YARN-18-v3.1.patch, YARN-18-v3.2.patch, YARN-18-v3.patch,
YARN-18-v4.1.patch, YARN-18-v4.2.patch, YARN-18-v4.3.patch, YARN-18-v4.patch, YARN-18-v5.1.patch,
YARN-18-v5.patch, YARN-18-v6.1.patch, YARN-18-v6.2.patch, YARN-18-v6.3.patch, YARN-18-v6.4.patch,
YARN-18-v6.patch, YARN-18-v7.patch
>
>
> There are several classes in YARN’s container assignment and task scheduling algorithms
that relate to data locality which were updated to give preference to running a container
on other locality besides node-local and rack-local (like nodegroup-local). This propose to
make these data structure/algorithms pluggable, like: SchedulerNode, RMNodeImpl, etc. The
inner class ScheduledRequests was made a package level class to it would be easier to create
a subclass, ScheduledRequestsWithNodeGroup.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message