hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-4309) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology
Date Sat, 07 Jul 2012 10:08:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Junping Du updated MAPREDUCE-4309:
----------------------------------

    Attachment: MAPREDUCE-4309-v4.patch

In v4 patch, fix two minor issues in previous patch:
1. In getting declared constructor, use class from string rather than getting class from object
(the later could be sub class which will be failed to get constructor). 
2. Keep some variables "private" to get rid of inconsistent synchronized issue that found
by FindBugs in previous patch.
                
> Make locatlity in YARN's container assignment and task scheduling pluggable for other
deployment topology
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4309
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4309
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 1.0.0, 2.0.0-alpha
>            Reporter: Junping Du
>            Assignee: Junping Du
>         Attachments: HADOOP-8474-ContainerAssignmentTaskScheduling-pluggable.patch, MAPREDUCE-4309-v2.patch,
MAPREDUCE-4309-v3.patch, MAPREDUCE-4309-v4.patch, MAPREDUCE-4309.patch
>
>
> There are several classes in YARN’s container assignment and task scheduling algorithms
that relate to data locality which were updated to give preference to running a container
on other locality besides node-local and rack-local (like nodegroup-local). This propose to
make these data structure/algorithms pluggable, like: SchedulerNode, RMNodeImpl, etc. The
inner class ScheduledRequests was made a package level class to it would be easier to create
a subclass, ScheduledRequestsWithNodeGroup.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message