hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8820) Backport HADOOP-8469 and HADOOP-8470: add "NodeGroup" layer in new NetworkTopology (also known as NetworkTopologyWithNodeGroup)
Date Tue, 13 Nov 2012 08:39:15 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496039#comment-13496039
] 

Junping Du commented on HADOOP-8820:
------------------------------------

Nicholas, Thanks for comments and questions. Under your great help, most HDFS part of code
is committed into trunk (except Balancer), so the left parts missing in trunk are mostly YARN.
HADOOP-8817 patch is based on MRV1 which has less code change comparing with YARN and MapReduce
part is already reviewed (by Luke). Also, I did a lot of tests on a deployed virtualized hadoop
cluster for combined patch, so I think it could be better to commit these patches as a whole
patch to get rid of potential bug involved by sync and could be convenient for the patch to
go to release branch (branch-1.2?). What do you think?
                
> Backport HADOOP-8469 and HADOOP-8470: add "NodeGroup" layer in new NetworkTopology (also
known as NetworkTopologyWithNodeGroup)
> -------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-8820
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8820
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: net
>    Affects Versions: 1.0.0
>            Reporter: Junping Du
>            Assignee: Junping Du
>         Attachments: HADOOP-8820.b1.002.patch, HADOOP-8820.b1.003.patch, HADOOP-8820.patch
>
>
> This patch backport HADOOP-8469 and HADOOP-8470 to branch-1 and includes:
> 1. Make NetworkTopology class pluggable for extension.
> 2. Implement a 4-layer NetworkTopology class (named as NetworkTopologyWithNodeGroup)
to use in virtualized environment (or other situation with additional layer between host and
rack).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message