Mailing-List: contact common-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-dev@hadoop.apache.org
Date: Fri, 31 May 2013 13:35:25 +0000 (UTC)
From: "Junping Du (JIRA)" <jira@apache.org>
To: common-dev@hadoop.apache.org
Message-ID: <JIRA.12559122.1338787650420.47168.1370007325298@arcas>
In-Reply-To: <JIRA.12559122.1338787650420@arcas>
References: <JIRA.12559122.1338787650420@arcas>
Subject: [jira] [Reopened] (HADOOP-8470) Implementation of 4-layer subclass
 of NetworkTopology (NetworkTopologyWithNodeGroup)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


     [ https://issues.apache.org/jira/browse/HADOOP-8470?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:all-tabpanel ]

Junping Du reopened HADOOP-8470:
--------------------------------


Reopen this JIRA for backport to branch-2.
               =20
> Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWit=
hNodeGroup)
> -------------------------------------------------------------------------=
-----------
>
>                 Key: HADOOP-8470
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8470
>             Project: Hadoop Common
>          Issue Type: Sub-task
>    Affects Versions: 1.0.0, 2.0.0-alpha
>            Reporter: Junping Du
>            Assignee: Junping Du
>             Fix For: 3.0.0
>
>         Attachments: HADOOP-8470-NetworkTopology-new-impl.patch, HADOOP-8=
470-NetworkTopology-new-impl-v2.patch, HADOOP-8470-NetworkTopology-new-impl=
-v3.patch, HADOOP-8470-NetworkTopology-new-impl-v4.patch
>
>
> To support the four-layer hierarchical topology shown in attached figure =
as a subclass of NetworkTopology, NetworkTopologyWithNodeGroup was develope=
d along with unit tests. NetworkTopologyWithNodeGroup overriding the method=
s add, remove, and pseudoSortByDistance were the most relevant to support t=
he four-layer topology. The method seudoSortByDistance selects the nodes to=
 use for reading data and sorts the nodes in sequence of node-local, nodegr=
oup-local, rack- local, rack=E2=80=93off. Another slightly change to seudoS=
ortByDistance is to support cases of separation data node and node manager:=
 if the reader cannot be found in NetworkTopology tree (formed by data node=
s only), then it will try to sort according to reader's sibling node in the=
 tree.
> The distance calculation changes the weights from 0 (local), 2 (rack- loc=
al), 4 (rack-off) to: 0 (local), 2 (nodegroup-local), 4 (rack-local), 6 (ra=
ck-off).
> The additional node group layer should be specified in the topology scrip=
t or table mapping, e.g. input 10.1.1.1, output: /rack1/nodegroup1
> A subclass on InnerNode, InnerNodeWithNodeGroup, was also needed to suppo=
rt NetworkTopologyWithNodeGroup.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs
For more information on JIRA, see: http://www.atlassian.com/software/jira