Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Sat, 9 Jun 2012 02:37:23 +0000 (UTC)
From: "Junping Du (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <343031215.55585.1339209443806.JavaMail.jiratomcat@issues-vm>
In-Reply-To: <2047609874.32787.1338787703725.JavaMail.jiratomcat@issues-vm>
Subject: [jira] [Updated] (HADOOP-8470) Implementation of 4-layer subclass
 of NetworkTopology (NetworkTopologyWithNodeGroup)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


     [ https://issues.apache.org/jira/browse/HADOOP-8470?page=3Dcom.atlassi=
an.jira.plugin.system.issuetabpanels:all-tabpanel ]

Junping Du updated HADOOP-8470:
-------------------------------

    Attachment:     (was: HADOOP-8470-NetworkTopology-new-impl-v3.patch)
   =20
> Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWit=
hNodeGroup)
> -------------------------------------------------------------------------=
-----------
>
>                 Key: HADOOP-8470
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8470
>             Project: Hadoop Common
>          Issue Type: Sub-task
>    Affects Versions: 1.0.0, 2.0.0-alpha
>            Reporter: Junping Du
>            Assignee: Junping Du
>         Attachments: HADOOP-8470-NetworkTopology-new-impl-v2.patch, HADOO=
P-8470-NetworkTopology-new-impl-v3.patch, HADOOP-8470-NetworkTopology-new-i=
mpl.patch
>
>
> To support the four-layer hierarchical topology shown in attached figure =
as a subclass of NetworkTopology, NetworkTopologyWithNodeGroup was develope=
d along with unit tests. NetworkTopologyWithNodeGroup overriding the method=
s add, remove, and pseudoSortByDistance were the most relevant to support t=
he four-layer topology. The method seudoSortByDistance selects the nodes to=
 use for reading data and sorts the nodes in sequence of node-local, nodegr=
oup-local, rack- local, rack=E2=80=93off. Another slightly change to seudoS=
ortByDistance is to support cases of separation data node and node manager:=
 if the reader cannot be found in NetworkTopology tree (formed by data node=
s only), then it will try to sort according to reader's sibling node in the=
 tree.
> The distance calculation changes the weights from 0 (local), 2 (rack- loc=
al), 4 (rack-off) to: 0 (local), 2 (nodegroup-local), 4 (rack-local), 6 (ra=
ck-off).
> The additional node group layer should be specified in the topology scrip=
t or table mapping, e.g. input 10.1.1.1, output: /rack1/nodegroup1
> A subclass on InnerNode, InnerNodeWithNodeGroup, was also needed to suppo=
rt NetworkTopologyWithNodeGroup.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs: https://issues.apache.org/jira/secure/ContactAdministrators!default.jsp=
a
For more information on JIRA, see: http://www.atlassian.com/software/jira