Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Date: Mon, 3 Jun 2013 13:03:26 +0000 (UTC)
From: "Hudson (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Message-ID: <JIRA.12559122.1338787650420.56245.1370264606452@arcas>
In-Reply-To: <JIRA.12559122.1338787650420@arcas>
References: <JIRA.12559122.1338787650420@arcas>
Subject: [jira] [Commented] (HADOOP-8470) Implementation of 4-layer subclass
 of NetworkTopology (NetworkTopologyWithNodeGroup)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/HADOOP-8470?page=3Dcom.atlassia=
n.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D136=
73089#comment-13673089 ]=20

Hudson commented on HADOOP-8470:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #1419 (See [https://builds.apache.org/job/H=
adoop-Hdfs-trunk/1419/])
    Move HADOOP-8469 and HADOOP-8470 to 2.1.0-beta in CHANGES.txt. (Revisio=
n 1488873)

     Result =3D FAILURE
szetszwo : http://svn.apache.org/viewcvs.cgi/?root=3DApache-SVN&view=3Drev&=
rev=3D1488873
Files :=20
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt

               =20
> Implementation of 4-layer subclass of NetworkTopology (NetworkTopologyWit=
hNodeGroup)
> -------------------------------------------------------------------------=
-----------
>
>                 Key: HADOOP-8470
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8470
>             Project: Hadoop Common
>          Issue Type: Sub-task
>    Affects Versions: 1.0.0, 2.0.0-alpha
>            Reporter: Junping Du
>            Assignee: Junping Du
>             Fix For: 1.2.0, 2.1.0-beta
>
>         Attachments: HADOOP-8470-branch-2.patch, HADOOP-8470-NetworkTopol=
ogy-new-impl.patch, HADOOP-8470-NetworkTopology-new-impl-v2.patch, HADOOP-8=
470-NetworkTopology-new-impl-v3.patch, HADOOP-8470-NetworkTopology-new-impl=
-v4.patch
>
>
> To support the four-layer hierarchical topology shown in attached figure =
as a subclass of NetworkTopology, NetworkTopologyWithNodeGroup was develope=
d along with unit tests. NetworkTopologyWithNodeGroup overriding the method=
s add, remove, and pseudoSortByDistance were the most relevant to support t=
he four-layer topology. The method seudoSortByDistance selects the nodes to=
 use for reading data and sorts the nodes in sequence of node-local, nodegr=
oup-local, rack- local, rack=E2=80=93off. Another slightly change to seudoS=
ortByDistance is to support cases of separation data node and node manager:=
 if the reader cannot be found in NetworkTopology tree (formed by data node=
s only), then it will try to sort according to reader's sibling node in the=
 tree.
> The distance calculation changes the weights from 0 (local), 2 (rack- loc=
al), 4 (rack-off) to: 0 (local), 2 (nodegroup-local), 4 (rack-local), 6 (ra=
ck-off).
> The additional node group layer should be specified in the topology scrip=
t or table mapping, e.g. input 10.1.1.1, output: /rack1/nodegroup1
> A subclass on InnerNode, InnerNodeWithNodeGroup, was also needed to suppo=
rt NetworkTopologyWithNodeGroup.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrato=
rs
For more information on JIRA, see: http://www.atlassian.com/software/jira