hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4095) HADOOP-8159 causes TestJobInProgress#testLocality to fail
Date Mon, 02 Apr 2012 17:49:25 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244373#comment-13244373
] 

Eli Collins commented on MAPREDUCE-4095:
----------------------------------------

This test explicitly creates a topology with nodes on two different levels:

{code}
    Node r2n3 = new NodeBase("/default/rack2/node3");
    nt.add(r2n3);

    Node r2n4 = new NodeBase("/default/rack2/s1/node4");
{code}

which is bogus. Calling toString on this topology would fail even before HADOOP-8159. 

We double checked the original topology spec in HADOOP-692 (https://issues.apache.org/jira/secure/attachment/12345251/Rack_aware_HDFS_proposal.pdf)
which does not support imbalanced topology. Let's fixup the test to use a valid topolgy.
                
> HADOOP-8159 causes TestJobInProgress#testLocality to fail
> ---------------------------------------------------------
>
>                 Key: MAPREDUCE-4095
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4095
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 1.1.0, 2.0.0
>            Reporter: Eli Collins
>            Assignee: Colin Patrick McCabe
>
> The following in TestJobInProgress#testLocality:
> {code}
>     Node r2n4 = new NodeBase("/default/rack2/s1/node4");
>     nt.add(r2n4);
> {code}
> violates the check introduced by HADOOP-8159:
> {noformat}
> Testcase: testLocality took 0.005 sec
>         Caused an ERROR
> Invalid network topology. You cannot have a rack and a non-rack node at the same level
of the network topology.
> org.apache.hadoop.net.NetworkTopology$InvalidTopologyException: Invalid network topology.
You cannot have a rack and a non-rack node at the same level of the network topology.
>         at org.apache.hadoop.net.NetworkTopology.add(NetworkTopology.java:349)
>         at org.apache.hadoop.mapred.TestJobInProgress.testLocality(TestJobInProgress.java:232)
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message