hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Tang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1222) [Mumak] We should not include nodes with numeric ips in cluster topology.
Date Sat, 21 Nov 2009 12:58:39 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12780966#action_12780966
] 

Hong Tang commented on MAPREDUCE-1222:
--------------------------------------

bq. What happens if there is no hostname? i.e., the cluster is completely done by IP address?


The attached patch assumes that task trackers advertise themselves by host names. To avoid
overly complicating the patch, I'd probably just add an option to allow users to enable/disable
node exclusion based on numeric ips.

> [Mumak] We should not include nodes with numeric ips in cluster topology.
> -------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1222
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1222
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/mumak
>    Affects Versions: 0.21.0, 0.22.0
>            Reporter: Hong Tang
>            Assignee: Hong Tang
>             Fix For: 0.21.0, 0.22.0
>
>         Attachments: mapreduce-1222-20091119.patch
>
>
> Rumen infers cluster topology by parsing input split locations from job history logs.
Due to HDFS-778, a cluster node may appear both as a numeric ip or as a host name in job history
logs. We should exclude nodes appeared as numeric ips in cluster toplogy when we run mumak
until a solution is found so that numeric ips would never appear in input split locations.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message