hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9369) DNS#reverseDns() can return hostname with . appended at the end
Date Wed, 06 Mar 2013 08:44:14 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13594497#comment-13594497
] 

Karthik Kambatla commented on HADOOP-9369:
------------------------------------------

Thanks Aaron for taking a look at the patch.

Consider a cluster setup where hadoop_allowed_hosts.txt is used to list nodes that can be
included, say nodes are 'sample1', 'sample2'. Now, if they also choose to fix the interface
to be used (say eth0), the TTs during initialization call themselves 'sample1.' and 'sample2.',
note the '.' at the end of the hostnames. Now, as this doesn't match any of the nodes listed
in the file, the two TTs are disallowed to join. Ideally, the TTs should identify themselves
as correct hostnames without '.' at the end.

The code path that the patch modifies is invoked only when we specify a particular interface,
otherwise the default/canonical hostnames are picked. As for when {{InitialDirContext#getAttributes()}}
returns a hostname with '.' at the end, I am not quite certain - it didn't show up on a pseudo-distributed
test.
                
> DNS#reverseDns() can return hostname with . appended at the end
> ---------------------------------------------------------------
>
>                 Key: HADOOP-9369
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9369
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: net
>    Affects Versions: 1.1.1, 2.0.3-alpha, 0.23.5
>            Reporter: Karthik Kambatla
>            Assignee: Karthik Kambatla
>         Attachments: hadoop-9369-branch1.patch, hadoop-9369.patch, hadoop-9369.patch
>
>
> DNS#reverseDns uses javax.naming.InitialDirContext to do a reverse DNS lookup. This can
sometimes return hostnames with a . at the end.
> Saw this happen on hadoop-1: two nodes with tasktracker.dns.interface set to eth0

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message