hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7510) Tokens should use original hostname provided instead of ip
Date Fri, 09 Sep 2011 15:51:08 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101291#comment-13101291

Daryn Sharp commented on HADOOP-7510:

This is now more academic than anything:
# I meant when the task creates the new job conf for the remote job it will launch, it should
set the {{mapreduce.job.hdfs-servers}} key so the remote job tracker will acquire the tokens.
 Ie. they won't be passed along.  I think the user has to kinit on the other side irrespective
of my change, so the remote JT should be able to get the tokens?  This shouldn't be a deal
breaker since you said it's a contrived use case?
# Not to beat a dead horse: The {{InetAddress}} docs are clear if/when a reverse lookup occurs
-- when only one arg (host or ip) is given.  Give both and there's never a lookup.  Typically
an {{InetSocketAddress}} is instantiated with just a host or an ip, so it instantiates a {{InetAddress}}
with one arg.  Since {{InetSocketAddress}} delegates to {{InetAddress}, lookups will occur.
 However, when an {{InetSocketAddress}} is instantiated with an {{InetAddress}} that was instantiated
with both host and ip, no lookups will occur due to the delegation.  I have checked the code
of multiple versions and vendor flavors of java and they all behave in this manner.

I added the config param last night, so would you please review the changes to see if they
are satisfactory?

> Tokens should use original hostname provided instead of ip
> ----------------------------------------------------------
>                 Key: HADOOP-7510
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7510
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: security
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>             Fix For:
>         Attachments: HADOOP-7510-2.patch, HADOOP-7510-3.patch, HADOOP-7510-4.patch, HADOOP-7510.patch
> Tokens currently store the ip:port of the remote server.  This precludes tokens from
being used after a host's ip is changed.  Tokens should store the hostname used to make the
RPC connection.  This will enable new processes to use their existing tokens.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message