hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7510) Tokens should use original hostname provided instead of ip
Date Fri, 09 Sep 2011 15:51:08 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101291#comment-13101291
] 

Daryn Sharp commented on HADOOP-7510:
-------------------------------------

This is now more academic than anything:
# I meant when the task creates the new job conf for the remote job it will launch, it should
set the {{mapreduce.job.hdfs-servers}} key so the remote job tracker will acquire the tokens.
 Ie. they won't be passed along.  I think the user has to kinit on the other side irrespective
of my change, so the remote JT should be able to get the tokens?  This shouldn't be a deal
breaker since you said it's a contrived use case?
# Not to beat a dead horse: The {{InetAddress}} docs are clear if/when a reverse lookup occurs
-- when only one arg (host or ip) is given.  Give both and there's never a lookup.  Typically
an {{InetSocketAddress}} is instantiated with just a host or an ip, so it instantiates a {{InetAddress}}
with one arg.  Since {{InetSocketAddress}} delegates to {{InetAddress}, lookups will occur.
 However, when an {{InetSocketAddress}} is instantiated with an {{InetAddress}} that was instantiated
with both host and ip, no lookups will occur due to the delegation.  I have checked the code
of multiple versions and vendor flavors of java and they all behave in this manner.

I added the config param last night, so would you please review the changes to see if they
are satisfactory?

> Tokens should use original hostname provided instead of ip
> ----------------------------------------------------------
>
>                 Key: HADOOP-7510
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7510
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: security
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>             Fix For: 0.20.205.0
>
>         Attachments: HADOOP-7510-2.patch, HADOOP-7510-3.patch, HADOOP-7510-4.patch, HADOOP-7510.patch
>
>
> Tokens currently store the ip:port of the remote server.  This precludes tokens from
being used after a host's ip is changed.  Tokens should store the hostname used to make the
RPC connection.  This will enable new processes to use their existing tokens.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message