hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2589) unnecessary hftp token fetch and renewal thread
Date Mon, 28 Nov 2011 22:55:41 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158899#comment-13158899
] 

Daryn Sharp commented on HDFS-2589:
-----------------------------------

I 100% agree the error handling is less than ideal, but I don't believe I fundamentally changed
the behavior.  The pre-existing code already assumed that any exception means the other side
is insecure.  I only made it defer the fetching of the token.
                
> unnecessary hftp token fetch and renewal thread
> -----------------------------------------------
>
>                 Key: HDFS-2589
>                 URL: https://issues.apache.org/jira/browse/HDFS-2589
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: security
>    Affects Versions: 1.0.0
>            Reporter: Daryn Sharp
>            Assignee: Daryn Sharp
>         Attachments: HDFS-2589.patch
>
>
> Instantiation of the hftp filesystem is causing a token to be implicitly created and
added to a custom token renewal thread.  With the new token renewal feature in the JT, this
causes the mapreduce {{obtainTokensForNamenodes}} to fetch two tokens (an implicit and uncancelled
token, and an explicit token) and leave a spurious renewal thread running.  This thread should
not be running in the JT.
> After speaking with Owen, the quick solution is to lazy fetch the token, and to lazy
start the renewer thread.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message