hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Owen O'Malley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2336) hftp only supports remote hdfs servers
Date Wed, 14 Sep 2011 21:40:09 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13104909#comment-13104909
] 

Owen O'Malley commented on HDFS-2336:
-------------------------------------

The fetchdt --webservice has only ever worked with hftp. It makes too many assumptions about
the shape of the url to fetch the token from a generic service.

If you want to extend fetchdt to work for the JobTracker, Oozie, etc, you'll need to put the
entire url on the command line.

> hftp only supports remote hdfs servers
> --------------------------------------
>
>                 Key: HDFS-2336
>                 URL: https://issues.apache.org/jira/browse/HDFS-2336
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.20.205.0, 0.23.0
>            Reporter: Daryn Sharp
>             Fix For: 0.23.0
>
>
> The new token renewal implementation appears to introduce invalid assumptions regarding
token kinds.
> Any token acquired over http is assumed to be hftp, so the kind is unconditionally changed
to hftp.  This precludes the acquisition of any other token types over http.  This new limitation
was added to a generic method in a public class.  It should have been encapsulated in the
hftp class, not the generic http token fetching methods.
> Furthermore, hftp will unconditionally change a hftp token's kind to hdfs.  I believe
this assumption means that hftp is now broken if the remote cluster's default filesystem is
not hdfs.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message