hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
Date Tue, 01 Nov 2011 22:39:33 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141709#comment-13141709
] 

Tsz Wo (Nicholas), SZE commented on HDFS-2316:
----------------------------------------------

@Alejandro,

> GET GETHOMEDIRECTORY operation is missing.

Do we really need it?  DistributedFileSystem implements it by simple creating a path locally

> The GETFILEBLOCKLOCATIONS, GETDELEGATIONTOKEN, RENEWDELEGATIONTOKEN, CANCELDELEGATIONTOKEN
operations seem to be the ones that don't make sense (at the moment) in a proxy scenario.
We should make those operations as optional.

I agree that GETFILEBLOCKLOCATIONS should be a private API.  Let's rename it to GET_BLOCK_LOCATIONS.

For the delegation token ops, they seems making sense in proxy scenario.  E.g. Oozie needs
it with proxy.

> The 'doas' query parameter is missing, this is required to enable proxyuser functionality.

In RPC, we use "realUser" for the user submitting the call and "user" for the effective user,
e.g. If Oozie performs an opertions as "nicholas", then realUser is "oozie" and user is "nicholas".
 How about we have something similar, say real.user and user.name?

> The 'user.name' query parameter is optional as this is used only in the case of pseudo
authentication, in the case of other authentication mechanism the username will be taken for
the authentication credentials.

Agree.
                
> webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
> --------------------------------------------------------------------------
>
>                 Key: HDFS-2316
>                 URL: https://issues.apache.org/jira/browse/HDFS-2316
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: WebHdfsAPI20111020.pdf
>
>
> We current have hftp for accessing HDFS over HTTP.  However, hftp is a read-only FileSystem
and does not provide "write" accesses.
> In HDFS-2284, we propose to have webhdfs for providing a complete FileSystem implementation
for accessing HDFS over HTTP.  The is the umbrella JIRA for the tasks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message