hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
Date Mon, 07 Nov 2011 21:46:52 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145842#comment-13145842

Alejandro Abdelnur commented on HDFS-2316:

Regarding #3, IMO having parts of the URL being case sensitive (the path & the param names)
and part of the url being case sensitive (the param values) is an issue. We cannot make the
path case-insensitive because file names are not. Because of that I'm suggesting all case
sensitive. But if we make the the param names case insensitive we should make the param values
case insensitive as well. We just have to make sure we don't modify the case of parameters
as in certain cases (a rename or a changeOwner may cause undesirable results).

Regarding #4, pathSuffix is good. Still this means that a FileStatus response requires knowledge
of the requested URL to be able to know which file we are talking about.

Regarding #5, If we are going to support XML, we can easily add the root elements to XML.
Adding a couple of nested levels because of XML conversion does not seem right. Furthermore,
I would assume that for performance reasons, when generating XML we'll do directly XML via
a Provider, we won't generate JSON and then convert it to XML.

Regarding #6, Regardless if Hoop as a FileSystem implementation, they should be interoperable.
This would mean that a distcp would work without changes even if the infrastructure setup
changes from hoop to webhdfs or viceversa.


> webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
> --------------------------------------------------------------------------
>                 Key: HDFS-2316
>                 URL: https://issues.apache.org/jira/browse/HDFS-2316
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: WebHdfsAPI20111020.pdf, WebHdfsAPI20111103.pdf
> We current have hftp for accessing HDFS over HTTP.  However, hftp is a read-only FileSystem
and does not provide "write" accesses.
> In HDFS-2284, we propose to have webhdfs for providing a complete FileSystem implementation
for accessing HDFS over HTTP.  The is the umbrella JIRA for the tasks.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message