hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
Date Tue, 01 Nov 2011 05:38:34 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140953#comment-13140953
] 

Alejandro Abdelnur commented on HDFS-2316:
------------------------------------------

I've been running tests to validate HTTP REST API compatibility between webhdfs and hoop.
Following the issues I've found.


* FileStatus JSON payload has elements that are not part of the FileStatus interface. The
WebhdfsFileSystem client expects those elements and fails if they are not present. These elements
are: localName, isSymlink, symlink. These elements are not later used and they are lost when
creating a FileStatus in WebhdfsFileSystem. Either those elements should not be in JSON payload
(my preference) or they should not be required by the WebhdfsFileSystem.

* delete, rename, mkdirs, setReplication JSON responses use 'boolean' as element name, they
should use the operation name as it is more descriptive.

* FileChecksum JSON serialization is using the classname in the JSON payload, it should not,
it should be something like:

{code}
{
  "algorithm" : "foo",
  "bytes" : "hexabytes",
  "length" : 1000
}
{code}

* Same as FileChecksum JSON for ContentSummary JSON.

                
> webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
> --------------------------------------------------------------------------
>
>                 Key: HDFS-2316
>                 URL: https://issues.apache.org/jira/browse/HDFS-2316
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: WebHdfsAPI20111020.pdf
>
>
> We current have hftp for accessing HDFS over HTTP.  However, hftp is a read-only FileSystem
and does not provide "write" accesses.
> In HDFS-2284, we propose to have webhdfs for providing a complete FileSystem implementation
for accessing HDFS over HTTP.  The is the umbrella JIRA for the tasks.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message