hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arpit Gupta (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
Date Tue, 08 Nov 2011 19:37:51 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13146497#comment-13146497

Arpit Gupta commented on HDFS-2316:

Again, I mean in a 'general way'. Having a syntax that is convenient for parsing using a specific
library doesn't seem the right approach.

I am not sure why the approach i suggested is not a general way. The current response we send
allows users to create a dom object from the json response. If the root object is not present
in that case the user would have to write specific code for different api calls and add the
root object when needed. Thus i think what we have right now allows for the general way rather
than specific solutions for different api calls.

The benefit for having a response that can be converted to valid xml is that in future if
we want to support xml response there is no schema change needed between xml and json. 

Also clients that are using java can use that java xpath libraries to parse the data. I am
not sure if json has something as strong as xpath that one can use.

Here you can see an example where a response has both json and xml responses

yql call to get weather info 
xml -> http://goo.gl/i2Gii
json -> http://goo.gl/osChW

So i believe our json response should be returning a root object.
> webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP
> --------------------------------------------------------------------------
>                 Key: HDFS-2316
>                 URL: https://issues.apache.org/jira/browse/HDFS-2316
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>         Attachments: WebHdfsAPI20111020.pdf, WebHdfsAPI20111103.pdf
> We current have hftp for accessing HDFS over HTTP.  However, hftp is a read-only FileSystem
and does not provide "write" accesses.
> In HDFS-2284, we propose to have webhdfs for providing a complete FileSystem implementation
for accessing HDFS over HTTP.  The is the umbrella JIRA for the tasks.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message