hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Romain Rigaux (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9366) Webhdfs support set result size and cursor value in op=LISTSTATUS
Date Thu, 24 Dec 2015 18:20:49 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15071176#comment-15071176

Romain Rigaux commented on HDFS-9366:

This is great, thanks!
Just talking from the point of view of and end user:
# size (e.g. 1000 rows) startafter (e.g. start fetching size rows after 100) (FYI Oozie use
'len' and 'offset' for this parameters terminology wise, https://oozie.apache.org/docs/4.2.0/WebServicesAPI.html#Jobs_Information,
maybe makese sense to unify)
# Is HttpFs going to be updated in a follow-up too? (that way both WebHdfs and HttpFs are
100% compatible)

> Webhdfs support set result size and cursor value in op=LISTSTATUS
> -----------------------------------------------------------------
>                 Key: HDFS-9366
>                 URL: https://issues.apache.org/jira/browse/HDFS-9366
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Yong Zhang
>            Assignee: Yong Zhang
>         Attachments: HDFS-9366.002.patch, HDFS-9366.patch
> webhdfs will return large result if HDFS directory with large number of children. Some
webui will not work or very slow in this scnario such as HUE.
> webhdfs could support LISTSTATUS operation to get all children via more than 1 request,
each request only return a small size.

This message was sent by Atlassian JIRA

View raw message