hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator
Date Wed, 24 Aug 2016 19:26:21 GMT

    [ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435511#comment-15435511
] 

Andrew Wang commented on HDFS-10784:
------------------------------------

Thanks for taking a look Xiao. FWIW, the limitation of starting the listing at an offset is
a function of the Java API, but not the REST API itself. Since Hue doesn't use the Java API,
it can implement an "iterator at offset" if it so desires. We could implement it in the Java
API too if that's desired, but I'm hesitant to widen the FileSystem API any further.

> Implement WebHdfsFileSystem#listStatusIterator
> ----------------------------------------------
>
>                 Key: HDFS-10784
>                 URL: https://issues.apache.org/jira/browse/HDFS-10784
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: webhdfs
>    Affects Versions: 2.6.4
>            Reporter: Andrew Wang
>            Assignee: Andrew Wang
>         Attachments: HDFS-10784.001.patch
>
>
> It would be nice to implement the iterative listStatus in WebHDFS so client apps do not
need to buffer the full file list for large directories.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message