hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs
Date Wed, 15 Mar 2017 21:15:42 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927003#comment-15927003

Konstantin Shvachko commented on HADOOP-14169:

This sounds like a good optimization for viewfs and a pretty clean patch.
Will commit it soon, unless other people want to review it as well.

> Implement listStatusIterator, listLocatedStatus for ViewFs
> ----------------------------------------------------------
>                 Key: HADOOP-14169
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14169
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: viewfs
>            Reporter: Erik Krogen
>            Assignee: Erik Krogen
>            Priority: Minor
>         Attachments: HADOOP-14169.000.patch, HADOOP-14169.001.patch, HADOOP-14169.002.patch
> Similar to what HADOOP-11812 did for ViewFileSystem, currently ViewFs does not respect
optimizations to {{listStatusIterator}} or {{listLocatedStatus}}, using the naive implementations
within {{AbstractFileSystem}}. This can cause performance issues if iterating over a large
directory, especially if the locations are also needed. This can be easily fixed.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message