hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14169) Implement listStatusIterator, listLocatedStatus for ViewFs
Date Wed, 15 Mar 2017 21:46:41 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927050#comment-15927050

Andrew Wang commented on HADOOP-14169:

Thanks for working on this Erik! I took a quick look at the patch, seems reasonable, +0 from

I also retriggered the precommit build so we can get a run before committing.

> Implement listStatusIterator, listLocatedStatus for ViewFs
> ----------------------------------------------------------
>                 Key: HADOOP-14169
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14169
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: viewfs
>            Reporter: Erik Krogen
>            Assignee: Erik Krogen
>            Priority: Minor
>         Attachments: HADOOP-14169.000.patch, HADOOP-14169.001.patch, HADOOP-14169.002.patch
> Similar to what HADOOP-11812 did for ViewFileSystem, currently ViewFs does not respect
optimizations to {{listStatusIterator}} or {{listLocatedStatus}}, using the naive implementations
within {{AbstractFileSystem}}. This can cause performance issues if iterating over a large
directory, especially if the locations are also needed. This can be easily fixed.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message