hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Charlie Helin (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9110) Improve upon HDFS-8480
Date Fri, 18 Sep 2015 20:54:04 GMT
Charlie Helin created HDFS-9110:

             Summary: Improve upon HDFS-8480
                 Key: HDFS-9110
                 URL: https://issues.apache.org/jira/browse/HDFS-9110
             Project: Hadoop HDFS
          Issue Type: Improvement
    Affects Versions: 2.7.0
            Reporter: Charlie Helin
            Priority: Minor
             Fix For: 2.6.1, 2.7.0

This is a request to do some cosmetic improvements on top of HDFS-8480. There a couple of
File -> java.nio.file.Path conversions which is a little bit distracting. 

The second aspect is more around efficiency, to be perfectly honest I'm not sure what the
number of files that may be processed. However as HDFS-8480 eludes to it appears that this
number could be significantly large. 

The current implementation is basically a collect and process where all files first is being
examined; put into a collection and after that processed. HDFS-8480 could simply be further
enhanced by employing a single iteration without creating an intermediary collection of filenames
by using a FileWalker

This message was sent by Atlassian JIRA

View raw message