hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13427) Eliminate needless uses of FileSystem.exists, iisFile, isDirectory
Date Tue, 26 Jul 2016 18:04:20 GMT
Steve Loughran created HADOOP-13427:

             Summary: Eliminate needless uses of FileSystem.exists, iisFile, isDirectory 
                 Key: HADOOP-13427
                 URL: https://issues.apache.org/jira/browse/HADOOP-13427
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
    Affects Versions: 2.8.0
            Reporter: Steve Loughran

We're cleaning up Hive and Spark's use of FileSystem.exists, because it is often the case
we see code of exists+open, exists+delete, when the exists probe is needless. Against object
stores, expensive needless.

Hadoop can set an example here by stripping them out. It will also show where there are opportunities
to optimise things better and/or improve reporting.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

View raw message