hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13427) Eliminate needless uses of FileSystem.exists, iisFile, isDirectory
Date Tue, 26 Jul 2016 18:04:20 GMT
Steve Loughran created HADOOP-13427:
---------------------------------------

             Summary: Eliminate needless uses of FileSystem.exists, iisFile, isDirectory 
                 Key: HADOOP-13427
                 URL: https://issues.apache.org/jira/browse/HADOOP-13427
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
    Affects Versions: 2.8.0
            Reporter: Steve Loughran


We're cleaning up Hive and Spark's use of FileSystem.exists, because it is often the case
we see code of exists+open, exists+delete, when the exists probe is needless. Against object
stores, expensive needless.

Hadoop can set an example here by stripping them out. It will also show where there are opportunities
to optimise things better and/or improve reporting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org


Mime
View raw message