hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-15094) FileSystem
Date Wed, 06 Dec 2017 11:23:00 GMT
Steve Loughran created HADOOP-15094:
---------------------------------------

             Summary: FileSystem
                 Key: HADOOP-15094
                 URL: https://issues.apache.org/jira/browse/HADOOP-15094
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Steve Loughran


Discussion around SPARK-22587 highlights how per-fs notions of a canonical URI make it hard
to determine if a file is on a specific filesystem, or, put differently, if two filesystems
are equivalent.

You can't reliably use this.getUri == that.getUri as it doesn't handle FQDN == unqualified
DN, bit you can't do nslookup as HDFS HA doesn't use hosnames.

If {{FileSystem.getCanonicalUri()}} were public, then this could be used to compare things
consistently.

needs: filesystem.md coverage; contract test (two filesystem instances are equal, different
filesystems aren't). Or at least: this method never returns null.





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message