hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3159) FileSystem cache keep overwriting cached value
Date Thu, 03 Apr 2008 22:07:25 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Tsz Wo (Nicholas), SZE updated HADOOP-3159:

    Attachment: 3159_20080403.patch


> We shouldn't do hdfs-specific stuff in FileSystem.java.
If the ugi is not found in conf, it will login for any file system.  For better performance,
a LOGIN_UGI will be stored in UserGroupInformation.  So actual login is done only once.

> FileSystem cache keep overwriting cached value
> ----------------------------------------------
>                 Key: HADOOP-3159
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3159
>             Project: Hadoop Core
>          Issue Type: Bug
>    Affects Versions: 0.16.2
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.16.3, 0.17.0
>         Attachments: 3159_20080402.patch, 3159_20080403.patch
> Consider the following:
> {code}
> Configuration conf1 = new Configuration();
> FileSystem fs1 = FileSystem.get(conf1); //conf1 may be modified, the cache key stored
will use the modified values.
> Configuration conf2 = new Configuration(); //create another conf, which won't have the
modified values.
> FileSystem fs2 = FileSystem.get(conf2); //may initialize another FileSystem instead of
returning the cached FileSystem, since conf2 does not have the modified values initially.
> {code}
> Therefore, FileSystem.get(conf) may keeps creating FileSystem and replaces the cached

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message