hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3159) FileSystem cache keep overwriting cached value
Date Thu, 03 Apr 2008 17:52:25 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585211#action_12585211

dhruba borthakur commented on HADOOP-3159:

One option would be to always invoke UnixUserGroupInformation.login (without check for "hdfs").
Howeverm the login() method could have a static variable that caches the last value. This
way there will not perrormance impact even if login gets called many many times within the
same process.

> FileSystem cache keep overwriting cached value
> ----------------------------------------------
>                 Key: HADOOP-3159
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3159
>             Project: Hadoop Core
>          Issue Type: Bug
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 0.17.0
>         Attachments: 3159_20080402.patch
> Consider the following:
> {code}
> Configuration conf1 = new Configuration();
> FileSystem fs1 = FileSystem.get(conf1); //conf1 may be modified, the cache key stored
will use the modified values.
> Configuration conf2 = new Configuration(); //create another conf, which won't have the
modified values.
> FileSystem fs2 = FileSystem.get(conf2); //may initialize another FileSystem instead of
returning the cached FileSystem, since conf2 does not have the modified values initially.
> {code}
> Therefore, FileSystem.get(conf) may keeps creating FileSystem and replaces the cached

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message