Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-issues@hadoop.apache.org
Message-ID: <13591390.72501277526230185.JavaMail.jira@thor>
Date: Sat, 26 Jun 2010 00:23:50 -0400 (EDT)
From: "Tsz Wo (Nicholas), SZE (JIRA)" <jira@apache.org>
To: common-issues@hadoop.apache.org
Subject: [jira] Updated: (HADOOP-6843) Entries in the FileSystem's Cache
 could be cleared when they are not used
In-Reply-To: <12452270.71901277517410023.JavaMail.jira@thor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HADOOP-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-6843:
-------------------------------------------

    Attachment: TestFileSystemCache.java

TestFileSystemCache.java: file system cache test 

> Entries in the FileSystem's Cache could be cleared when they are not used
> -------------------------------------------------------------------------
>
>                 Key: HADOOP-6843
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6843
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Devaraj Das
>             Fix For: 0.22.0
>
>         Attachments: fs-weak-ref.4.patch, TestFileSystemCache.java
>
>
> In FileSystem, there is a cache maintained for Filesystem instances. The entries in the cache are cleared only when explicit FileSystem.close is invoked. Applications are not careful on this aspect. Typically, they do FileSystem.get(), operate on the FileSystem, and then they just forget about it. Every FileSystem instance stores a reference to the Configuration object that it was created with. Over a period of time, as the cache grows, this can lead to OOM (we have seen this happening in our hadoop 20S clusters at Yahoo).
> This jira aims at addressing the above issue.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.