hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "amith (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-3545) DFSClient leak due to malfunctioning of FileSystem Cache
Date Tue, 19 Jun 2012 11:00:43 GMT
amith created HDFS-3545:

             Summary: DFSClient leak due to malfunctioning of FileSystem Cache
                 Key: HDFS-3545
                 URL: https://issues.apache.org/jira/browse/HDFS-3545
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: hdfs client
    Affects Versions: 2.0.0-alpha, 3.0.0
            Reporter: amith

For every FileSystem.get new FileSystem object is getting created even though the UGI object
passed has same name. This is creating the lot of FileSystem objects and cached in FileSystem
cache instead of using the same cached object .

This is causing the Cache to grow in size causing OOME

This behaviour can be seen in Mapred and Hive components also since they use  FileSystem.get
in the described fashion

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message