hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John George (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-3373) FileContext HDFS implementation can leak socket caches
Date Tue, 28 Aug 2012 17:54:08 GMT

     [ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

John George updated HDFS-3373:
------------------------------

    Attachment: HDFS-3373.trunk.patch.1

TestConnCache failure is related to this JIRA. I had moved testDisableCache() from that test
to another test file because now it is not possible to change cache config per DFS. 

TestHftpDelegationToken is unrelated to this patch and has been failing in other builds as
well.

Attaching a patch with testDisableCache() removed from TestConnCache to a new file
                
> FileContext HDFS implementation can leak socket caches
> ------------------------------------------------------
>
>                 Key: HDFS-3373
>                 URL: https://issues.apache.org/jira/browse/HDFS-3373
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs client
>    Affects Versions: 2.0.0-alpha, 3.0.0
>            Reporter: Todd Lipcon
>            Assignee: John George
>         Attachments: HDFS-3373.branch-23.patch, HDFS-3373.trunk.patch, HDFS-3373.trunk.patch.1
>
>
> As noted by Nicholas in HDFS-3359, FileContext doesn't have a close() method, and thus
never calls DFSClient.close(). This means that, until finalizers run, DFSClient will hold
on to its SocketCache object and potentially have a lot of outstanding sockets/fds held on
to.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message