hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gschen <10210240...@fudan.edu.cn>
Subject Re: [jira] [Commented] (HDFS-3373) FileContext HDFS implementation can leak socket caches
Date Thu, 27 Sep 2012 14:07:40 GMT
On 9/27/2012 10:00 PM, Hudson (JIRA) wrote:
>      [ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464749#comment-13464749
]
>
> Hudson commented on HDFS-3373:
> ------------------------------
>
> Integrated in Hadoop-Mapreduce-trunk #1209 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1209/])
>      HDFS-3373. Change DFSClient input stream socket cache to global static and add a
thread to cleanup expired cache entries.  Contributed by John George (Revision 1390466)
>
>       Result = SUCCESS
> szetszwo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1390466
> Files :
> * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
> * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
> * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
> * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/SocketCache.java
> * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestConnCache.java
> * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDistributedFileSystem.java
> * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestSocketCache.java
>
>
>> FileContext HDFS implementation can leak socket caches
>> ------------------------------------------------------
>>
>>                  Key: HDFS-3373
>>                  URL: https://issues.apache.org/jira/browse/HDFS-3373
>>              Project: Hadoop HDFS
>>           Issue Type: Bug
>>           Components: hdfs client
>>     Affects Versions: 2.0.0-alpha, 3.0.0
>>             Reporter: Todd Lipcon
>>             Assignee: John George
>>              Fix For: 2.0.3-alpha
>>
>>          Attachments: HDFS-3373.branch-23.patch, HDFS-3373.trunk.patch, HDFS-3373.trunk.patch.1,
HDFS-3373.trunk.patch.2, HDFS-3373.trunk.patch.3, HDFS-3373.trunk.patch.3, HDFS-3373.trunk.patch.4
>>
>>
>> As noted by Nicholas in HDFS-3359, FileContext doesn't have a close() method, and
thus never calls DFSClient.close(). This means that, until finalizers run, DFSClient will
hold on to its SocketCache object and potentially have a lot of outstanding sockets/fds held
on to.
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators
> For more information on JIRA, see: http://www.atlassian.com/software/jira
unsubscribe


Mime
View raw message