hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2494) [webhdfs] When Getting the file using OP=OPEN with DN http address, ESTABLISHED sockets are growing.
Date Mon, 24 Oct 2011 20:56:32 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13134476#comment-13134476
] 

Uma Maheswara Rao G commented on HDFS-2494:
-------------------------------------------

Hi Nicholas,
 I just verified the patch with my environment, looks there are more sockets still be leaking.

 I just gave the fix by closing dfsclient as well.

After this step, sockets came down,


C:\Users\uma>netstat | grep ESTABLISHED|wc -l
50
C:\Users\uma>netstat | grep ESTABLISHED|wc -l
58
C:\Users\uma>netstat | grep ESTABLISHED|wc -l
58

I uploaded the patch with it. Can you please take a look?

Thanks
Uma


                
> [webhdfs] When Getting the file using OP=OPEN with DN http address, ESTABLISHED sockets
are growing.
> ----------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-2494
>                 URL: https://issues.apache.org/jira/browse/HDFS-2494
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 0.24.0
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>         Attachments: HDFS-2494.patch, h2494_20111024.patch, h2494_20111024b.patch
>
>
> As part of the reliable test,
> Scenario:
> Initially check the socket count. ---there are aroud 42 sockets are there.
> open the file with DataNode http address using op=OPEN request parameter about 500 times
in loop.
> Wait for some time and check the socket count. --- There are thousands of ESTABLISHED
sockets are growing. ~2052
> Here is the netstat result:
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> C:\Users\uma>netstat | grep 127.0.0.1 | grep ESTABLISHED |wc -l
> 2042
> This count is not coming down.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message