hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3067) DFSInputStream 'pread' does not close its sockets
Date Thu, 17 Apr 2008 00:53:21 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Raghu Angadi updated HADOOP-3067:
---------------------------------

    Description: 
{{DFSInputStream.read(int, buffer)}} does not close the sockets it opens. Main reason this
problem did not show up till now is that pread interface is not used much.

TestCrcCorruption failure first reported in HADOOP-2902 is caused by this bug. Hadoop 0.17
uses more file descriptors for each thread waiting on socket io. Since client does not close
sockets, it leaves a lot of DataNode threads waiting in the unit test.


  was:

{{DFSInputStream.read(int, buffer)}} does not close the sockets it opens. Main reason this
problem did not show up till now is that pread interface is not used much.

TestCrcCorruption failure first reported in HADOOP-2902 is caused by this bug. Hadoop 0.17
uses more file descriptors for each thread waiting on socket io. Since client does not close
sockets, it leaves a lot of DataNode threads waiting in the unit test.


    Environment: DFSInputStream left sockets open. User Impact : positive but mostly unnoticed.

> DFSInputStream 'pread' does not close its sockets
> -------------------------------------------------
>
>                 Key: HADOOP-3067
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3067
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>         Environment: DFSInputStream left sockets open. User Impact : positive but mostly
unnoticed.
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>            Priority: Blocker
>             Fix For: 0.17.0
>
>         Attachments: HADOOP-3067.patch, HADOOP-3067.patch
>
>
> {{DFSInputStream.read(int, buffer)}} does not close the sockets it opens. Main reason
this problem did not show up till now is that pread interface is not used much.
> TestCrcCorruption failure first reported in HADOOP-2902 is caused by this bug. Hadoop
0.17 uses more file descriptors for each thread waiting on socket io. Since client does not
close sockets, it leaves a lot of DataNode threads waiting in the unit test.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message