hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cody Saunders (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-693) java.net.SocketTimeoutException: 480000 millis timeout while waiting for channel to be ready for write exceptions were cast when trying to read file via StreamFile.
Date Wed, 07 Jul 2010 21:26:54 GMT

    [ https://issues.apache.org/jira/browse/HDFS-693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886090#action_12886090
] 

Cody Saunders commented on HDFS-693:
------------------------------------

Followup, even though I set TZ, I still get 480s timeouts in datanodes. Here's a sample, where
it appears only 3ms actually pass before it complains:

2010-07-07 13:56:57,865 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace:
src: /192.168.200.207:50010, dest: /192.168.200.207:44915, bytes: 264192, op: HDFS_READ, cliID:
DFSClient_1293902555, srvID: DS-7579347-192.168.200.207-50010-1278476587314, blockid: blk_-3262154426456719253_1840

2010-07-07 13:56:57,868 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(192.168.200.207:50010,
storageID=DS-7579347-192.168.200.207-50010-1278476587314, infoPort=50075, ipcPort=50020):Got
exception while serving blk_-3262154426456719253_1840 to /192.168.200.207:
java.net.SocketTimeoutException: 480000 millis timeout while waiting for channel to be ready
for write. ch : java.nio.channels.SocketChannel[connected local=/192.168.200.207:50010 remote=/192.168.200.207:44915]
    at org.apache.hadoop.net.SocketIOWithTimeout.waitForIO(SocketIOWithTimeout.java:246)
    at org.apache.hadoop.net.SocketOutputStream.waitForWritable(SocketOutputStream.java:159)
    at org.apache.hadoop.net.SocketOutputStream.transferToFully(SocketOutputStream.java:198)
    at org.apache.hadoop.hdfs.server.datanode.BlockSender.sendChunks(BlockSender.java:313)
    at org.apache.hadoop.hdfs.server.datanode.BlockSender.sendBlock(BlockSender.java:400)
    at org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:180)
    at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:95)
    at java.lang.Thread.run(Thread.java:619)

I am using hadoop 0.20.2 and hbase 0.20.4.

> java.net.SocketTimeoutException: 480000 millis timeout while waiting for channel to be
ready for write exceptions were cast when trying to read file via StreamFile.
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-693
>                 URL: https://issues.apache.org/jira/browse/HDFS-693
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 0.20.1
>            Reporter: Yajun Dong
>         Attachments: HDFS-693.log
>
>
> To exclude the case of network problem, I found the count of  dataXceiver is about 30.
 Also, I could see the output of netstate -a | grep 50075 has many TIME_WAIT status when this
happened.
> partial log in attachment. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message