cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pavel Yaskevich (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-6424) Millions of Message.java (line 342) Got an IOException in internalRead messages on each node of cluster
Date Sat, 30 Nov 2013 04:44:55 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13835614#comment-13835614
] 

Pavel Yaskevich commented on CASSANDRA-6424:
--------------------------------------------

[~jbellis] If it's "Connection Reset by Peer" we can't do much on the server side but to log
those messages so users are aware of the situation, I can reduce logging of that message to
DEBUG but the problem is - as we don't know the cause of IOException we can't really tell
(without logging all of those) if there is actually something bad happened which caused IOException
or not, original HsHa implementation packed with Thrift has the same logic regarding those
errors so I decided to comply and leave that message as a WARN.

> Millions of Message.java (line 342) Got an IOException in internalRead messages on each
node of cluster
> -------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-6424
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6424
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: Ubuntu server 12.04 , cassandra 2.0.2 & 2.0.3
>            Reporter: Dimetrio
>
> I have millions of this debug messages on all nodes of cassandra cluster. And after it's
starts - no one node is working.
> Cassandra restart not solve the problem (but sometimes it can help).
> {{ WARN [Thrift-Selector_6] 2013-11-29 15:42:18,344 Message.java (line 342) Got an IOException
in internalRead!
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>         at sun.nio.ch.IOUtil.read(IOUtil.java:192)
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
>         at org.apache.thrift.transport.TNonblockingSocket.read(TNonblockingSocket.java:141)
>         at com.thinkaurelius.thrift.util.mem.Buffer.readFrom(Buffer.java:96)
>         at com.thinkaurelius.thrift.Message.internalRead(Message.java:338)
>         at com.thinkaurelius.thrift.Message.read(Message.java:141)
>         at com.thinkaurelius.thrift.TDisruptorServer$SelectorThread.handleRead(TDisruptorServer.java:521)
>         at com.thinkaurelius.thrift.TDisruptorServer$SelectorThread.processKey(TDisruptorServer.java:500)
>         at com.thinkaurelius.thrift.TDisruptorServer$AbstractSelectorThread.select(TDisruptorServer.java:375)
>         at com.thinkaurelius.thrift.TDisruptorServer$AbstractSelectorThread.run(TDisrptorServer.java:339)
>  WARN [Thrift-Selector_2] 2013-11-29 15:42:18,344 Message.java (line 342) Got an IOException
in internalRead!
> java.io.IOException:}}



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message