cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paulo Motta (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-11287) Node Bootstrap fails due to Streaming error
Date Tue, 01 Mar 2016 17:59:18 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174105#comment-15174105
] 

Paulo Motta edited comment on CASSANDRA-11287 at 3/1/16 5:59 PM:
-----------------------------------------------------------------

Thanks for the report. This happens because you're trying to stream sstables from the previous
format and this is not currently supported.

The error message is not clear enough and we could fix that, but we are already working on
supporting streaming of sstables from previous versions on CASSANDRA-10990, which should be
available on upcoming 3.5 release, if everything works out as planned.

The workaround for now is to run upgradesstables on all nodes before running any operation
that uses streaming, such as bootstrap, repair or rebuild. For now I will close this as duplicate
of CASSANDRA-10990, as this will be addressed there.


was (Author: pauloricardomg):
Thanks for the report. This happens because you're trying to stream sstables from the previous
format and this is not currently supported.

The error message is not clear enough and we could fix that, but we are already working on
supporting streaming of sstables from previous versions on CASSANDRA-10990, which should be
available on next release, if everything works out as planned.

The workaround for now is to run upgradesstables on all nodes before running any operation
that uses streaming, such as bootstrap, repair or rebuild. For now I will close this as duplicate
of CASSANDRA-10990, as this will be addressed there.

> Node Bootstrap fails due to Streaming error
> -------------------------------------------
>
>                 Key: CASSANDRA-11287
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11287
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Streaming and Messaging
>         Environment: Cassandra 3.3
>            Reporter: Michał Matłoka
>
> I am trying to bootstrap a node, in its logs I get the following errors
> {code}
> ERROR [STREAM-IN-/10.10.10.3] 2016-03-01 08:16:33,006 StreamSession.java:520 - [Stream
#866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
> java.io.EOFException: null
>         at java.io.DataInputStream.readFully(DataInputStream.java:197) ~[na:1.8.0_72]
>         at java.io.DataInputStream.readLong(DataInputStream.java:416) ~[na:1.8.0_72]
>         at org.apache.cassandra.io.compress.CompressionMetadata$ChunkSerializer.deserialize(CompressionMetadata.java:513)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.io.compress.CompressionMetadata$ChunkSerializer.deserialize(CompressionMetadata.java:503)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.compress.CompressionInfo$CompressionInfoSerializer.deserialize(CompressionInfo.java:73)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.compress.CompressionInfo$CompressionInfoSerializer.deserialize(CompressionInfo.java:46)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.FileMessageHeader$FileMessageHeaderSerializer.deserialize(FileMessageHeader.java:227)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:44)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:39)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.StreamMessage.deserialize(StreamMessage.java:59)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$IncomingMessageHandler.run(ConnectionHandler.java:261)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
> ERROR [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,007 StreamSession.java:520 - [Stream
#866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
> java.io.IOException: Broken pipe
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.write(IOUtil.java:51) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) ~[na:1.8.0_72]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.doFlush(BufferedDataOutputStreamPlus.java:323)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.flush(BufferedDataOutputStreamPlus.java:331)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:364)
[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335)
[apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
> INFO  [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,019 StreamResultFuture.java:185 -
[Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Session with /10.10.10.3 is complete
> ERROR [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,020 StreamSession.java:520 - [Stream
#866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
> java.io.IOException: Broken pipe
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.write(IOUtil.java:51) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) ~[na:1.8.0_72]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.doFlush(BufferedDataOutputStreamPlus.java:323)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.flush(BufferedDataOutputStreamPlus.java:331)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:364)
[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:343)
[apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
> {code}
> on source node
> {code}
> INFO  [STREAM-IN-/10.10.10.5] 2016-03-01 08:34:59,057 StreamResultFuture.java:171 - [Stream
#19bddf70-df80-11e5-a235-6562056da4d2 ID#0] Prepare completed. Receiving 0 files(0 bytes),
sending 102 files(276993164542 bytes)
> ERROR [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,185 StreamSession.java:520 - [Stream
#19bddf70-df80-11e5-a235-6562056da4d2] Streaming error occurred
> java.lang.NullPointerException: null
>         at org.apache.cassandra.db.SerializationHeader$Component.access$500(SerializationHeader.java:283)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.db.SerializationHeader$Serializer.serialize(SerializationHeader.java:430)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.FileMessageHeader$FileMessageHeaderSerializer.serialize(FileMessageHeader.java:208)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.OutgoingFileMessage.serialize(OutgoingFileMessage.java:84)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:48)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:40)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:48)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:363)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335)
~[apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]
> INFO  [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,186 StreamResultFuture.java:185 -
[Stream #19bddf70-df80-11e5-a235-6562056da4d2] Session with /10.10.10.5 is complete
> WARN  [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,186 StreamResultFuture.java:212 -
[Stream #19bddf70-df80-11e5-a235-6562056da4d2] Stream failed
> {code}
> All nodes have Cassandra 3.3.
> Note: source node is doing an sstable upgrade.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message