Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2844F18A09 for ; Tue, 8 Mar 2016 21:24:41 +0000 (UTC) Received: (qmail 40405 invoked by uid 500); 8 Mar 2016 21:24:41 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 40371 invoked by uid 500); 8 Mar 2016 21:24:41 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 40360 invoked by uid 99); 8 Mar 2016 21:24:40 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Mar 2016 21:24:40 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id CC1322C1F58 for ; Tue, 8 Mar 2016 21:24:40 +0000 (UTC) Date: Tue, 8 Mar 2016 21:24:40 +0000 (UTC) From: "Russ Hatch (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CASSANDRA-11196) tuple_notation_test upgrade tests flaps MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-11196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185834#comment-15185834 ] Russ Hatch commented on CASSANDRA-11196: ---------------------------------------- [~slebresne] I'm able to repro this locally, here's the cassandra stack trace: {noformat} node1: ERROR [SharedPool-Worker-2] 2016-03-08 14:15:16,739 QueryMessage.java:136 - Unexpected error during query java.lang.IndexOutOfBoundsException: null at java.nio.Buffer.checkIndex(Buffer.java:540) ~[na:1.8.0_74] at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:178) ~[na:1.8.0_74] at org.apache.cassandra.db.composites.BoundedComposite.toByteBuffer(BoundedComposite.java:91) ~[main/:na] at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:387) ~[main/:na] at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:366) ~[main/:na] at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:286) ~[main/:na] at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:259) ~[main/:na] at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:541) ~[main/:na] at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:500) ~[main/:na] at org.apache.cassandra.db.SliceFromReadCommandSerializer.serializedSize(SliceFromReadCommand.java:203) ~[main/:na] at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:171) ~[main/:na] at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:132) ~[main/:na] at org.apache.cassandra.net.MessageOut.payloadSize(MessageOut.java:166) ~[main/:na] at org.apache.cassandra.net.OutboundTcpConnectionPool.getConnection(OutboundTcpConnectionPool.java:72) ~[main/:na] at org.apache.cassandra.net.MessagingService.getConnection(MessagingService.java:592) ~[main/:na] at org.apache.cassandra.net.MessagingService.sendOneWay(MessagingService.java:739) ~[main/:na] at org.apache.cassandra.net.MessagingService.sendRR(MessagingService.java:682) ~[main/:na] at org.apache.cassandra.net.MessagingService.sendRRWithFailure(MessagingService.java:665) ~[main/:na] at org.apache.cassandra.service.AbstractReadExecutor.makeRequests(AbstractReadExecutor.java:112) ~[main/:na] at org.apache.cassandra.service.AbstractReadExecutor.makeDataRequests(AbstractReadExecutor.java:85) ~[main/:na] at org.apache.cassandra.service.AbstractReadExecutor$NeverSpeculatingReadExecutor.executeAsync(AbstractReadExecutor.java:216) ~[main/:na] at org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:1422) ~[main/:na] at org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1360) ~[main/:na] at org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1277) ~[main/:na] at org.apache.cassandra.service.pager.SliceQueryPager.queryNextPage(SliceQueryPager.java:96) ~[main/:na] at org.apache.cassandra.service.pager.AbstractQueryPager.fetchPage(AbstractQueryPager.java:85) ~[main/:na] at org.apache.cassandra.service.pager.SliceQueryPager.fetchPage(SliceQueryPager.java:39) ~[main/:na] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:239) ~[main/:na] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:179) ~[main/:na] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76) ~[main/:na] at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:226) ~[main/:na] at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:257) ~[main/:na] at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:242) ~[main/:na] at org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:123) ~[main/:na] at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507) [main/:na] at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401) [main/:na] at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-all-4.0.23.Final.jar:4.0.23.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) [netty-all-4.0.23.Final.jar:4.0.23.Final] at io.netty.channel.AbstractChannelHandlerContext.access$700(AbstractChannelHandlerContext.java:32) [netty-all-4.0.23.Final.jar:4.0.23.Final] at io.netty.channel.AbstractChannelHandlerContext$8.run(AbstractChannelHandlerContext.java:324) [netty-all-4.0.23.Final.jar:4.0.23.Final] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_74] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) [main/:na] at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [main/:na] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74] ERROR [SharedPool-Worker-2] 2016-03-08 14:15:16,739 ErrorMessage.java:338 - Unexpected exception during request java.lang.IndexOutOfBoundsException: null at java.nio.Buffer.checkIndex(Buffer.java:540) ~[na:1.8.0_74] at java.nio.HeapByteBuffer.put(HeapByteBuffer.java:178) ~[na:1.8.0_74] at org.apache.cassandra.db.composites.BoundedComposite.toByteBuffer(BoundedComposite.java:91) ~[main/:na] at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:387) ~[main/:na] at org.apache.cassandra.db.composites.AbstractCType$Serializer.serializedSize(AbstractCType.java:366) ~[main/:na] at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:286) ~[main/:na] at org.apache.cassandra.db.filter.ColumnSlice$Serializer.serializedSize(ColumnSlice.java:259) ~[main/:na] at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:541) ~[main/:na] at org.apache.cassandra.db.filter.SliceQueryFilter$Serializer.serializedSize(SliceQueryFilter.java:500) ~[main/:na] at org.apache.cassandra.db.SliceFromReadCommandSerializer.serializedSize(SliceFromReadCommand.java:203) ~[main/:na] at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:171) ~[main/:na] at org.apache.cassandra.db.ReadCommandSerializer.serializedSize(ReadCommand.java:132) ~[main/:na] at org.apache.cassandra.net.MessageOut.payloadSize(MessageOut.java:166) ~[main/:na] at org.apache.cassandra.net.OutboundTcpConnectionPool.getConnection(OutboundTcpConnectionPool.java:72) ~[main/:na] at org.apache.cassandra.net.MessagingService.getConnection(MessagingService.java:592) ~[main/:na] at org.apache.cassandra.net.MessagingService.sendOneWay(MessagingService.java:739) ~[main/:na] at org.apache.cassandra.net.MessagingService.sendRR(MessagingService.java:682) ~[main/:na] at org.apache.cassandra.net.MessagingService.sendRRWithFailure(MessagingService.java:665) ~[main/:na] at org.apache.cassandra.service.AbstractReadExecutor.makeRequests(AbstractReadExecutor.java:112) ~[main/:na] at org.apache.cassandra.service.AbstractReadExecutor.makeDataRequests(AbstractReadExecutor.java:85) ~[main/:na] at org.apache.cassandra.service.AbstractReadExecutor$NeverSpeculatingReadExecutor.executeAsync(AbstractReadExecutor.java:216) ~[main/:na] at org.apache.cassandra.service.StorageProxy.fetchRows(StorageProxy.java:1422) ~[main/:na] at org.apache.cassandra.service.StorageProxy.readRegular(StorageProxy.java:1360) ~[main/:na] at org.apache.cassandra.service.StorageProxy.read(StorageProxy.java:1277) ~[main/:na] at org.apache.cassandra.service.pager.SliceQueryPager.queryNextPage(SliceQueryPager.java:96) ~[main/:na] at org.apache.cassandra.service.pager.AbstractQueryPager.fetchPage(AbstractQueryPager.java:85) ~[main/:na] at org.apache.cassandra.service.pager.SliceQueryPager.fetchPage(SliceQueryPager.java:39) ~[main/:na] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:239) ~[main/:na] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:179) ~[main/:na] at org.apache.cassandra.cql3.statements.SelectStatement.execute(SelectStatement.java:76) ~[main/:na] at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:226) ~[main/:na] at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:257) ~[main/:na] at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:242) ~[main/:na] at org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:123) ~[main/:na] at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:507) [main/:na] at org.apache.cassandra.transport.Message$Dispatcher.channelRead0(Message.java:401) [main/:na] at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) [netty-all-4.0.23.Final.jar:4.0.23.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) [netty-all-4.0.23.Final.jar:4.0.23.Final] at io.netty.channel.AbstractChannelHandlerContext.access$700(AbstractChannelHandlerContext.java:32) [netty-all-4.0.23.Final.jar:4.0.23.Final] at io.netty.channel.AbstractChannelHandlerContext$8.run(AbstractChannelHandlerContext.java:324) [netty-all-4.0.23.Final.jar:4.0.23.Final] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_74] at org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:164) [main/:na] at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:105) [main/:na] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74] {noformat} I'll attach some full logs in just a minute here. > tuple_notation_test upgrade tests flaps > --------------------------------------- > > Key: CASSANDRA-11196 > URL: https://issues.apache.org/jira/browse/CASSANDRA-11196 > Project: Cassandra > Issue Type: Bug > Reporter: Jim Witschey > Assignee: Benjamin Lerer > Labels: dtest > > {{tuple_notation_test}} in the {{upgrade_tests.cql_tests}} module flaps on a number of different upgrade paths. Here are some of the tests that flap: > {code} > upgrade_tests/cql_tests.py:TestCQLNodes2RF1_2_1_UpTo_2_2_HEAD.tuple_notation_test > upgrade_tests/cql_tests.py:TestCQLNodes2RF1_2_1_UpTo_2_2_HEAD.tuple_notation_test > upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_1_UpTo_2_2_HEAD.tuple_notation_test > upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_1_UpTo_2_2_HEAD.tuple_notation_test > upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_2_HEAD_UpTo_Trunk.tuple_notation_test > upgrade_tests/cql_tests.py:TestCQLNodes3RF3_2_2_HEAD_UpTo_Trunk.tuple_notation_test > {code} > Here's an example failure: > http://cassci.datastax.com/job/upgrade_tests-all/9/testReport/upgrade_tests.cql_tests/TestCQLNodes2RF1_2_1_UpTo_2_2_HEAD/tuple_notation_test/ > All the failures I've seen fail with this error: > {code} > > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)