Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Tue, 6 May 2014 15:31:15 +0000 (UTC)
From: "Mohica Jasha (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.12712600.1399389851317.236749.1399390275440@arcas>
In-Reply-To: <JIRA.12712600.1399389851317@arcas>
References: <JIRA.12712600.1399389851317@arcas>
Subject: [jira] [Commented] (CASSANDRA-7176) error in cassandra log file
 under stress
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/CASSANDRA-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13990753#comment-13990753 ] 

Mohica Jasha commented on CASSANDRA-7176:
-----------------------------------------

Unfortunately we didn't have our logging fully enabled by the time this happened. But from what I can see from logs the query just before the java-driver timeout occurred in the app-server most likely was
{noformat}
DELETE from conditional_update_lock where resource_id = '${myresourceid}' IF lock_id = ${myuuid};
{noformat}

We cannot reproduce the problem. So I suspect maybe it is a race condition bug in Paxos implementation. Any idea?

> error in cassandra log file under stress
> ----------------------------------------
>
>                 Key: CASSANDRA-7176
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-7176
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>            Reporter: Mohica Jasha
>
> We are using C* 2.0.5 with DC1:3, DC2:3 and datastax java-driver 2.0.1 in our app-server.
> When we put our app-server under heavy stress testing. We got a {{com.datastax.driver.core.exceptions.ReadTimeoutException}} from java-driver and in the C* log file we got the following:
> {noformat}
> ERROR [Native-Transport-Requests:457009] 2014-05-02 13:49:09,794 QueryMessage.java (line 131) Unexpected error during query
> java.lang.UnsupportedOperationException: Invalid consistency level: LOCAL_SERIAL
>         at org.apache.cassandra.db.ConsistencyLevel.blockFor(ConsistencyLevel.java:137)
>         at org.apache.cassandra.service.StorageProxy.beginAndRepairPaxos(StorageProxy.java:416)
>         at org.apache.cassandra.service.StorageProxy.cas(StorageProxy.java:228)
>         at org.apache.cassandra.cql3.statements.ModificationStatement.executeWithCondition(ModificationStatement.java:423)
>         at org.apache.cassandra.cql3.statements.ModificationStatement.execute(ModificationStatement.java:380)
>         at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188)
>         at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:222)
>         at org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:119)
>         at org.apache.cassandra.transport.Message$Dispatcher.messageReceived(Message.java:304)
>         at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
>         at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>         at org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:43)
>         at org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:67)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
> ERROR [Native-Transport-Requests:457009] 2014-05-02 13:49:09,794 ErrorMessage.java (line 222) Unexpected exception during request
> java.lang.UnsupportedOperationException: Invalid consistency level: LOCAL_SERIAL
>         at org.apache.cassandra.db.ConsistencyLevel.blockFor(ConsistencyLevel.java:137)
>         at org.apache.cassandra.service.StorageProxy.beginAndRepairPaxos(StorageProxy.java:416)
>         at org.apache.cassandra.service.StorageProxy.cas(StorageProxy.java:228)
>         at org.apache.cassandra.cql3.statements.ModificationStatement.executeWithCondition(ModificationStatement.java:423)
>         at org.apache.cassandra.cql3.statements.ModificationStatement.execute(ModificationStatement.java:380)
>         at org.apache.cassandra.cql3.QueryProcessor.processStatement(QueryProcessor.java:188)
>         at org.apache.cassandra.cql3.QueryProcessor.process(QueryProcessor.java:222)
>         at org.apache.cassandra.transport.messages.QueryMessage.execute(QueryMessage.java:119)
>         at org.apache.cassandra.transport.Message$Dispatcher.messageReceived(Message.java:304)
>         at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
>         at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>         at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>         at org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:43)
>         at org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:67)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:744)
> {noformat}


--
This message was sent by Atlassian JIRA
(v6.2#6252)