Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of bburruss@real.com designates
 207.188.23.4 as permitted sender)
Subject: 0.7 beta 1 - "error in row mutation" and NPE
From: "B. Todd Burruss" <bburruss@real.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary="=-QZ/9u59ZKCfJbMbOVMH9"
Date: Mon, 23 Aug 2010 11:33:51 -0700
Message-ID: <1282588431.3078.17.camel@rnwk-dell>
MIME-Version: 1.0
Old-Return-Path: bburruss@real.com

--=-QZ/9u59ZKCfJbMbOVMH9
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit

i see the following in my server logs quite closely while doing a lot of
batch_mutations and reads.  i create keyspaces and column families using
thrift api, not cassandra.yaml.  did not migrate anything from 0.6.

4 node cluster, RF = 3, QUORUM read/write.

happens immediately on a fresh start of the cluster with no data -
removed all data and commit logs before starting.

i believe the problem is because the creation of the keyspace/CFs has
possible not propagated to all nodes before i start slamming with the
batch_mutates and gets.  if i put a 1 second sleep after the keyspace
has been created, but before i start using it, all is well.


ERROR [ROW-MUTATION-STAGE:19] 2010-08-23 11:14:30,659
RowMutationVerbHandler.java (line 78) Error in row mutation
org.apache.cassandra.db.UnserializableColumnFamilyException: Couldn't
find cfId=1001
	at
org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:115)
	at
org.apache.cassandra.db.RowMutationSerializer.defreezeTheMaps(RowMutation.java:372)
	at
org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:382)
	at
org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:340)
	at
org.apache.cassandra.db.RowMutationVerbHandler.doVerb(RowMutationVerbHandler.java:46)
	at
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:41)
	at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:619)

ERROR [ROW-READ-STAGE:6] 2010-08-23 11:26:04,197
DebuggableThreadPoolExecutor.java (line 102) Error in ThreadPoolExecutor
java.lang.NullPointerException
	at org.apache.cassandra.db.Table.open(Table.java:104)
	at
org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:70)
	at
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:41)
	at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:619)


--=-QZ/9u59ZKCfJbMbOVMH9
Content-Type: text/html; charset="utf-8"
Content-Transfer-Encoding: 7bit

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
  <META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
  <META NAME="GENERATOR" CONTENT="GtkHTML/3.28.3">
</HEAD>
<BODY>
i see the following in my server logs quite closely while doing a lot of batch_mutations and reads.&nbsp; i create keyspaces and column families using thrift api, not cassandra.yaml.&nbsp; did not migrate anything from 0.6.<BR>
<BR>
4 node cluster, RF = 3, QUORUM read/write.<BR>
<BR>
happens immediately on a fresh start of the cluster with no data - removed all data and commit logs before starting.<BR>
<BR>
i believe the problem is because the creation of the keyspace/CFs has possible not propagated to all nodes before i start slamming with the batch_mutates and gets.&nbsp; if i put a 1 second sleep after the keyspace has been created, but before i start using it, all is well.<BR>
<BR>
<BR>
ERROR [ROW-MUTATION-STAGE:19] 2010-08-23 11:14:30,659 RowMutationVerbHandler.java (line 78) Error in row mutation<BR>
org.apache.cassandra.db.UnserializableColumnFamilyException: Couldn't find cfId=1001<BR>
	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:115)<BR>
	at org.apache.cassandra.db.RowMutationSerializer.defreezeTheMaps(RowMutation.java:372)<BR>
	at org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:382)<BR>
	at org.apache.cassandra.db.RowMutationSerializer.deserialize(RowMutation.java:340)<BR>
	at org.apache.cassandra.db.RowMutationVerbHandler.doVerb(RowMutationVerbHandler.java:46)<BR>
	at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:41)<BR>
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<BR>
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<BR>
	at java.lang.Thread.run(Thread.java:619)<BR>
<BR>
ERROR [ROW-READ-STAGE:6] 2010-08-23 11:26:04,197 DebuggableThreadPoolExecutor.java (line 102) Error in ThreadPoolExecutor<BR>
java.lang.NullPointerException<BR>
	at org.apache.cassandra.db.Table.open(Table.java:104)<BR>
	at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:70)<BR>
	at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:41)<BR>
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<BR>
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<BR>
	at java.lang.Thread.run(Thread.java:619)<BR>
<BR>
</BODY>
</HTML>

--=-QZ/9u59ZKCfJbMbOVMH9--