cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Claire Chang <cla...@merchantcircle.com>
Subject Re: ERROR 22:59:00,329 Error in ThreadPoolExecutor
Date Fri, 16 Jul 2010 01:08:16 GMT
i saw this in the kernel log: jsvc uses 32-bit capabilitie. Is this right?

our server is 
Linux  2.6.32-23-generic #37-Ubuntu SMP Fri Jun 11 08:03:28 UTC 2010 x86_64 GNU/Linux

On Jul 15, 2010, at 11:04 AM, Claire Chang wrote:

> I am using Random Partitioner. The other 2 nodes are working fine. There are no Errors
in the log files for the 2 good nodes. 
> 
> There were no log messages within 30 minutes before the exception occurs. Here is the
last log statement before the exception occurred.
> 
> INFO [COMPACTION-POOL:1] 2010-07-15 03:07:58,217 CompactionManager.java (line 246) Compacting
[org.
> apache.cassandra.io.SSTableReader(path='/var/lib/cassandra/data/Musubi/Conn-22-Data.db'),org.apache.
> cassandra.io.SSTableReader(path='/var/lib/cassandra/data/Musubi/Conn-23-Data.db'),org.apache.cassand
> ra.io.SSTableReader(path='/var/lib/cassandra/data/Musubi/Conn-24-Data.db'),org.apache.cassandra.io.S
> STableReader(path='/var/lib/cassandra/data/Musubi/Conn-25-Data.db')]
> INFO [COMPACTION-POOL:1] 2010-07-15 03:07:59,884 CompactionManager.java (line 320) Compacted
to /var/lib/cassandra/data/Musubi/Conn-26-Data.db.  21687831/21675414 bytes for 72901 keys.
 Time: 1666ms.
> 
> Any help is MUCH appreciated!
> 
> claire
> On Jul 15, 2010, at 10:43 AM, Claire Chang wrote:
> 
>> I am trying to set up a 3 node cluster. RF=3 and CL=1 for most of the request. The
initial seeding took about 1 hour to complete which loaded each node with 2G of data. After
the seeding completed, one node started having this exception and hung. Read/Write with CL=ALL
timed out but CL=QUORUM was fine. I restarted the node and the problem went away. But after
3 hours, same scenario reappeared. Any idea? Any workaround? Thanks. -Claire
>> 
>> 
>> ERROR 22:59:00,329 Error in ThreadPoolExecutor
>> java.lang.NullPointerException
>>       at org.apache.cassandra.db.Table.apply(Table.java:407)
>>       at org.apache.cassandra.db.RowMutationVerbHandler.doVerb(RowMutationVerbHandler.java:68)
>>       at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:40)
>>       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>>       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>>       at java.lang.Thread.run(Thread.java:636)
>> ...
>> 
>> 
>> ERROR 03:30:59,862 Uncaught exception in thread Thread[ROW-MUTATION-STAGE:15,5,main]
>> java.lang.NullPointerException
>>       at org.apache.cassandra.db.Table.apply(Table.java:407)
>>       at org.apache.cassandra.db.RowMutationVerbHandler.doVerb(RowMutationVerbHandler.java:68)
>>       at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:40)
>>       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>>       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>>       at java.lang.Thread.run(Thread.java:636)
>> INFO 06:11:22,965 InetAddress /192.168.11.29 is now dead.
>> INFO 06:11:22,966 InetAddress /192.168.11.27 is now dead.
>> 
> 


Mime
View raw message