cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From S├ębastien Giroux (JIRA) <j...@apache.org>
Subject [jira] Issue Comment Edited: (CASSANDRA-2240) nodetool scrub hangs or throws an exception
Date Tue, 01 Mar 2011 15:37:37 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000920#comment-13000920
] 

S├ębastien Giroux edited comment on CASSANDRA-2240 at 3/1/11 3:36 PM:
---------------------------------------------------------------------

I'm testing it as we speak!

Log are flooded with this:

 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it
 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it
 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it
 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it

I'm not sure why it's scrubbing "WebsiteWajams" CF as I asked for "Wajam" (nodetool -h 127.0.0.1
scrub Wajam Wajam) ... Either way, this sstable is messed up too so that's fine.

Hopefully it won't just do like v4 that ran all night and was still echoing invalid bloom
filter for the same sstable in the log this morning, Looks like it was stuck in a infinite
loop or something.

It looks like it's scrubbing another sstable now so that's already an improvment.

Will keep you guys updated!




      was (Author: wajam):
    I'm testing it as we speak!

Log are flooded with this:

 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it
 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it
 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it
 INFO 15:31:15,783 Invalid bloom filter in SSTableReader(path='/var/lib/cassandra/data/Wajam/WebsiteWajams-f-164-Data.db');
will rebuild it

I'm not sure why it's scrubbing "WebsiteWajams" CF as I asked for "Wajam" (nodetool -h 127.0.0.1
scrub Wajam Wajam) ... Either way, this sstable is messed up too so that's fine.

Hopefully it won't just do like v4 that ran all night and was still echoing invalid bloom
filter for the same sstable in the log this morning, Looks like it was stuck in a infinite
loop or something.

It looks like it's scrubbing another sstable now so that's already an improvment.

Will keep you guy updated!



  
> nodetool scrub hangs or throws an exception
> -------------------------------------------
>
>                 Key: CASSANDRA-2240
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2240
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tools
>    Affects Versions: 0.7.3
>         Environment: using build #314 from hudson
>            Reporter: Yaniv Kunda
>            Assignee: Jonathan Ellis
>             Fix For: 0.7.4
>
>         Attachments: 2240-v2.txt, 2240-v3.txt, 2240-v5.patch, 2240-v6.txt, 2240.txt,
2240.txt, exception2.txt, jstack1.txt, signatureBuckets-f-104.tar.gz, system.log.2.gz, system.log.gz,
test-0.6.x-tables.tar.gz, userChannelFilter-f-210.tar.gz
>
>
> trying to run nodetool scrub hung or (only happened one time) threw the following exception:
> ERROR [CompactionExecutor:1] 2011-02-28 10:26:26,620 AbstractCassandraDaemon.java (line
114) Fatal exception in thread Thread[CompactionExecutor:1,1,main]
> java.lang.AssertionError
>         at org.apache.cassandra.dht.RandomPartitioner.convertFromDiskFormat(RandomPartitioner.java:62)
>         at org.apache.cassandra.io.sstable.SSTableReader.decodeKey(SSTableReader.java:627)
>         at org.apache.cassandra.db.CompactionManager.doScrub(CompactionManager.java:538)
>         at org.apache.cassandra.db.CompactionManager.access$600(CompactionManager.java:55)
>         at org.apache.cassandra.db.CompactionManager$3.call(CompactionManager.java:194)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message