cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcus Eriksson (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CASSANDRA-7368) Compaction stops after org.apache.cassandra.io.sstable.CorruptSSTableException
Date Fri, 17 Oct 2014 06:19:34 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marcus Eriksson resolved CASSANDRA-7368.
----------------------------------------
    Resolution: Cannot Reproduce

The compaction stopping can have a few causes (that are now fixed), first we have CASSANDRA-7745
where we wrongly said that there were no more compactions to do, and then we have the fact
that multi threaded compaction was really shaky and it is now gone (in 2.0)

I would recommend upgrading to a newer version and try to reproduce it there

> Compaction stops after org.apache.cassandra.io.sstable.CorruptSSTableException
> ------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-7368
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-7368
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: OS: RHEL 6.5
> Cassandra version: 1.2.16
>            Reporter: Francois Richard
>            Assignee: Marcus Eriksson
>
> Hi,
> We are getting a case where compaction stops totally on a node after an exception related
to: org.apache.cassandra.io.sstable.CorruptSSTableException.
> nodetool compactionstats remains at the same level for hours:
> {code}
> pending tasks: 1451
>           compaction type        keyspace   column family       completed           total
     unit  progress
>                Compaction        SyncCoreContactPrefixBytesIndex       257799931    
  376785179     bytes    68.42%
> Active compaction remaining time :        n/a
> {code}
> Here is the exception log:
> {code}
> ERROR [Deserialize SSTableReader(path='/home/y/var/cassandra/data/SyncCore/ContactPrefixBytesIndex/SyncCore-ContactPrefixBytesIndex-ic-116118-Data.db')]
2014-06-09 06:39:37,570 CassandraDaemon.java (line 191) Exception in thread Thread[Deserialize
SSTableReader(path='/home/y/var/cassandra/data/SyncCore/ContactPrefixBytesIndex/SyncCore-ContactPrefixBytesIndex-ic-116118-Data.db'),1,main]
> org.apache.cassandra.io.sstable.CorruptSSTableException: java.io.IOException: dataSize
of 7421941880990663551 starting at 257836699 would be larger than file /home/y/var/cassandra/data/SyncCore/ContactPrefixBytesIndex/SyncCore-ContactPrefixBytesIndex-ic-116118-Data.db
length 376785179
> 	at org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:167)
> 	at org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:83)
> 	at org.apache.cassandra.io.sstable.SSTableIdentityIterator.<init>(SSTableIdentityIterator.java:69)
> 	at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:180)
> 	at org.apache.cassandra.io.sstable.SSTableScanner$KeyScanningIterator.next(SSTableScanner.java:155)
> 	at org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:142)
> 	at org.apache.cassandra.io.sstable.SSTableScanner.next(SSTableScanner.java:38)
> 	at org.apache.cassandra.db.compaction.LeveledCompactionStrategy$LeveledScanner.computeNext(LeveledCompactionStrategy.java:238)
> 	at org.apache.cassandra.db.compaction.LeveledCompactionStrategy$LeveledScanner.computeNext(LeveledCompactionStrategy.java:207)
> 	at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
> 	at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
> --
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message