cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nikolai Grigoriev (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-6531) Failure to start after unclean shutdown - java.lang.IllegalArgumentException: bufferSize must be positive
Date Sat, 28 Dec 2013 02:03:50 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13857912#comment-13857912
] 

Nikolai Grigoriev commented on CASSANDRA-6531:
----------------------------------------------

I believe the log messages were somewhat misleading. After messing with debug logs for a while
I have found that the problem was, apparently, not with system KS. I have removed all stuff
\*compactions_in_progress\* and that helped one of these two nodes in question to start. Another
one seems to have an identity crisis as it believes that another node with the same address
has already joined the cluster...but that seems to be another story.

> Failure to start after unclean shutdown - java.lang.IllegalArgumentException: bufferSize
must be positive
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-6531
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6531
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: Cassandra 2.0.3 with patches for CASSANDRA-6496 and CASSANDRA-6284,
built from source; Linux; XFS on the data disks; 5 data disks; 6 nodes
>            Reporter: Nikolai Grigoriev
>            Assignee: Jonathan Ellis
>              Labels: compression
>             Fix For: 1.2.14, 2.0.5
>
>         Attachments: 6531.txt, cassandra_jstack.txt, system.log.gz, system.log.gz
>
>
> We had a severe power outage in the lab that resulted in unclean shutdown of the Cassandra
servers. After the power was back I tried to start the cluster. Two out of 6 nodes cannot
start because of this exception:
> {code}
>  INFO 20:47:11,003 Initializing system.local
>  INFO [main] 2013-12-27 20:47:11,003 ColumnFamilyStore.java (line 251) Initializing system.local
>  INFO 20:47:11,006 Opening /hadoop/disk1/cassandra/data/system/local/system-local-jb-2478
(5836 bytes)
>  INFO [SSTableBatchOpen:1] 2013-12-27 20:47:11,006 SSTableReader.java (line 223) Opening
/hadoop/disk1/cassandra/data/system/local/system-local-jb-2478 (5836 bytes)
>  INFO 20:47:11,006 Opening /hadoop/disk4/cassandra/data/system/local/system-local-jb-2479
(144 bytes)
>  INFO [SSTableBatchOpen:2] 2013-12-27 20:47:11,006 SSTableReader.java (line 223) Opening
/hadoop/disk4/cassandra/data/system/local/system-local-jb-2479 (144 bytes)
> ERROR 20:47:12,366 Exception encountered during startup
> java.lang.IllegalArgumentException: bufferSize must be positive
>         at org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
>         at org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76)
>         at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:55)
>         at org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1363)
>         at org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:67)
>         at org.apache.cassandra.io.sstable.SSTableReader.getScanner(SSTableReader.java:1147)
>         at org.apache.cassandra.db.RowIteratorFactory.getIterator(RowIteratorFactory.java:69)
>         at org.apache.cassandra.db.ColumnFamilyStore.getSequentialIterator(ColumnFamilyStore.java:1526)
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1645)
>         at org.apache.cassandra.db.RangeSliceCommand.executeLocally(RangeSliceCommand.java:137)
>         at org.apache.cassandra.cql3.statements.SelectStatement.executeInternal(SelectStatement.java:236)
>         at org.apache.cassandra.cql3.statements.SelectStatement.executeInternal(SelectStatement.java:1)
>         at org.apache.cassandra.cql3.QueryProcessor.processInternal(QueryProcessor.java:255)
>         at org.apache.cassandra.db.SystemKeyspace.getUnfinishedCompactions(SystemKeyspace.java:206)
>         at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:261)
>         at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:461)
>         at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:504)
> {code}
> Collecting the logs now, will attach to the issue in a moment. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message