Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Fri, 27 Dec 2013 21:05:50 +0000 (UTC)
From: "Nikolai Grigoriev (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.12686569.1388177600984.16601.1388178350478@arcas>
In-Reply-To: <JIRA.12686569.1388177600984@arcas>
References: <JIRA.12686569.1388177600984@arcas>
Subject: [jira] [Updated] (CASSANDRA-6531) Failure to start after unclean
 shutdown - java.lang.IllegalArgumentException: bufferSize must be positive
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/CASSANDRA-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nikolai Grigoriev updated CASSANDRA-6531:
-----------------------------------------

    Attachment: cassandra_jstack.txt
                system.log.gz

Startup log with default logging level set to TRACE (log4j.rootLogger=TRACE,stdout,R). Interestingly enough I do not see the original exception in the log when I change it to TRACE and Cassandra process does not terminate. So I include the thread dump just in case.

> Failure to start after unclean shutdown - java.lang.IllegalArgumentException: bufferSize must be positive
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-6531
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6531
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: Cassandra 2.0.3 with patches for CASSANDRA-6496 and CASSANDRA-6284, built from source; Linux; XFS on the data disks; 5 data disks; 6 nodes
>            Reporter: Nikolai Grigoriev
>         Attachments: cassandra_jstack.txt, system.log.gz, system.log.gz
>
>
> We had a severe power outage in the lab that resulted in unclean shutdown of the Cassandra servers. After the power was back I tried to start the cluster. Two out of 6 nodes cannot start because of this exception:
> {code}
>  INFO 20:47:11,003 Initializing system.local
>  INFO [main] 2013-12-27 20:47:11,003 ColumnFamilyStore.java (line 251) Initializing system.local
>  INFO 20:47:11,006 Opening /hadoop/disk1/cassandra/data/system/local/system-local-jb-2478 (5836 bytes)
>  INFO [SSTableBatchOpen:1] 2013-12-27 20:47:11,006 SSTableReader.java (line 223) Opening /hadoop/disk1/cassandra/data/system/local/system-local-jb-2478 (5836 bytes)
>  INFO 20:47:11,006 Opening /hadoop/disk4/cassandra/data/system/local/system-local-jb-2479 (144 bytes)
>  INFO [SSTableBatchOpen:2] 2013-12-27 20:47:11,006 SSTableReader.java (line 223) Opening /hadoop/disk4/cassandra/data/system/local/system-local-jb-2479 (144 bytes)
> ERROR 20:47:12,366 Exception encountered during startup
> java.lang.IllegalArgumentException: bufferSize must be positive
>         at org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:67)
>         at org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76)
>         at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:55)
>         at org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1363)
>         at org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:67)
>         at org.apache.cassandra.io.sstable.SSTableReader.getScanner(SSTableReader.java:1147)
>         at org.apache.cassandra.db.RowIteratorFactory.getIterator(RowIteratorFactory.java:69)
>         at org.apache.cassandra.db.ColumnFamilyStore.getSequentialIterator(ColumnFamilyStore.java:1526)
>         at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1645)
>         at org.apache.cassandra.db.RangeSliceCommand.executeLocally(RangeSliceCommand.java:137)
>         at org.apache.cassandra.cql3.statements.SelectStatement.executeInternal(SelectStatement.java:236)
>         at org.apache.cassandra.cql3.statements.SelectStatement.executeInternal(SelectStatement.java:1)
>         at org.apache.cassandra.cql3.QueryProcessor.processInternal(QueryProcessor.java:255)
>         at org.apache.cassandra.db.SystemKeyspace.getUnfinishedCompactions(SystemKeyspace.java:206)
>         at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:261)
>         at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:461)
>         at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:504)
> {code}
> Collecting the logs now, will attach to the issue in a moment. 


--
This message was sent by Atlassian JIRA
(v6.1.5#6160)