cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aaron morton <aa...@thelastpickle.com>
Subject Re: Cannot start cassandra node anymore
Date Wed, 04 Jan 2012 21:10:54 GMT
If you have the time turn logging up to DEBUG and start again, it will log where it failed.
Put the logs aside incase there is a bug there. 


To get things running again: Move the commit log segment out of the directory and try the
restart. Then run a repair from the node. 

Have you made any recent schema changes ? 

Hope that helps. 

-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com

On 5/01/2012, at 5:09 AM, Carlo Pires wrote:

> Hi,
> 
> I can't start a node of my cluster. Could someone help me to catch the problem?
> 
> Using: debian with cassandra 1.0.6.
> 
> root@carlo-laptop:/etc/cassandra# cat /var/log/cassandra/output.log 
>  INFO 13:46:00,596 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.6.0_26
>  INFO 13:46:00,600 Heap size: 1052770304/1052770304
>  INFO 13:46:00,601 Classpath: /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4.0-fixes.jar:/usr/share/cassandra/lib/avro-1.4.0-sources-fixes.jar:/usr/share/cassandra/lib/commons-cli-1.1.jar:/usr/share/cassandra/lib/commons-codec-1.2.jar:/usr/share/cassandra/lib/commons-lang-2.4.jar:/usr/share/cassandra/lib/compress-lzf-0.8.4.jar:/usr/share/cassandra/lib/concurrentlinkedhashmap-lru-1.2.jar:/usr/share/cassandra/lib/guava-r08.jar:/usr/share/cassandra/lib/high-scale-lib-1.1.2.jar:/usr/share/cassandra/lib/jackson-core-asl-1.4.0.jar:/usr/share/cassandra/lib/jackson-mapper-asl-1.4.0.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar:/usr/share/cassandra/lib/jline-0.9.94.jar:/usr/share/cassandra/lib/json-simple-1.1.jar:/usr/share/cassandra/lib/libthrift-0.6.jar:/usr/share/cassandra/lib/log4j-1.2.16.jar:/usr/share/cassandra/lib/servlet-api-2.5-20081211.jar:/usr/share/cassandra/lib/slf4j-api-1.6.1.jar:/usr/share/cassandra/lib/slf4j-log4j12-1.6.1.jar:/usr/share/cassandra/lib/snakeyaml-1.6.jar:/usr/share/cassandra/lib/snappy-java-1.0.4.1.jar:/usr/share/cassandra/apache-cassandra-1.0.6.jar:/usr/share/cassandra/apache-cassandra-thrift-1.0.6.jar:/usr/share/cassandra/apache-cassandra.jar:/usr/share/java/jna.jar:/etc/cassandra:/usr/share/java/commons-daemon.jar:/usr/share/cassandra/lib/jamm-0.2.5.jar
>  INFO 13:46:00,617 Unable to link C library. Native methods will be disabled.
>  INFO 13:46:00,627 Loading settings from file:/etc/cassandra/cassandra.yaml
>  INFO 13:46:00,767 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
>  INFO 13:46:00,783 Global memtable threshold is enabled at 334MB
>  INFO 13:46:01,086 Opening /var/lib/cassandra/data/system/Versions-hc-5 (247 bytes)
>  INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-394 (1307316 bytes)
>  INFO 13:46:01,125 Opening /var/lib/cassandra/data/system/Schema-hc-396 (14421 bytes)
>  INFO 13:46:01,145 Opening /var/lib/cassandra/data/system/Migrations-hc-394 (2285452
bytes)
>  INFO 13:46:01,148 Opening /var/lib/cassandra/data/system/Migrations-hc-396 (18582 bytes)
>  INFO 13:46:01,159 Opening /var/lib/cassandra/data/system/LocationInfo-hc-13 (415 bytes)
>  INFO 13:46:01,162 Opening /var/lib/cassandra/data/system/LocationInfo-hc-15 (163 bytes)
>  INFO 13:46:01,162 Opening /var/lib/cassandra/data/system/LocationInfo-hc-14 (80 bytes)
>  INFO 13:46:01,175 Opening /var/lib/cassandra/data/system/HintsColumnFamily-hc-7 (13566
bytes)
>  INFO 13:46:01,183 Opening /var/lib/cassandra/data/system/HintsColumnFamily-hc-6 (1019
bytes)
>  INFO 13:46:01,227 Loading schema version 5c583e90-3631-11e1-0000-b1d70f5561fa
>  INFO 13:46:01,572 Creating new commitlog segment /var/lib/cassandra/commitlog/CommitLog-1325691961572.log
>  INFO 13:46:01,586 Replaying /var/lib/cassandra/commitlog/CommitLog-1325586865178.log,
/var/lib/cassandra/commitlog/CommitLog-1325625102454.log, /var/lib/cassandra/commitlog/CommitLog-1325674574711.log,
/var/lib/cassandra/commitlog/CommitLog-1325676430281.log, /var/lib/cassandra/commitlog/CommitLog-1325676440840.log,
/var/lib/cassandra/commitlog/CommitLog-1325676472468.log, /var/lib/cassandra/commitlog/CommitLog-1325690114212.log,
/var/lib/cassandra/commitlog/CommitLog-1325691142058.log, /var/lib/cassandra/commitlog/CommitLog-1325691453774.log,
/var/lib/cassandra/commitlog/CommitLog-1325691528668.log
>  INFO 13:46:01,657 Finished reading /var/lib/cassandra/commitlog/CommitLog-1325586865178.log
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:160)
> Caused by: java.lang.IllegalArgumentException
>     at java.nio.Buffer.limit(Buffer.java:249)
>     at org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57)
>     at org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66)
>     at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:82)
>     at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:37)
>     at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606)
>     at java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:878)
>     at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893)
>     at org.apache.cassandra.db.ThreadSafeSortedColumns.addColumn(ThreadSafeSortedColumns.java:88)
>     at org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:129)
>     at org.apache.cassandra.db.AbstractColumnContainer.addColumn(AbstractColumnContainer.java:124)
>     at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:148)
>     at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(ColumnFamilySerializer.java:139)
>     at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:132)
>     at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401)
>     at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:285)
>     at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172)
>     at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:196)
>     at org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassandraDaemon.java:238)
>     ... 5 more
> Cannot load daemon
> Service exit with a return value of 3
> 


Mime
View raw message