Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 764F14BE2 for ; Mon, 23 May 2011 18:18:50 +0000 (UTC) Received: (qmail 15065 invoked by uid 500); 23 May 2011 18:18:48 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 15036 invoked by uid 500); 23 May 2011 18:18:48 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 15028 invoked by uid 99); 23 May 2011 18:18:48 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 May 2011 18:18:48 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [64.255.243.50] (HELO barracuda.healthx.com) (64.255.243.50) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 May 2011 18:18:40 +0000 X-ASG-Debug-ID: 1306174693-0c3dc4580001-f7dORa Received: from hxexch01.healthx.com (hxexch01.healthx.com [10.1.1.20]) by barracuda.healthx.com with ESMTP id ndHxDiJKTy20CwWb for ; Mon, 23 May 2011 14:18:14 -0400 (EDT) X-Barracuda-Envelope-From: smcpheeters@healthx.com X-ASG-Whitelist: Client x-cr-puzzleid: {781E1DCC-6F3F-4396-A0F9-3E8181441A8C} MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Content-class: urn:content-classes:message Subject: Reboot, now node down 0.8rc1 X-MimeOLE: Produced By Microsoft Exchange V6.5 X-ASG-Orig-Subj: Reboot, now node down 0.8rc1 Date: Mon, 23 May 2011 14:18:10 -0400 Message-ID: <178AEA2FC5B6064AB2A15FA6A78C65A907369197@hxexch01.healthx.com> X-MS-Has-Attach: x-cr-hashedpuzzle: Rt4= AMEv A5z5 BitR CwoI DGfI DqHU D0NR E4ui FtB3 GMGH GQyf Gp9E JXRA KoMh K3G2;1;dQBzAGUAcgBAAGMAYQBzAHMAYQBuAGQAcgBhAC4AYQBwAGEAYwBoAGUALgBvAHIAZwA=;Sosha1_v1;7;{781E1DCC-6F3F-4396-A0F9-3E8181441A8C};cwBtAGMAcABoAGUAZQB0AGUAcgBzAEAAaABlAGEAbAB0AGgAeAAuAGMAbwBtAA==;Mon, 23 May 2011 18:18:11 GMT;UgBlAGIAbwBvAHQALAAgAG4AbwB3ACAAbgBvAGQAZQAgAGQAbwB3AG4AIAAwAC4AOAByAGMAMQA= X-MS-TNEF-Correlator: Thread-Topic: Reboot, now node down 0.8rc1 Thread-Index: AcwZdcXxplAoMDVLSB+ccUDktP1ecQ== From: "Scott McPheeters" To: X-Barracuda-Connect: hxexch01.healthx.com[10.1.1.20] X-Barracuda-Start-Time: 1306174693 X-Barracuda-URL: http://barracuda.healthx.com:8000/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at healthx.com X-Virus-Checked: Checked by ClamAV on apache.org I have a test node system running release 0.8rc1. I rebooted node3 and now Cassandra is failing on startup.=20 Any ideas? I am not sure where to begin. Debian 6, plenty of disk space, Cassandra 0.8rc1 INFO 13:48:58,192 Creating new commitlog segment /home/cassandra/commitlog/CommitLog-1306172938192.log INFO 13:48:58,236 Replaying /home/cassandra/commitlog/CommitLog-1305918923361.log INFO 13:49:04,041 Finished reading /home/cassandra/commitlog/CommitLog-1305918923361.log java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav a:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor Impl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.commons.daemon.support.DaemonLoader.load(DaemonLoader.java:16 0) Caused by: java.io.IOError: java.io.EOFException at org.apache.cassandra.io.util.ColumnIterator.deserializeNext(ColumnSorted Map.java:265) at org.apache.cassandra.io.util.ColumnIterator.next(ColumnSortedMap.java:28 1) at org.apache.cassandra.io.util.ColumnIterator.next(ColumnSortedMap.java:23 6) at java.util.concurrent.ConcurrentSkipListMap.buildFromSorted(ConcurrentSki pListMap.java:1493) at java.util.concurrent.ConcurrentSkipListMap.(ConcurrentSkipListMap. java:1443) at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.ja va:402) at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(Column FamilySerializer.java:136) at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilyS erializer.java:126) at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(Ro wMutation.java:367) at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:271) at org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:158) at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassa ndraDaemon.java:174) at org.apache.cassandra.service.AbstractCassandraDaemon.init(AbstractCassan draDaemon.java:216) ... 5 more Caused by: java.io.EOFException at java.io.DataInputStream.readFully(DataInputStream.java:180) at java.io.DataInputStream.readFully(DataInputStream.java:152) at org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:394) at org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBuffer Util.java:368) at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.ja va:87) at org.apache.cassandra.io.util.ColumnIterator.deserializeNext(ColumnSorted Map.java:261) ... 17 more Cannot load daemon Service exit with a return value of 3 Scott