Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 8B722200BA8 for ; Mon, 24 Oct 2016 10:38:16 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 89E74160AEB; Mon, 24 Oct 2016 08:38:16 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 8380C160AE1 for ; Mon, 24 Oct 2016 10:38:15 +0200 (CEST) Received: (qmail 31746 invoked by uid 500); 24 Oct 2016 08:38:13 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 31736 invoked by uid 99); 24 Oct 2016 08:38:13 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Oct 2016 08:38:13 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 3A7DCC064D for ; Mon, 24 Oct 2016 08:38:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.291 X-Spam-Level: *** X-Spam-Status: No, score=3.291 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, HTML_OBFUSCATE_10_20=1.162, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 1yvLFnIHypty for ; Mon, 24 Oct 2016 08:38:12 +0000 (UTC) Received: from mail-wm0-f45.google.com (mail-wm0-f45.google.com [74.125.82.45]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 75FB05F576 for ; Mon, 24 Oct 2016 08:38:11 +0000 (UTC) Received: by mail-wm0-f45.google.com with SMTP id b80so90555256wme.1 for ; Mon, 24 Oct 2016 01:38:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=HnXFs+SkCbV5nd1NBsymUrnwqhMZjDYVEaPAnYk4gfk=; b=tk5w1Um5ZXQQtDAxS0WyRq9C+pujWR82NslxMmz8yDNTZViUPcRG+cPHI8eAoRJWt8 iUb1WN+UblaZAs+5tNtAdkmbQJSqAZICXjjvg7yY9NWQggYcADQqTP8Hp3xbB4OG9SZZ jpTeDWGijIAkoD8+6QbDrofgtFP5A6D/90VcUhVX8NLMOUCWLzLMzcJclm45tvtMMIVm exL8J14Ah9mFOwugzKt+dV4vBhKCBm/tCcGmWbDhRmiTkH9jf1NEv1HFzfkD65t1KL9R 3woQkIyyZJCT9iHJ+uQtaxg8UCAM60VZHsPmP6aAbXsA9fhqEMiNw9rrsymrMVyg9VCC rzsw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=HnXFs+SkCbV5nd1NBsymUrnwqhMZjDYVEaPAnYk4gfk=; b=OaYbgjtZqg91tZsRiez4Av0smnWh5R+lYZredz+0NFE7oowGBKz5y7wCw9zsz/1opv xXy3QuJIimoIetm8UFT1gD9euq7g35Y+dqm0xOZK/ovn4ICP5YwI5W7KlHFmu/OLJv2T 3CwTzvSUqTqcCsd9QPLTNsIJbr2xfPfcOe9fFBlsxjyKSybYllVsKPudNdyFaxK6b818 Vqd5uGwxHiG6syTSgAmfZ32R6kJfIPdEr8Uhm5nBdOzUgKndMMVVW+tQunw+zJ8ovIZK /J9DD0vWkgC/AlW932fjYl6E7h//HvJMycVNupObzM/I4m5a02rvRTOIlUJPcMwC4AqY lRyg== X-Gm-Message-State: AA6/9RmHwrbF81qD3sqLP2w5r2Bj2Q9Rv4JsWhNGE0lIABt5Z/grW7lmF3k58YX1+SDiASb7L9DT3yeVYogKUg== X-Received: by 10.28.232.23 with SMTP id f23mr14649663wmh.125.1477298290226; Mon, 24 Oct 2016 01:38:10 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.50.197 with HTTP; Mon, 24 Oct 2016 01:38:09 -0700 (PDT) In-Reply-To: References: From: Ali Akhtar Date: Mon, 24 Oct 2016 13:38:09 +0500 Message-ID: Subject: Re: CommitLogReadHandler$CommitLogReadException: Unexpected error deserializing mutation To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a11466da2d0fa82053f984fad archived-at: Mon, 24 Oct 2016 08:38:16 -0000 --001a11466da2d0fa82053f984fad Content-Type: text/plain; charset=UTF-8 Thanks, but I did come across those, it doesn't look like they provide a resolution. On Mon, Oct 24, 2016 at 1:36 PM, DuyHai Doan wrote: > You may read those: > > https://issues.apache.org/jira/browse/CASSANDRA-12121 > https://issues.apache.org/jira/browse/CASSANDRA-12397 > > On Mon, Oct 24, 2016 at 10:24 AM, Ali Akhtar wrote: > >> Any workarounds that don't involve me having to figure out how to >> uninstall and re-install a different version? >> >> On Mon, Oct 24, 2016 at 1:24 PM, Ali Akhtar wrote: >> >>> 3.9.. >>> >>> On Mon, Oct 24, 2016 at 1:22 PM, DuyHai Doan >>> wrote: >>> >>>> Which version of C* ? There was similar issues with commitlogs in >>>> tic-toc versions. >>>> >>>> On Mon, Oct 24, 2016 at 4:18 AM, Ali Akhtar >>>> wrote: >>>> >>>>> I have a single node cassandra installation on my dev laptop, which is >>>>> used just for dev / testing. >>>>> >>>>> Recently, whenever I restart my laptop, Cassandra fails to start when >>>>> I run it via 'sudo service cassandra start'. >>>>> >>>>> Doing a tail on /var/log/cassandra/system.log gives this log: >>>>> >>>>> *INFO [main] 2016-10-24 07:08:02,950 CommitLog.java:166 - Replaying >>>>> /var/lib/cassandra/commitlog/CommitLog-6-1476907676969.log, >>>>> /var/lib/cassandra/commitlog/CommitLog-6-1476907676970.log, >>>>> /var/lib/cassandra/commitlog/CommitLog-6-1477269052845.log* >>>>> *ERROR [main] 2016-10-24 07:08:03,357 JVMStabilityInspector.java:82 - >>>>> Exiting due to error while processing commit log during initialization.* >>>>> *org.apache.cassandra.db.commitlog.CommitLogReadHandler$CommitLogReadException: >>>>> Unexpected error deserializing mutation; saved to >>>>> /tmp/mutation9186356142128811141dat. This may be caused by replaying a >>>>> mutation against a table with the same name but incompatible schema. >>>>> Exception follows: org.apache.cassandra.serializers.MarshalException: Not >>>>> enough bytes to read 0th field board_id* >>>>> * at >>>>> org.apache.cassandra.db.commitlog.CommitLogReader.readMutation(CommitLogReader.java:410) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.db.commitlog.CommitLogReader.readSection(CommitLogReader.java:343) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.db.commitlog.CommitLogReader.readCommitLogSegment(CommitLogReader.java:202) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.db.commitlog.CommitLogReader.readAllFiles(CommitLogReader.java:85) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.db.commitlog.CommitLogReplayer.replayFiles(CommitLogReplayer.java:135) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.db.commitlog.CommitLog.recoverFiles(CommitLog.java:187) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.db.commitlog.CommitLog.recoverSegmentsOnDisk(CommitLog.java:167) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:323) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:601) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> * at >>>>> org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) >>>>> [apache-cassandra-3.9.jar:3.9]* >>>>> >>>>> >>>>> I then have to do 'sudo rm -rf /var/lib/cassandra/commitlog/*' which >>>>> fixes the problem, but then I lose all of my data. >>>>> >>>>> It looks like its saying there wasn't enough data to read the field >>>>> 'board_id', any ideas why that would be? >>>>> >>>> >>>> >>> >> > --001a11466da2d0fa82053f984fad Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Thanks, but I did come across those, it doesn't look l= ike they provide a resolution.

On Mon, Oct 24, 2016 at 1:36 PM, DuyHai Doan <doan= duyhai@gmail.com> wrote:
You may read those:


On Mon, Oct 24, 2016 at 10:24 AM, Ali Akhtar <= ali.rac200@gmail.com> wrote:
Any workarounds that don't involve me having to figu= re out how to uninstall and re-install a different version?

On Mon, Oct 24, 2016= at 1:24 PM, Ali Akhtar <ali.rac200@gmail.com> wrote:
=
3.9..

On Mon, Oct 24, 2016 at 1:22 PM, DuyHai Doan <doanduyh= ai@gmail.com> wrote:
Which version of C* ? There was similar issues with commitlogs i= n tic-toc versions.

On Mon, Oct 24, 2016 at 4:18 AM, Ali Akhtar <al= i.rac200@gmail.com> wrote:
=
I have a single node cassandra installation on my dev lapt= op, which is used just for dev / testing.

Recently, when= ever I restart my laptop, Cassandra fails to start when I run it via 's= udo service cassandra start'.

Doing a tail on = /var/log/cassandra/system.log gives this log:

INFO =C2=A0[main] 2016-10-24 07:08:02,950 CommitLog.java:166 - Replayin= g /var/lib/cassandra/commitlog/CommitLog-6-1476907676969.log, /var/lib= /cassandra/commitlog/CommitLog-6-1476907676970.log, /var/lib/cassandra= /commitlog/CommitLog-6-1477269052845.log
ERROR [main]= 2016-10-24 07:08:03,357 JVMStabilityInspector.java:82 - Exiting due to err= or while processing commit log during initialization.
org.= apache.cassandra.db.commitlog.CommitLogReadHandler$CommitLogReadE= xception: Unexpected error deserializing mutation; saved to /tmp/mutation91= 86356142128811141dat.=C2=A0 This may be caused by replaying a mutation= against a table with the same name but incompatible schema.=C2=A0 Exceptio= n follows: org.apache.cassandra.serializers.MarshalException: Not enou= gh bytes to read 0th field board_id
at org.apache.cassandra.db.commitlog.CommitLogReader.readMut= ation(CommitLogReader.java:410) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.db.commit= log.CommitLogReader.readSection(CommitLogReader.java:343) [apache= -cassandra-3.9.jar:3.9]
at= org.apache.cassandra.db.commitlog.CommitLogReader.readCommitLogS= egment(CommitLogReader.java:202) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.db.commi= tlog.CommitLogReader.readAllFiles(CommitLogReader.java:85) [apach= e-cassandra-3.9.jar:3.9]
a= t org.apache.cassandra.db.commitlog.CommitLogReplayer.replayFiles= (CommitLogReplayer.java:135) [apache-cassandra-3.9.jar:3.9]
<= div> at org.apache.cassandra.db.commitlog.CommitLog.recoverFiles(CommitLog.java:187) [apache-cassandra-3.9= .jar:3.9]
at org.apache.ca= ssandra.db.commitlog.CommitLog.recoverSegmentsOnDisk(CommitLog.ja= va:167) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.setup(Cas= sandraDaemon.java:323) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.Cass= andraDaemon.activate(CassandraDaemon.java:601) [apache-cassandra-3.9.j= ar:3.9]
at org.apache.cass= andra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apa= che-cassandra-3.9.jar:3.9]


I then have to do 'sudo rm -rf /var/lib/cassandra/commitlog/*<= wbr>' which fixes the problem, but then I lose all of my data.

It looks like its saying there wasn't enough data to r= ead the field 'board_id', any ideas why that would be?





--001a11466da2d0fa82053f984fad--