Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5224995B1 for ; Mon, 18 Jun 2012 01:13:42 +0000 (UTC) Received: (qmail 14519 invoked by uid 500); 18 Jun 2012 01:13:40 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 14497 invoked by uid 500); 18 Jun 2012 01:13:40 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 14489 invoked by uid 99); 18 Jun 2012 01:13:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Jun 2012 01:13:39 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a57.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Jun 2012 01:13:31 +0000 Received: from homiemail-a57.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a57.g.dreamhost.com (Postfix) with ESMTP id EEBBE208060 for ; Sun, 17 Jun 2012 18:13:09 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; q=dns; s=thelastpickle.com; b=Mq64rbSsFd Y+6T82/cyhOXF/5P5TTeyRNWAl4Ovmc2tYxMbHelAHrUQhGjcre85ty4Owqm+jK0 bVux9z1j0nSHxck6pxdVwyNv1Uetcpa21XIviLapojP7jO4TOFwNe7nYLeRtBps8 ukyr5Ru96DAYer5KEBPHakHvnivaHc/mY= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; s=thelastpickle.com; bh=RvqwEaHxI5ooGUQf yPg8xuFn1Ss=; b=bWEznZdqHmyLVWj9ByLoWMowxP3gArK50YzhccNsHRQRlxcn Ptds4xBbVgRz56N0GPTeiAzAgbypBw/Y+k3cvFSOLLwo+Tq3+IrgNk7paLWymQh9 mmQXT1551CF9sOs3Su8um0QmxbPKRO30jvVofAQu1q8E8wzCAzTQAdA+k7U= Received: from [172.20.10.3] (unknown [118.149.36.200]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a57.g.dreamhost.com (Postfix) with ESMTPSA id 9D75D208058 for ; Sun, 17 Jun 2012 18:13:08 -0700 (PDT) From: aaron morton Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: multipart/alternative; boundary="Apple-Mail=_F88DD3D3-0AE4-41FC-83FD-CD1A416B03D4" Subject: Re: MurmurHash NPE during compaction Date: Mon, 18 Jun 2012 13:13:04 +1200 In-Reply-To: To: user@cassandra.apache.org References: Message-Id: X-Mailer: Apple Mail (2.1278) --Apple-Mail=_F88DD3D3-0AE4-41FC-83FD-CD1A416B03D4 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=iso-8859-1 Can you please create a ticket on = https://issues.apache.org/jira/browse/CASSANDRA Please include: * CF definition including the bloom_filter_fp_chance * If the data was upgraded from a previous version of cassandra.=20 * The names of the files that were being compacted.=20 As a work around you can try using nodetool upgradetables to re-write = the files - this may also fail, but its could be worth trying.=20 The next step would be to remove determine which files were causing the = issue (looking at the logs) and remove them from the data directory. = Then run repair to restore consistency.=20 Cheers ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/06/2012, at 11:38 PM, Ravikumar Govindarajan wrote: > We received the following NPE during compaction of a large row. We are = on cassandra-1.0.7. Need some help here to find the root cause of the = issue >=20 > ERROR [CompactionExecutor:595] 2012-06-13 09:44:46,718 = AbstractCassandraDaemon.java (line 139) Fatal exception in thread = Thread[CompactionExecutor:595,1,main] > java.lang.NullPointerException > at = org.apache.cassandra.utils.MurmurHash.hash64(MurmurHash.java:102) > at = org.apache.cassandra.utils.BloomFilter.getHashBuckets(BloomFilter.java:103= ) > at = org.apache.cassandra.utils.BloomFilter.getHashBuckets(BloomFilter.java:92)= > at = org.apache.cassandra.utils.BloomFilter.add(BloomFilter.java:114) > at = org.apache.cassandra.db.ColumnIndexer.serialize(ColumnIndexer.java:96) > at = org.apache.cassandra.db.ColumnIndexer.serialize(ColumnIndexer.java:51) > at = org.apache.cassandra.db.compaction.PrecompactedRow.write(PrecompactedRow.j= ava:135) > at = org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:16= 0) > at = org.apache.cassandra.db.compaction.CompactionTask.execute(CompactionTask.j= ava:159) > at = org.apache.cassandra.db.compaction.CompactionManager$1.call(CompactionMana= ger.java:134) > at = org.apache.cassandra.db.compaction.CompactionManager$1.call(CompactionMana= ger.java:114) > at = java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at = java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.= java:885) > at = java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :907) > at java.lang.Thread.run(Thread.java:619) >=20 > Thanks and Regards, > Ravi --Apple-Mail=_F88DD3D3-0AE4-41FC-83FD-CD1A416B03D4 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=iso-8859-1 https://issues.ap= ache.org/jira/browse/CASSANDRA

Please = include:
* CF definition including the = bloom_filter_fp_chance
* If the data was upgraded from a = previous version of cassandra. 
* The names of the files = that were being compacted. 

As a work = around you can try using nodetool upgradetables to re-write the = files - this may also fail, but its could be worth = trying. 

The next step would be to remove = determine which files were causing the issue (looking at the logs) and = remove them from the data directory. Then run repair to restore = consistency. 

Cheers

http://www.thelastpickle.com

On 14/06/2012, at 11:38 PM, Ravikumar Govindarajan = wrote:

We received the following NPE during compaction of a large = row. We are on cassandra-1.0.7. Need some help here to find the root = cause of the issue

&= nbsp;ERROR [CompactionExecutor:595] 2012-06-13 09:44:46,718 = AbstractCassandraDaemon.java (line 139) Fatal exception in thread = Thread[CompactionExecutor:595,1,main]
java.lang.NullPointerException
      =   at = org.apache.cassandra.utils.MurmurHash.hash64(MurmurHash.java:102)
        at = org.apache.cassandra.utils.BloomFilter.getHashBuckets(BloomFilter.java:103= )
        at = org.apache.cassandra.utils.BloomFilter.getHashBuckets(BloomFilter.java:92)=
        at = org.apache.cassandra.utils.BloomFilter.add(BloomFilter.java:114)
        at = org.apache.cassandra.db.ColumnIndexer.serialize(ColumnIndexer.java:96)
        at = org.apache.cassandra.db.ColumnIndexer.serialize(ColumnIndexer.java:51)
        at = org.apache.cassandra.db.compaction.PrecompactedRow.write(PrecompactedRow.j= ava:135)
        at = org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:16= 0)
        at = org.apache.cassandra.db.compaction.CompactionTask.execute(CompactionTask.j= ava:159)
        at = org.apache.cassandra.db.compaction.CompactionManager$1.call(CompactionMana= ger.java:134)
        at = org.apache.cassandra.db.compaction.CompactionManager$1.call(CompactionMana= ger.java:114)
        at = java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at = java.util.concurrent.FutureTask.run(FutureTask.java:138)
  =       at = java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.= java:885)
        at = java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :907)
        at = java.lang.Thread.run(Thread.java:619)

Thanks = and Regards,
Ravi

= --Apple-Mail=_F88DD3D3-0AE4-41FC-83FD-CD1A416B03D4--