Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8CD969F3A for ; Sun, 25 Sep 2011 07:27:41 +0000 (UTC) Received: (qmail 58086 invoked by uid 500); 25 Sep 2011 07:27:39 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 58047 invoked by uid 500); 25 Sep 2011 07:27:39 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 58035 invoked by uid 99); 25 Sep 2011 07:27:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 25 Sep 2011 07:27:39 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of watcherfr@gmail.com designates 74.125.82.172 as permitted sender) Received: from [74.125.82.172] (HELO mail-wy0-f172.google.com) (74.125.82.172) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 25 Sep 2011 07:27:31 +0000 Received: by wyh21 with SMTP id 21so3151088wyh.31 for ; Sun, 25 Sep 2011 00:27:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; bh=SJuu7vMGscyzt9DTJGzKs1PU06aunMfUCotMB3hFGW4=; b=V/q8/oLgrF3QjvgIZOyt5BoKAMDiGqSaDNBjQG+FfCWDIbzVzA2Zecq3vAYgb3vRF7 2IVQVprIT6W+mH5LNCUjgz7/s1cLLGqpcnBirSqh7XAaji/KwZvA/HxWejdW5Qb2A2I1 R+LRDAD0MjnwYhQU3zV4A/FynnCYg5BnNXDqs= MIME-Version: 1.0 Received: by 10.227.55.5 with SMTP id s5mr5632442wbg.92.1316935630972; Sun, 25 Sep 2011 00:27:10 -0700 (PDT) Received: by 10.180.8.228 with HTTP; Sun, 25 Sep 2011 00:27:10 -0700 (PDT) Date: Sun, 25 Sep 2011 09:27:10 +0200 Message-ID: Subject: Token != DecoratedKey assertion From: Philippe To: user Content-Type: multipart/alternative; boundary=20cf3001b50979e8aa04adbef8bc X-Virus-Checked: Checked by ClamAV on apache.org --20cf3001b50979e8aa04adbef8bc Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello, I've seen a couple of these in my logs, running 0.8.4. This is a RF=3D3, 3-node cluster. 2 nodes including this one are on 0.8.4 a= nd one is on 0.8.5 The node is still functionning hours later. Should I be worried ? Thanks ERROR [ReadStage:94911] 2011-09-24 22:40:30,043 AbstractCassandraDaemon.jav= a (line 134) Fatal exception in thread Thread[ReadStage:94911,5,main] java.lang.AssertionError: DecoratedKey(Token(bytes[0000224ceb80b5fb11e00000848783ceb9bf00000000000000= 02ffffffffffffff33]), 0000224ceb80b5fb11e00000848783ceb9bf0000000000000002ffffffffffffff33) !=3D DecoratedKey(Token(bytes[038453154cb00000005f14]), 038453154cb00000005f14) in /var/lib/cassandra/data/XXXXXXXXX/PUBLIC_MONTHLY_20-g-10634-Data.db at org.apache.cassandra.db.columniterator.SSTableSliceIterator.(SSTableS= liceIterator.java:59) at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(Sl= iceQueryFilter.java:66) at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFi= lter.java:80) at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilySt= ore.java:1315) at org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:1= 182) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore= .java:1222) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore= .java:1169) at org.apache.cassandra.db.Table.getRow(Table.java:385) at org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadComm= and.java:58) at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(Sto= rageProxy.java:642) at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProx= y.java:1107) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.j= ava:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:= 908) at java.lang.Thread.run(Thread.java:662) ERROR [ReadStage:94936] 2011-09-24 22:40:30,042 AbstractCassandraDaemon.jav= a (line 134) Fatal exception in thread Thread[ReadStage:94936,5,main] java.lang.AssertionError: DecoratedKey(Token(bytes[]), ) !=3D DecoratedKey(Token(bytes[038453154c900000005f14]), 038453154c900000005f14) in /var/lib/cassandra/data/XXXXXXXXX/PUBLIC_MONTHLY_20-g-10634-Data.db at org.apache.cassandra.db.columniterator.SSTableSliceIterator.(SSTableS= liceIterator.java:59) at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(Sl= iceQueryFilter.java:66) at org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFi= lter.java:80) at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilySt= ore.java:1315) at org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:1= 182) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore= .java:1222) at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore= .java:1169) at org.apache.cassandra.db.Table.getRow(Table.java:385) at org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadComm= and.java:58) at org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(Sto= rageProxy.java:642) at org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProx= y.java:1107) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.j= ava:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:= 908) at java.lang.Thread.run(Thread.java:662) ERROR [ReadStage:94713] 2011-09-24 22:40:30,041 AbstractCassandraDaemon.jav= a (line 134) Fatal exception in thread Thread[ReadStage:94713,5,main] java.lang.AssertionError: DecoratedKey(Token(bytes[7c4831fe0000000000000001ffffffffffffffaa000c6c6976= 65626f782d62653065800000008000000000000000000000020007000311950100000480000= 00000000000000001327e62362a00000024000100009c0dc550c60111e0000001687c4831fe= 000000000000000100000000000000010007000311950100010480000000000000000000013= 27e62362a00000024000100009c0dc550c60111e0000001687c4831fe0000000000000001ff= ffffffffffffb0000c6c697665626f782d66313263800000008000000000000000000000020= 00700031195010000048000000000000000000001327e62362a00000024000100009c0dc550= c60111e0000001687c4831fe000000000000000100000000000000010007000311950100010= 48000000000000000000001327e62362a00000024000100009c0dc550c60111e0000001687c= 4831fe0000000000000001ffffffffffffffab000b062a27f9e3000000005f13000000]), 7c4831fe0000000000000001ffffffffffffffaa000c6c697665626f782d626530658000000= 0800000000000000000000002000700031195010000048000000000000000000001327e6236= 2a00000024000100009c0dc550c60111e0000001687c4831fe0000000000000001000000000= 0000001000700031195010001048000000000000000000001327e62362a0000002400010000= 9c0dc550c60111e0000001687c4831fe0000000000000001ffffffffffffffb0000c6c69766= 5626f782d663132638000000080000000000000000000000200070003119501000004800000= 0000000000000001327e62362a00000024000100009c0dc550c60111e0000001687c4831fe0= 000000000000001000000000000000100070003119501000104800000000000000000000132= 7e62362a00000024000100009c0dc550c60111e0000001687c4831fe0000000000000001fff= fffffffffffab000b062a27f9e3000000005f13000000) !=3D DecoratedKey(Token(bytes[038451bfeeb00000005f14]), 038451bfeeb00000005f14) in /var/lib/cassandra/data/XXXXXXXXX/PUBLIC_MONTHLY_20-g-12305-Data.db --20cf3001b50979e8aa04adbef8bc Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hello,
I've seen a couple of these in my logs, running 0.8.4.
Thi= s is a RF=3D3, 3-node cluster. 2 nodes including this one are on 0.8.4 and = one is on 0.8.5

The node is still functionning hours later. Should I= be worried ?

Thanks

ERROR [ReadStage:94911] 2011-09-24 22:40:30,043 AbstractC= assandraDaemon.java (line 134) Fatal exception in thread Thread[ReadStage:9= 4911,5,main]
java.lang.AssertionError: DecoratedKey(Token(bytes[0000224c= eb80b5fb11e00000848783ceb9bf0000000000000002ffffffffffffff33]), 0000224ceb8= 0b5fb11e00000848783ceb9bf0000000000000002ffffffffffffff33) !=3D DecoratedKe= y(Token(bytes[038453154cb00000005f14]), 038453154cb00000005f14) in /var/lib= /cassandra/data/XXXXXXXXX/PUBLIC_MONTHLY_20-g-10634-Data.db
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.columniterator.SSTableSlic= eIterator.<init>(SSTableSliceIterator.java:59)
=A0=A0=A0=A0=A0=A0= =A0 at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIter= ator(SliceQueryFilter.java:66)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.filter.QueryFilter.getSSTa= bleColumnIterator(QueryFilter.java:80)
=A0=A0=A0=A0=A0=A0=A0 at org.apac= he.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java= :1315)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamilyStor= e.cacheRow(ColumnFamilyStore.java:1182)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamilyStore.getColum= nFamily(ColumnFamilyStore.java:1222)
=A0=A0=A0=A0=A0=A0=A0 at org.apache= .cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1169= )
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.Table.getRow(Table.ja= va:385)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.SliceByNamesReadCommand.ge= tRow(SliceByNamesReadCommand.java:58)
=A0=A0=A0=A0=A0=A0=A0 at org.apach= e.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy= .java:642)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.service.Storage= Proxy$DroppableRunnable.run(StorageProxy.java:1107)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run= Task(ThreadPoolExecutor.java:886)
=A0=A0=A0=A0=A0=A0=A0 at java.util.con= current.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
=A0= =A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:662)
ERROR [ReadStage:94936] 2011-09-24 22:40:30,042 AbstractCassandraDaemon.jav= a (line 134) Fatal exception in thread Thread[ReadStage:94936,5,main]
ja= va.lang.AssertionError: DecoratedKey(Token(bytes[]), ) !=3D DecoratedKey(To= ken(bytes[038453154c900000005f14]), 038453154c900000005f14) in /var/lib/cas= sandra/data/XXXXXXXXX/PUBLIC_MONTHLY_20-g-10634-Data.db
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.columniterator.SSTableSlic= eIterator.<init>(SSTableSliceIterator.java:59)
=A0=A0=A0=A0=A0=A0= =A0 at org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIter= ator(SliceQueryFilter.java:66)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.filter.QueryFilter.getSSTa= bleColumnIterator(QueryFilter.java:80)
=A0=A0=A0=A0=A0=A0=A0 at org.apac= he.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java= :1315)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamilyStor= e.cacheRow(ColumnFamilyStore.java:1182)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.ColumnFamilyStore.getColum= nFamily(ColumnFamilyStore.java:1222)
=A0=A0=A0=A0=A0=A0=A0 at org.apache= .cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1169= )
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.Table.getRow(Table.ja= va:385)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.SliceByNamesReadCommand.ge= tRow(SliceByNamesReadCommand.java:58)
=A0=A0=A0=A0=A0=A0=A0 at org.apach= e.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy= .java:642)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.service.Storage= Proxy$DroppableRunnable.run(StorageProxy.java:1107)
=A0=A0=A0=A0=A0=A0=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run= Task(ThreadPoolExecutor.java:886)
=A0=A0=A0=A0=A0=A0=A0 at java.util.con= current.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
=A0= =A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:662)
ERROR [ReadStage:94713] 2011-09-24 22:40:30,041 AbstractCassandraDaemon.jav= a (line 134) Fatal exception in thread Thread[ReadStage:94713,5,main]
ja= va.lang.AssertionError: DecoratedKey(Token(bytes[7c4831fe0000000000000001ff= ffffffffffffaa000c6c697665626f782d62653065800000008000000000000000000000020= 00700031195010000048000000000000000000001327e62362a00000024000100009c0dc550= c60111e0000001687c4831fe000000000000000100000000000000010007000311950100010= 48000000000000000000001327e62362a00000024000100009c0dc550c60111e0000001687c= 4831fe0000000000000001ffffffffffffffb0000c6c697665626f782d66313263800000008= 00000000000000000000002000700031195010000048000000000000000000001327e62362a= 00000024000100009c0dc550c60111e0000001687c4831fe000000000000000100000000000= 00001000700031195010001048000000000000000000001327e62362a00000024000100009c= 0dc550c60111e0000001687c4831fe0000000000000001ffffffffffffffab000b062a27f9e= 3000000005f13000000]), 7c4831fe0000000000000001ffffffffffffffaa000c6c697665= 626f782d6265306580000000800000000000000000000002000700031195010000048000000= 000000000000001327e62362a00000024000100009c0dc550c60111e0000001687c4831fe00= 000000000000010000000000000001000700031195010001048000000000000000000001327= e62362a00000024000100009c0dc550c60111e0000001687c4831fe0000000000000001ffff= ffffffffffb0000c6c697665626f782d6631326380000000800000000000000000000002000= 700031195010000048000000000000000000001327e62362a00000024000100009c0dc550c6= 0111e0000001687c4831fe00000000000000010000000000000001000700031195010001048= 000000000000000000001327e62362a00000024000100009c0dc550c60111e0000001687c48= 31fe0000000000000001ffffffffffffffab000b062a27f9e3000000005f13000000) !=3D = DecoratedKey(Token(bytes[038451bfeeb00000005f14]), 038451bfeeb00000005f14) = in /var/lib/cassandra/data/XXXXXXXXX/PUBLIC_MONTHLY_20-g-12305-Data.db



--20cf3001b50979e8aa04adbef8bc--