Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of gdusbabek@gmail.com
 designates 74.125.83.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:reply-to:in-reply-to:references:date:message-id
         :subject:from:to:content-type:content-transfer-encoding;
        b=rdNDVR2f3E1BAtovoxXYMqIkKzqbJIeEhwQuy4KRvWA+eBR9OVfYNV9e85wDz57AMT
         LacG548aa4UEwnLoLw/Q5JWzmHt28H46ha9SabiZaecewmkaGySm7qblVxXNAcdHg7sT
         KZOovKP7t39hi2gpbmo+2cghD6tQtYkaoyZt8=
MIME-Version: 1.0
Reply-To: gdusbabek@gmail.com
In-Reply-To: <g2me4b4609b1004150603x1b32a757j653afd7210a9df8d@mail.gmail.com>
References: <p2je4b4609b1004150206na0f3a503me057a62c96fdf88c@mail.gmail.com>
	 <s2r1c6fcff1004150400l8a60e7a8ib55d180aa0212cca@mail.gmail.com>
	 <g2me4b4609b1004150603x1b32a757j653afd7210a9df8d@mail.gmail.com>
Date: Thu, 15 Apr 2010 08:20:05 -0500
Message-ID: <k2q1c6fcff1004150620p91e34224s80d6e8c307c5709c@mail.gmail.com>
Subject: Re: AssertionError: DecoratedKey(...) != DecoratedKey(...)
From: Gary Dusbabek <gdusbabek@gmail.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

No data corruption.  There was a bug in the way that the index was
scanned that was manifesting itself when when the index got bigger
than 2GB.

Gary.


On Thu, Apr 15, 2010 at 08:03, Ran Tavory <rantav@gmail.com> wrote:
> yes, this looks like the same issue, thanks Gary.
> Other than seeing the errors in the log I haven't seen any other
> irregularities. (maybe there are, but they haven't surfaced). Does this
> assertion mean data corruption or something else that's worth waiting to
> 0.6.1 for?
>
> On Thu, Apr 15, 2010 at 2:00 PM, Gary Dusbabek <gdusbabek@gmail.com> wrot=
e:
>>
>> Ran,
>>
>> It looks like you're seeing
>> https://issues.apache.org/jira/browse/CASSANDRA-866. =A0It's fixed in
>> 0.6.1.
>>
>> Gary
>>
>> On Thu, Apr 15, 2010 at 04:06, Ran Tavory <rantav@gmail.com> wrote:
>> > When restarting one of the nodes in my cluster I found this error in t=
he
>> > log. What does this mean?
>> >
>> > =A0INFO [GC inspection] 2010-04-15 05:03:04,898 GCInspector.java (line
>> > 110) GC
>> > for ConcurrentMarkSweep: 712 ms, 11149016 reclaimed leaving 442336680
>> > used;
>> > max is 4432068608
>> > ERROR [HINTED-HANDOFF-POOL:1] 2010-04-15 05:03:17,948
>> > DebuggableThreadPoolExecutor.java (line 94) Error in executor futureta=
sk
>> > java.util.concurrent.ExecutionException: java.lang.AssertionError:
>> > DecoratedKey(163143070370570938845670096830182058073,
>> > 1K2i35+B8RuuRDP7Gwz3Xw=3D=3D) !=3D
>> > DecoratedKey(163143368384879375649994309361429628039,
>> > 4k54mGvj7JoT5rBH68K+9A=3D=3D) in
>> > /outbrain/cassandra/data/outbrain/DocumentMapping-305-Data.db
>> > =A0=A0 =A0 =A0 =A0at
>> > java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
>> > =A0=A0 =A0 =A0 =A0at java.util.concurrent.FutureTask.get(FutureTask.ja=
va:83)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor.afterExec=
ute(DebuggableThreadPoolExecutor.java:86)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecu=
tor.java:888)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.=
java:908)
>> > =A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:619)
>> > Caused by: java.lang.AssertionError:
>> > DecoratedKey(163143070370570938845670096830182058073,
>> > 1K2i35+B8RuuRDP7Gwz3Xw=3D=3D) !=3D
>> > DecoratedKey(163143368384879375649994309361429628039,
>> > 4k54mGvj7JoT5rBH68K+9A=3D=3D) in
>> > /outbrain/cassandra/data/outbrain/DocumentMapping-305-Data.db
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.filter.SSTableSliceIterator$ColumnGroupReader.=
<init>(SSTableSliceIterator.java:127)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.filter.SSTableSliceIterator.<init>(SSTableSlic=
eIterator.java:59)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterat=
or(SliceQueryFilter.java:63)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFam=
ilyStore.java:830)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamily=
Store.java:750)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamily=
Store.java:719)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.HintedHandOffManager.sendMessage(HintedHandOff=
Manager.java:122)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpoint(Hi=
ntedHandOffManager.java:250)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.HintedHandOffManager.access$100(HintedHandOffM=
anager.java:80)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > org.apache.cassandra.db.HintedHandOffManager$2.runMayThrow(HintedHandO=
ffManager.java:280)
>> > =A0=A0 =A0 =A0 =A0at
>> > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30=
)
>> > =A0=A0 =A0 =A0 =A0at
>> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441=
)
>> > =A0=A0 =A0 =A0 =A0at
>> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>> > =A0=A0 =A0 =A0 =A0at java.util.concurrent.FutureTask.run(FutureTask.ja=
va:138)
>> > =A0=A0 =A0 =A0 =A0at
>> >
>> > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecu=
tor.java:886)
>> > =A0=A0 =A0 =A0 =A0... 2 more
>> >
>
>