Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of jeremy.hanna1234@gmail.com
 designates 209.85.216.172 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=content-type:mime-version:subject:from:in-reply-to:date
         :content-transfer-encoding:message-id:references:to:x-mailer;
        b=k22n13jtq4pdOTJMIkdViTmKR/FFUwPIHQMxy0Nb03PjKda+kh/DfIZTsz8ccw4fo3
         1bZJRud26dn4moEIm4nKMPTFRoEv0YvDTKXqIDrPl3TN6Vs6BHv2HGQ+EyeTgDn8goF4
         FuGFJLRVLKhyOcJSu1oC78zZ/bbCJ7QjqCmeY=
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1082)
Subject: Re: word_count example fails in multi-node configuration
From: Jeremy Hanna <jeremy.hanna1234@gmail.com>
In-Reply-To: <AANLkTinfFn0Vz-G8mm1ixcyL2DvT3CTBDD7xZk4Rk7vm@mail.gmail.com>
Date: Mon, 29 Nov 2010 11:31:28 -0600
Content-Transfer-Encoding: quoted-printable
Message-Id: <DE60CAD6-59B8-40B3-BC98-524314B1BB59@gmail.com>
References: <AANLkTinfFn0Vz-G8mm1ixcyL2DvT3CTBDD7xZk4Rk7vm@mail.gmail.com>
To: user@cassandra.apache.org

Roman:

I logged a jira ticket about this for further investigation, if you'd =
like to follow that.

https://issues.apache.org/jira/browse/CASSANDRA-1787

On Nov 29, 2010, at 3:14 AM, RS wrote:

> Hi guys,
>=20
> I am trying to run word_count example from contrib directory (0.7 beta
> 3 and 0.7.0 rc 1).
> It works fine in a single-node configuration, but fails with 2+ nodes.
>=20
> It fails in the assert statement, which caused problems before
> (https://issues.apache.org/jira/browse/CASSANDRA-1700).
>=20
> Here's a simple ring I have and error messages.
> ---
> Address         Status State   Load            Owns    Token
>=20
> 143797990709940316224804537595633718982
> 127.0.0.2       Up     Normal  40.2 KB         51.38%
> 61078635599166706937511052402724559481
> 127.0.0.1       Up     Normal  36.01 KB        48.62%
> 143797990709940316224804537595633718982
> ---
> [SERVER SIDE]
>=20
> ERROR 17:39:57,098 Fatal exception in thread =
Thread[ReadStage:4,5,main]
> java.lang.AssertionError:
> =
(143797990709940316224804537595633718982,610786355991667069375110524027245=
59481]
> 	at =
org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.=
java:1273)
> 	at =
org.apache.cassandra.service.RangeSliceVerbHandler.doVerb(RangeSliceVerbHa=
ndler.java:48)
> 	at =
org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:=
62)
> 	at =
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.=
java:886)
> 	at =
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java=
:908)
> 	at java.lang.Thread.run(Thread.java:619)
> ---
> [CLIENT_SIDE]
> java.lang.RuntimeException: org.apache.thrift.TApplicationException:
> Internal error processing get_range_slices
> 	at =
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit=
(ColumnFamilyRecordReader.java:277)
> 	at =
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNe=
xt(ColumnFamilyRecordReader.java:292)
> 	at =
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNe=
xt(ColumnFamilyRecordReader.java:189)
> 	at =
com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterat=
or.java:136)
> 	at =
com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:1=
31)
> 	at =
org.apache.cassandra.hadoop.ColumnFamilyRecordReader.nextKeyValue(ColumnFa=
milyRecordReader.java:148)
> 	at =
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapT=
ask.java:423)
> 	at =
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
> 	at =
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at =
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: org.apache.thrift.TApplicationException: Internal error
> processing get_range_slices
> 	at =
org.apache.thrift.TApplicationException.read(TApplicationException.java:10=
8)
> 	at =
org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassand=
ra.java:724)
> 	at =
org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.ja=
va:704)
> 	at =
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit=
(ColumnFamilyRecordReader.java:255)
> 	... 11 more
> ---
>=20
> Looks like tokens used in ColumnFamilySplits
> (ColumnFamilyInputFormat.java) are on wrapping ranges (left_token >
> right_token).
> Any ideas how to fix this?
>=20
> --
> Regards,
> Roman