Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 67406 invoked from network); 30 Nov 2010 01:14:37 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 30 Nov 2010 01:14:37 -0000 Received: (qmail 59131 invoked by uid 500); 30 Nov 2010 01:14:35 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59113 invoked by uid 500); 30 Nov 2010 01:14:35 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59105 invoked by uid 99); 30 Nov 2010 01:14:34 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Nov 2010 01:14:34 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of apparc@gmail.com designates 209.85.216.172 as permitted sender) Received: from [209.85.216.172] (HELO mail-qy0-f172.google.com) (209.85.216.172) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Nov 2010 01:14:26 +0000 Received: by qyk34 with SMTP id 34so578774qyk.10 for ; Mon, 29 Nov 2010 17:14:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=j7oILih9ak/npDAGfTJ03dzBj+vDCo9OWlyMJOu5laA=; b=e0mDqeNmPWrcQh/8X3G/+HRcW1gp1UwPmkqNXLwfOPzNQAaqs7tCuvdV34F5hQ1GqT cWQmr1F5xHtUB2jOn7XTDuFsbPzGAYeNBWAMMOaNuKE/Qj5Our8n01qQpNpHYgrSdTwl qi3F8Q7+1IVfaOGZU99dbZzit4pmNoAUxHlTk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=UwyXnBX6QJFBIMIBIAXw1E0Ka6OwazBeEAWUXJGHAsRKGu6cdY1SmrBNQlDHJcIj3i WU+sq4CMYDWTl3PgJJky2tGZq9kUrIJeEi2KuBgnbr0eZinxhg2prpLnUbSu474Hp7rL S4wczQ98JMt4JsOSRN0L2c/xqbtlMP0Dx4oX0= MIME-Version: 1.0 Received: by 10.224.28.77 with SMTP id l13mr5831452qac.301.1291079644390; Mon, 29 Nov 2010 17:14:04 -0800 (PST) Received: by 10.220.44.209 with HTTP; Mon, 29 Nov 2010 17:14:04 -0800 (PST) In-Reply-To: <89AFE5E1-A0C3-4046-ADC5-9E0342A30870@gmail.com> References: <89AFE5E1-A0C3-4046-ADC5-9E0342A30870@gmail.com> Date: Tue, 30 Nov 2010 10:14:04 +0900 Message-ID: Subject: Re: word_count example fails in multi-node configuration From: RS To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org It occurs in 0.7 beta 3 and 0.7.0 rc 1. Thank you, Jeremy. I will follow the ticket. -Roman On Tue, Nov 30, 2010 at 2:50 AM, Jeremy Hanna wrote: > Roman: > > I commented on the ticket - would you mind answering on there? =A0https:/= /issues.apache.org/jira/browse/CASSANDRA-1787 > > Tx, > > Jeremy > > On Nov 29, 2010, at 3:14 AM, RS wrote: > >> Hi guys, >> >> I am trying to run word_count example from contrib directory (0.7 beta >> 3 and 0.7.0 rc 1). >> It works fine in a single-node configuration, but fails with 2+ nodes. >> >> It fails in the assert statement, which caused problems before >> (https://issues.apache.org/jira/browse/CASSANDRA-1700). >> >> Here's a simple ring I have and error messages. >> --- >> Address =A0 =A0 =A0 =A0 Status State =A0 Load =A0 =A0 =A0 =A0 =A0 =A0Own= s =A0 =A0Token >> >> 143797990709940316224804537595633718982 >> 127.0.0.2 =A0 =A0 =A0 Up =A0 =A0 Normal =A040.2 KB =A0 =A0 =A0 =A0 51.38= % >> 61078635599166706937511052402724559481 >> 127.0.0.1 =A0 =A0 =A0 Up =A0 =A0 Normal =A036.01 KB =A0 =A0 =A0 =A048.62= % >> 143797990709940316224804537595633718982 >> --- >> [SERVER SIDE] >> >> ERROR 17:39:57,098 Fatal exception in thread Thread[ReadStage:4,5,main] >> java.lang.AssertionError: >> (143797990709940316224804537595633718982,6107863559916670693751105240272= 4559481] >> =A0 =A0 =A0 at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(C= olumnFamilyStore.java:1273) >> =A0 =A0 =A0 at org.apache.cassandra.service.RangeSliceVerbHandler.doVerb= (RangeSliceVerbHandler.java:48) >> =A0 =A0 =A0 at org.apache.cassandra.net.MessageDeliveryTask.run(MessageD= eliveryTask.java:62) >> =A0 =A0 =A0 at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Th= readPoolExecutor.java:886) >> =A0 =A0 =A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread= PoolExecutor.java:908) >> =A0 =A0 =A0 at java.lang.Thread.run(Thread.java:619) >> --- >> [CLIENT_SIDE] >> java.lang.RuntimeException: org.apache.thrift.TApplicationException: >> Internal error processing get_range_slices >> =A0 =A0 =A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowI= terator.maybeInit(ColumnFamilyRecordReader.java:277) >> =A0 =A0 =A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowI= terator.computeNext(ColumnFamilyRecordReader.java:292) >> =A0 =A0 =A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowI= terator.computeNext(ColumnFamilyRecordReader.java:189) >> =A0 =A0 =A0 at com.google.common.collect.AbstractIterator.tryToComputeNe= xt(AbstractIterator.java:136) >> =A0 =A0 =A0 at com.google.common.collect.AbstractIterator.hasNext(Abstra= ctIterator.java:131) >> =A0 =A0 =A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.next= KeyValue(ColumnFamilyRecordReader.java:148) >> =A0 =A0 =A0 at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.= nextKeyValue(MapTask.java:423) >> =A0 =A0 =A0 at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapCo= ntext.java:67) >> =A0 =A0 =A0 at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143) >> =A0 =A0 =A0 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.jav= a:621) >> =A0 =A0 =A0 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305) >> =A0 =A0 =A0 at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobR= unner.java:177) >> Caused by: org.apache.thrift.TApplicationException: Internal error >> processing get_range_slices >> =A0 =A0 =A0 at org.apache.thrift.TApplicationException.read(TApplication= Exception.java:108) >> =A0 =A0 =A0 at org.apache.cassandra.thrift.Cassandra$Client.recv_get_ran= ge_slices(Cassandra.java:724) >> =A0 =A0 =A0 at org.apache.cassandra.thrift.Cassandra$Client.get_range_sl= ices(Cassandra.java:704) >> =A0 =A0 =A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowI= terator.maybeInit(ColumnFamilyRecordReader.java:255) >> =A0 =A0 =A0 ... 11 more >> --- >> >> Looks like tokens used in ColumnFamilySplits >> (ColumnFamilyInputFormat.java) are on wrapping ranges (left_token > >> right_token). >> Any ideas how to fix this? >> >> -- >> Regards, >> Roman > >