Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 59956 invoked from network); 10 Nov 2010 17:40:45 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 10 Nov 2010 17:40:45 -0000 Received: (qmail 20368 invoked by uid 500); 10 Nov 2010 17:41:15 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 20345 invoked by uid 500); 10 Nov 2010 17:41:15 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 20336 invoked by uid 99); 10 Nov 2010 17:41:15 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Nov 2010 17:41:15 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jeremy.hanna1234@gmail.com designates 209.85.161.172 as permitted sender) Received: from [209.85.161.172] (HELO mail-gx0-f172.google.com) (209.85.161.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Nov 2010 17:41:05 +0000 Received: by gxk27 with SMTP id 27so584088gxk.31 for ; Wed, 10 Nov 2010 09:40:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:content-type:mime-version :subject:from:in-reply-to:date:content-transfer-encoding:message-id :references:to:x-mailer; bh=eXltQ49YVH40GAC8bO/JcPmhVhOQInx6EPdG9yEqbiA=; b=N27lfI75cBg8J6kVwmXdT+hO5KVYplIVYpXvDjQIWYNmpaDvU5igJwT4MniUKO8zvx uMfMdkcSHNs8rVSWxcvBt0hHBwAERktQDbSvs3DJXnCK76OD70cQ7MadPSuqSACmeFO2 i6opwrI4ST/35jNhi9g0yXRNANxeUMmaOnSF4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to:x-mailer; b=HITvreFIt2N/1YOZhxwYnmjtSvrd88Oy85g2yxiFXv3MoJFdOBWZCiMAkbLmqKDGzK Im6Z83zdbtZBTJ8Xy+tScqiPQpVz2NwXKCn9Z8Stb82dAj8sd2XOTHfNghWy1MxxxmVs BEkjKl8Ex6EXpQ91Gl53cCOoNe1CWyDz72bHY= Received: by 10.100.122.3 with SMTP id u3mr5186021anc.30.1289410844571; Wed, 10 Nov 2010 09:40:44 -0800 (PST) Received: from [10.1.184.152] (fw1-aus1.rackspace.net [64.39.0.68]) by mx.google.com with ESMTPS id w3sm1096100anw.25.2010.11.10.09.40.42 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 10 Nov 2010 09:40:43 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1081) Subject: Re: MapReduce/Hadoop in cassandra 0.7 beta3 From: Jeremy Hanna In-Reply-To: Date: Wed, 10 Nov 2010 11:40:42 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: <913E79D2-7D19-407D-A307-BA64AD687D0F@gmail.com> References: To: user@cassandra.apache.org X-Mailer: Apple Mail (2.1081) X-Virus-Checked: Checked by ClamAV on apache.org Aditya, Can you reproduce the problem locally with "pig -x local myscript.pig"? Also, moving this message back to the cassandra user list. On Nov 10, 2010, at 10:47 AM, Aditya Muralidharan wrote: > Hi, >=20 > I'm still getting the error associated with = https://issues.apache.org/jira/browse/CASSANDRA-1700 > I have 7 suse nodes running Cassandra0.7 branch (latest as of the = morning of Nov 9). I've loaded 10 rows with one column = family(replication factor=3D4) and 100 super columns. Using the = ColumnFamilyInputFormat with mapreduce (LocalJobRunner) to retrieve all = the rows gives me the following exception: >=20 > 10/11/10 10:33:15 WARN mapred.LocalJobRunner: job_local_0001 > java.lang.RuntimeException: org.apache.thrift.TApplicationException: = Internal error processing get_range_slices > at = org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit= (ColumnFamilyRecordReader.java:277) > at = org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNe= xt(ColumnFamilyRecordReader.java:292) > at = org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNe= xt(ColumnFamilyRecordReader.java:189) > at = com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterat= or.java:136) > at = com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:1= 31) > at = org.apache.cassandra.hadoop.ColumnFamilyRecordReader.nextKeyValue(ColumnFa= milyRecordReader.java:148) > at = org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapT= ask.java:423) > at = org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143) > at = org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305) > at = org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177) > Caused by: org.apache.thrift.TApplicationException: Internal error = processing get_range_slices > at = org.apache.thrift.TApplicationException.read(TApplicationException.java:10= 8) > at = org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassand= ra.java:724) > at = org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.ja= va:704) > at = org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit= (ColumnFamilyRecordReader.java:255) > ... 11 more >=20 > The server has the following exception: > ERROR [pool-1-thread-11] 2010-11-10 10:35:58,839 Cassandra.java (line = 2876) Internal error processing get_range_slices > java.lang.AssertionError: = (150596448267070854052355226693835429313,188864318807883527921085450293725= 60769] > at = org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.= java:1200) > at = org.apache.cassandra.service.StorageProxy.getRangeSlice(StorageProxy.java:= 429) > at = org.apache.cassandra.thrift.CassandraServer.get_range_slices(CassandraServ= er.java:513) > at = org.apache.cassandra.thrift.Cassandra$Processor$get_range_slices.process(C= assandra.java:2868) > at = org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:255= 5) > at = org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(Cust= omTThreadPoolServer.java:167) > at = java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.= java:886) > at = java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :908) > at java.lang.Thread.run(Thread.java:619) >=20 > Any help would be appreciated. >=20 > Thanks. >=20 > AD