Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 79902 invoked from network); 10 Nov 2010 18:07:34 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 10 Nov 2010 18:07:34 -0000 Received: (qmail 75288 invoked by uid 500); 10 Nov 2010 18:08:01 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 75269 invoked by uid 500); 10 Nov 2010 18:08:01 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 75261 invoked by uid 99); 10 Nov 2010 18:08:01 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Nov 2010 18:08:01 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=10.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of stuhood@mailtrust.com designates 207.97.245.181 as permitted sender) Received: from [207.97.245.181] (HELO smtp181.iad.emailsrvr.com) (207.97.245.181) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Nov 2010 18:07:54 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by smtp48.relay.iad1a.emailsrvr.com (SMTP Server) with ESMTP id 0FB37168383; Wed, 10 Nov 2010 13:07:34 -0500 (EST) X-Virus-Scanned: OK Received: from dynamic1.wm-web.iad.mlsrvr.com (dynamic1.wm-web.iad1a.rsapps.net [192.168.2.150]) by smtp48.relay.iad1a.emailsrvr.com (SMTP Server) with ESMTP id EE9401682F0; Wed, 10 Nov 2010 13:07:33 -0500 (EST) Received: from mailtrust.com (localhost [127.0.0.1]) by dynamic1.wm-web.iad.mlsrvr.com (Postfix) with ESMTP id D57EAC98070; Wed, 10 Nov 2010 13:07:33 -0500 (EST) Received: by apps.rackspace.com (Authenticated sender: stuhood@mailtrust.com, from: stu.hood@rackspace.com) with HTTP; Wed, 10 Nov 2010 12:07:33 -0600 (CST) Date: Wed, 10 Nov 2010 12:07:33 -0600 (CST) Subject: Re: MapReduce/Hadoop in cassandra 0.7 beta3 From: "Stu Hood" To: user@cassandra.apache.org Cc: Aditya.Muralidharan@nisc.coop MIME-Version: 1.0 Content-Type: text/plain;charset=UTF-8 Content-Transfer-Encoding: quoted-printable Importance: Normal X-Priority: 3 (Normal) X-Type: plain In-Reply-To: <913E79D2-7D19-407D-A307-BA64AD687D0F@gmail.com> References: <913E79D2-7D19-407D-A307-BA64AD687D0F@gmail.com> Message-ID: <1289412453.872528233@192.168.2.228> X-Mailer: webmail8 Hey Aditya,=0A=0AWould you mind attaching that last hundred few lines from = before the exception from the server log to this ticket: https://issues.apa= che.org/jira/browse/CASSANDRA-1724 ?=0A=0AThanks,=0AStu=0A=0A-----Original = Message-----=0AFrom: "Jeremy Hanna" =0ASent: We= dnesday, November 10, 2010 11:40am=0ATo: user@cassandra.apache.org=0ASubjec= t: Re: MapReduce/Hadoop in cassandra 0.7 beta3=0A=0AAditya,=0A=0ACan you re= produce the problem locally with "pig -x local myscript.pig"?=0A=0AAlso, mo= ving this message back to the cassandra user list.=0A=0AOn Nov 10, 2010, at= 10:47 AM, Aditya Muralidharan wrote:=0A=0A> Hi,=0A> =0A> I'm still getting= the error associated with https://issues.apache.org/jira/browse/CASSANDRA-= 1700=0A> I have 7 suse nodes running Cassandra0.7 branch (latest as of the = morning of Nov 9). I've loaded 10 rows with one column family(replication f= actor=3D4) and 100 super columns. Using the ColumnFamilyInputFormat with ma= preduce (LocalJobRunner) to retrieve all the rows gives me the following ex= ception:=0A> =0A> 10/11/10 10:33:15 WARN mapred.LocalJobRunner: job_local_0= 001=0A> java.lang.RuntimeException: org.apache.thrift.TApplicationException= : Internal error processing get_range_slices=0A> at org.apache.cassa= ndra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit(ColumnFamilyReco= rdReader.java:277)=0A> at org.apache.cassandra.hadoop.ColumnFamilyRe= cordReader$RowIterator.computeNext(ColumnFamilyRecordReader.java:292)=0A> = at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.c= omputeNext(ColumnFamilyRecordReader.java:189)=0A> at com.google.comm= on.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136)=0A>= at com.google.common.collect.AbstractIterator.hasNext(AbstractItera= tor.java:131)=0A> at org.apache.cassandra.hadoop.ColumnFamilyRecordR= eader.nextKeyValue(ColumnFamilyRecordReader.java:148)=0A> at org.apa= che.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java= :423)=0A> at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(Map= Context.java:67)=0A> at org.apache.hadoop.mapreduce.Mapper.run(Mappe= r.java:143)=0A> at org.apache.hadoop.mapred.MapTask.runNewMapper(Map= Task.java:621)=0A> at org.apache.hadoop.mapred.MapTask.run(MapTask.j= ava:305)=0A> at org.apache.hadoop.mapred.LocalJobRunner$Job.run(Loca= lJobRunner.java:177)=0A> Caused by: org.apache.thrift.TApplicationException= : Internal error processing get_range_slices=0A> at org.apache.thrif= t.TApplicationException.read(TApplicationException.java:108)=0A> at = org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassandr= a.java:724)=0A> at org.apache.cassandra.thrift.Cassandra$Client.get_= range_slices(Cassandra.java:704)=0A> at org.apache.cassandra.hadoop.= ColumnFamilyRecordReader$RowIterator.maybeInit(ColumnFamilyRecordReader.jav= a:255)=0A> ... 11 more=0A> =0A> The server has the following excepti= on:=0A> ERROR [pool-1-thread-11] 2010-11-10 10:35:58,839 Cassandra.java (li= ne 2876) Internal error processing get_range_slices=0A> java.lang.Assertion= Error: (150596448267070854052355226693835429313,188864318807883527921085450= 29372560769]=0A> at org.apache.cassandra.db.ColumnFamilyStore.getRan= geSlice(ColumnFamilyStore.java:1200)=0A> at org.apache.cassandra.ser= vice.StorageProxy.getRangeSlice(StorageProxy.java:429)=0A> at org.ap= ache.cassandra.thrift.CassandraServer.get_range_slices(CassandraServer.java= :513)=0A> at org.apache.cassandra.thrift.Cassandra$Processor$get_ran= ge_slices.process(Cassandra.java:2868)=0A> at org.apache.cassandra.t= hrift.Cassandra$Processor.process(Cassandra.java:2555)=0A> at org.ap= ache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThre= adPoolServer.java:167)=0A> at java.util.concurrent.ThreadPoolExecuto= r$Worker.runTask(ThreadPoolExecutor.java:886)=0A> at java.util.concu= rrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)=0A> = at java.lang.Thread.run(Thread.java:619)=0A> =0A> Any help would be apprec= iated.=0A> =0A> Thanks.=0A> =0A> AD=0A=0A