incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saket Joshi" <sjo...@touchcommerce.com>
Subject Cassandra hadoop Thrift Time out
Date Fri, 24 Sep 2010 19:17:45 GMT
Hi Experts,

 

I need help on an exception integrating cassandra-hadoop. I am getting
the following exception, when running a Hadoop Map reduce job
http://pastebin.com/RktaqDnj

I am using cassandra 0.6.5 , 3 node cluster. I don't get any exception
when the data I am processing is very small  < 5 rows and 100 columns,
but get the error with modest data is > 5 rows 500 columns. I went
though some of the forums where people have experienced the same issue. 

http://www.listware.net/201005/cassandra-user/21897-timeout-while-runnin
g-simple-hadoop-job.html . Is this a bug with Cassandra-hadoop classes
and is that fixed in 0.7 for sure? how stable is 0.7 beta ? In the
system.log I see a lot of "  index has reached its threshold; switching
in a fresh Memtable" messages

 

Has Anyone faced a similar issue and solved it? Is migrating to 0.7  the
only solution? 

 

Thanks, 

Saket

 

Stack Trace of the Exception:

{ava.lang.RuntimeException: TimedOutException()

        at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeIn
it(ColumnFamilyRecordReader.java:186)

        at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.compute
Next(ColumnFamilyRecordReader.java:236)

        at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.compute
Next(ColumnFamilyRecordReader.java:104)

        at
com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIter
ator.java:135)

        at
com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java
:130)

        at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader.nextKeyValue(Column
FamilyRecordReader.java:98)

        at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(Ma
pTask.java:423)

        at
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)

        at
org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:583)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)

        at org.apache.hadoop.mapred.Child.main(Child.java:170)

Caused by: TimedOutException()

        at
org.apache.cassandra.thrift.Cassandra$get_range_slices_result.read(Cassa
ndra.java:11094)

        at
org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassa
ndra.java:628)

        at
org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.
java:602)

        at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeIn
it(ColumnFamilyRecordReader.java:164)}


Mime
View raw message