Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: neutral (nike.apache.org: local policy)
MIME-Version: 1.0
From: =?UTF-8?Q?Utku_Can_Top=C3=A7u?= <utku@topcu.gen.tr>
Date: Thu, 29 Apr 2010 16:25:14 +0200
Message-ID: <w2g709d5bba1004290725ia712a48g3de117799539dbfb@mail.gmail.com>
Subject: TimedOutException when using the ColumnFamilyInputFormat
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=0016e6dab05660c497048560e650

--0016e6dab05660c497048560e650
Content-Type: text/plain; charset=UTF-8

Hey All,

I'm trying to run some tests on cassandra an Hadoop integration. I'm
basically following the word count example at
https://svn.apache.org/repos/asf/cassandra/trunk/contrib/word_count/src/WordCount.javausing
the ColumnFamilyInputFormat.

Currently I have one-node cassandra and hadoop setup on the same machine.

I'm having problems if there are more than one map tasks running on the same
node, please find the copy of the error message below.

If I limit the map tasks per tasktracker to 1, the MapReduce works fine
without anyproblems at all.

Do you thinki it's a know issue or am I doing something wrong in
implementation.

---------------error----------------
10/04/29 13:47:37 INFO mapred.JobClient: Task Id :
attempt_201004291109_0024_m_000000_1, Status : FAILED
java.lang.RuntimeException: TimedOutException()
    at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit(ColumnFamilyRecordReader.java:165)
    at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNext(ColumnFamilyRecordReader.java:215)
    at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.computeNext(ColumnFamilyRecordReader.java:97)
    at
com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:135)
    at
com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:130)
    at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader.nextKeyValue(ColumnFamilyRecordReader.java:91)
    at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:423)
    at
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
    at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: TimedOutException()
    at
org.apache.cassandra.thrift.Cassandra$get_range_slices_result.read(Cassandra.java:11015)
    at
org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassandra.java:623)
    at
org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.java:597)
    at
org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeInit(ColumnFamilyRecordReader.java:142)
    ... 11 more
---------------------------------------


Best Regards,
Utku

--0016e6dab05660c497048560e650
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hey All,<br><br>I&#39;m trying to run some tests on cassandra an Hadoop int=
egration. I&#39;m basically following the word count example at <a href=3D"=
https://svn.apache.org/repos/asf/cassandra/trunk/contrib/word_count/src/Wor=
dCount.java">https://svn.apache.org/repos/asf/cassandra/trunk/contrib/word_=
count/src/WordCount.java</a> using the ColumnFamilyInputFormat.<br>

<br>Currently I have one-node cassandra and hadoop setup on the same machin=
e.<br><br>I&#39;m having problems if there are more than one map tasks runn=
ing on the same node, please find the copy of the error message below.<br>

<br>If I limit the map tasks per tasktracker to 1, the MapReduce works fine=
 without anyproblems at all.<br><br>Do you thinki it&#39;s a know issue or =
am I doing something wrong in implementation.<br><br>---------------error--=
--------------<br>

10/04/29 13:47:37 INFO mapred.JobClient: Task Id : attempt_201004291109_002=
4_m_000000_1, Status : FAILED<br>java.lang.RuntimeException: TimedOutExcept=
ion()<br>=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.hadoop.ColumnFamilyReco=
rdReader$RowIterator.maybeInit(ColumnFamilyRecordReader.java:165)<br>

=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$=
RowIterator.computeNext(ColumnFamilyRecordReader.java:215)<br>=C2=A0=C2=A0=
=C2=A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.=
computeNext(ColumnFamilyRecordReader.java:97)<br>

=C2=A0=C2=A0=C2=A0 at com.google.common.collect.AbstractIterator.tryToCompu=
teNext(AbstractIterator.java:135)<br>=C2=A0=C2=A0=C2=A0 at com.google.commo=
n.collect.AbstractIterator.hasNext(AbstractIterator.java:130)<br>=C2=A0=C2=
=A0=C2=A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.nextKeyVa=
lue(ColumnFamilyRecordReader.java:91)<br>

=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.MapTask$NewTrackingRecordRea=
der.nextKeyValue(MapTask.java:423)<br>=C2=A0=C2=A0=C2=A0 at org.apache.hado=
op.mapreduce.MapContext.nextKeyValue(MapContext.java:67)<br>=C2=A0=C2=A0=C2=
=A0 at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)<br>

=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask=
.java:621)<br>=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.MapTask.run(Ma=
pTask.java:305)<br>=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.mapred.Child.mai=
n(Child.java:170)<br>Caused by: TimedOutException()<br>

=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.thrift.Cassandra$get_range_slice=
s_result.read(Cassandra.java:11015)<br>=C2=A0=C2=A0=C2=A0 at org.apache.cas=
sandra.thrift.Cassandra$Client.recv_get_range_slices(Cassandra.java:623)<br=
>=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.thrift.Cassandra$Client.get_ran=
ge_slices(Cassandra.java:597)<br>

=C2=A0=C2=A0=C2=A0 at org.apache.cassandra.hadoop.ColumnFamilyRecordReader$=
RowIterator.maybeInit(ColumnFamilyRecordReader.java:142)<br>=C2=A0=C2=A0=C2=
=A0 ... 11 more<br>---------------------------------------<br><br><br>Best =
Regards,<br>Utku<br>

--0016e6dab05660c497048560e650--