Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of jesse.mcconnell@gmail.com
 designates 74.125.83.172 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=ceGWvwh3C6M58XdeCgdkvQW0VXnOT2Zg8rO/whbD5jbyMJs4TK6rJbgrVqVA4pGfHe
         VDkl6QdohVXRwUZcmtldBSmSmXHoGX7DlKmHdidE4F8FQkDZpeFJT2+3Y5C7G2PEEWa9
         al+etV6hD6+h4H3b1VNAGcfreNTDL6DI5LQKA=
MIME-Version: 1.0
In-Reply-To: <n2xa43524d01004191740g4812f8adw2a4cafa5c2cacf40@mail.gmail.com>
References: <q2v775e31411004181259zf9d5c145mb90405726fa3890c@mail.gmail.com>
	 <1271626639.295713261@192.168.2.228>
	 <t2u775e31411004181453y204c2793n45e58d9d60290dda@mail.gmail.com>
	 <1271628078.92320234@192.168.2.231>
	 <i2g775e31411004191712pb4a0ffd5h49bf88d6d93114e@mail.gmail.com>
	 <n2xa43524d01004191740g4812f8adw2a4cafa5c2cacf40@mail.gmail.com>
Date: Mon, 19 Apr 2010 19:41:33 -0500
Message-ID: <n2ra43524d01004191741mb4165421z1e43bbf42394e8b3@mail.gmail.com>
Subject: Re: Help with MapReduce
From: Jesse McConnell <jesse.mcconnell@gmail.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

err not count in your case, but same symptom, cassandra can't return
the answer to your query in the configured rpctimeout time

cheers,
jesse

--
jesse mcconnell
jesse.mcconnell@gmail.com


On Mon, Apr 19, 2010 at 19:40, Jesse McConnell
<jesse.mcconnell@gmail.com> wrote:
> most likely means that the count() operation is taking too long for
> the configured RPCTimeout
>
> counts get unreliable after a certain number of columns under a key in
> my experience
>
> jesse
>
> --
> jesse mcconnell
> jesse.mcconnell@gmail.com
>
>
>
> On Mon, Apr 19, 2010 at 19:12, Joost Ouwerkerk <joost@openplaces.org> wro=
te:
>> I'm slowly getting somewhere with Cassandra... I have successfully impor=
ted
>> 1.5 million rows using MapReduce. =C2=A0This took about 8 minutes on an =
8-node
>> cluster, which is comparable to the time it takes with HBase.
>> Now I'm having trouble scanning this data. =C2=A0I've created a simple M=
apReduce
>> job that counts rows in my ColumnFamily. =C2=A0The Job fails with most t=
asks
>> throwing the following Exception. =C2=A0Anyone have any ideas what's goi=
ng wrong?
>> java.lang.RuntimeException: TimedOutException()
>>
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeIn=
it(ColumnFamilyRecordReader.java:165)
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.compute=
Next(ColumnFamilyRecordReader.java:215)
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.compute=
Next(ColumnFamilyRecordReader.java:97)
>> =C2=A0 =C2=A0 =C2=A0 at
>> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIter=
ator.java:135)
>> =C2=A0 =C2=A0 =C2=A0 at
>> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java=
:130)
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.hadoop.ColumnFamilyRecordReader.nextKeyValue(Column=
FamilyRecordReader.java:91)
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(Ma=
pTask.java:423)
>> =C2=A0 =C2=A0 =C2=A0 at org.apache.hadoop.mapreduce.MapContext.nextKeyVa=
lue(MapContext.java:67)
>> =C2=A0 =C2=A0 =C2=A0 at org.apache.hadoop.mapreduce.Mapper.run(Mapper.ja=
va:143)
>> =C2=A0 =C2=A0 =C2=A0 at org.apache.hadoop.mapred.MapTask.runNewMapper(Ma=
pTask.java:583)
>> =C2=A0 =C2=A0 =C2=A0 at org.apache.hadoop.mapred.MapTask.run(MapTask.jav=
a:305)
>> =C2=A0 =C2=A0 =C2=A0 at org.apache.hadoop.mapred.Child.main(Child.java:1=
70)
>> Caused by: TimedOutException()
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.thrift.Cassandra$get_range_slices_result.read(Cassa=
ndra.java:11015)
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.thrift.Cassandra$Client.recv_get_range_slices(Cassa=
ndra.java:623)
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.thrift.Cassandra$Client.get_range_slices(Cassandra.=
java:597)
>> =C2=A0 =C2=A0 =C2=A0 at
>> org.apache.cassandra.hadoop.ColumnFamilyRecordReader$RowIterator.maybeIn=
it(ColumnFamilyRecordReader.java:142)
>> =C2=A0 =C2=A0 =C2=A0 ... 11 more
>>
>> On Sun, Apr 18, 2010 at 6:01 PM, Stu Hood <stu.hood@rackspace.com> wrote=
:
>>>
>>> In 0.6.0 and trunk, it is located at
>>> src/java/org/apache/cassandra/hadoop/ColumnFamilyInputFormat.java
>>>
>>> You might be using a pre-release version of 0.6 if you are seeing a fat
>>> client based InputFormat.
>>>
>>>
>>> -----Original Message-----
>>> From: "Joost Ouwerkerk" <joost@openplaces.org>
>>> Sent: Sunday, April 18, 2010 4:53pm
>>> To: user@cassandra.apache.org
>>> Subject: Re: Help with MapReduce
>>>
>>> Where is the ColumnFamilyInputFormat that uses Thrift? =C2=A0I don't ac=
tually
>>> have a preference about client, I just want to be consistent with
>>> ColumnInputFormat.
>>>
>>> On Sun, Apr 18, 2010 at 5:37 PM, Stu Hood <stu.hood@rackspace.com> wrot=
e:
>>>
>>> > ColumnFamilyInputFormat no longer uses the fat client API, and instea=
d
>>> > uses
>>> > Thrift. There are still some significant problems with the fat client=
,
>>> > so it
>>> > shouldn't be used without a good understanding of those problems.
>>> >
>>> > If you still want to use it, check out contrib/bmt_example, but I'd
>>> > recommend that you use thrift for now.
>>> >
>>> > -----Original Message-----
>>> > From: "Joost Ouwerkerk" <joost@openplaces.org>
>>> > Sent: Sunday, April 18, 2010 2:59pm
>>> > To: user@cassandra.apache.org
>>> > Subject: Help with MapReduce
>>> >
>>> > I'm a Cassandra noob trying to validate Cassandra as a viable
>>> > alternative
>>> > to
>>> > HBase (which we've been using for over a year) for our application. =
=C2=A0So
>>> > far,
>>> > I've had no success getting Cassandra working with MapReduce.
>>> >
>>> > My first step is inserting data into Cassandra. =C2=A0I've created a =
MapRed
>>> > job
>>> > based using the fat client API. =C2=A0I'm using the fat client (Stora=
geProxy)
>>> > because that's what ColumnFamilyInputFormat uses and I want to use th=
e
>>> > same
>>> > API for both read and write jobs.
>>> >
>>> > When I call StorageProxy.mutate(), nothing happens. =C2=A0The job com=
pletes
>>> > as
>>> > if
>>> > it had done something, but in fact nothing has changed in the cluster=
.
>>> > =C2=A0When
>>> > I call StorageProxy.mutateBlocking(), I get an IOException complainin=
g
>>> > that
>>> > there is no connection to the cluster. =C2=A0I've concluded with the =
debugger
>>> > that StorageService is not connecting to the cluster, even though I'v=
e
>>> > specified the correct seed and ListenAddress (I've using the exact sa=
me
>>> > storage-conf.xml as the nodes in the cluster).
>>> >
>>> > I'm sure I'm missing something obvious in the configuration or my set=
up,
>>> > but
>>> > since I'm new to Cassandra, I can't see what it is.
>>> >
>>> > Any help appreciated,
>>> > Joost
>>> >
>>> >
>>> >
>>>
>>>
>>
>>
>