Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of sonnyheer@gmail.com
 designates 209.85.214.172 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=noLHMheNP/+7GDpeB4SU58xq37TGPUx6jWu/iTU6dNm+tGps+eDX/kcuM72Cnn7WXF
         yITSw2C1moJCupbS/50x/TrQZXu4xNPOfNghaa48d2eK9yYq1U2nNG0DAlEmEjAN5C+U
         C8+sv326k5Obk2e06ideEWhu1zKK6DwxWfcTk=
MIME-Version: 1.0
In-Reply-To: <AANLkTinTnYHwwb_NPHT-PqqkE78ouiSbxUBbEfR1vyr3@mail.gmail.com>
References: <AANLkTilZobWuCM82TeF4_31WLp6YOtTdp6d0VaYacu3G@mail.gmail.com>
	 <AANLkTinTnYHwwb_NPHT-PqqkE78ouiSbxUBbEfR1vyr3@mail.gmail.com>
Date: Tue, 18 May 2010 16:37:37 -0700
Message-ID: <AANLkTil_mHa2Smx_pKspQJ2ZmEsPZaEKRNuxwhwyN8La@mail.gmail.com>
Subject: Re: Timeouts running batch_mutate
From: Sonny Heer <sonnyheer@gmail.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Yeah there are many writes happening at the same time to any given cass nod=
e.

e.g. assume 10 machines, all running hadoop and cassandra.  The hadoop
nodes are randomly picking a cassandra node and writing directly using
the batch mutate.

After increasing the timeout even more, i don't get that exception
anymore.  But now getting UnavailableException.

The wiki states this happens when all the replicas required could be
created and/or read.  How do we resolve this problem?  the write
consistency is one.

thanks


On Sat, May 15, 2010 at 8:02 AM, Jonathan Ellis <jbellis@gmail.com> wrote:
> rpctimeout should be sufficient
>
> you can turn on debug logging to see how long it's actually taking the
> destination node to do the write (or look at cfstats, if no other
> writes are going on)
>
> On Fri, May 14, 2010 at 11:55 AM, Sonny Heer <sonnyheer@gmail.com> wrote:
>> Hey,
>>
>> I'm running a map/reduce job, reading from HDFS directory, and
>> reducing to Cassandra using the batch_mutate method.
>>
>> The reducer builds the list of rowmutations for a single row, and
>> calls batch_mutate at the end. =A0As I move to a larger dataset, i'm
>> seeing the following exception:
>>
>> Caused by: TimedOutException()
>> =A0 =A0 =A0 =A0at org.apache.cassandra.thrift.Cassandra$batch_mutate_res=
ult.read(Cassandra.java:15361)
>> =A0 =A0 =A0 =A0at org.apache.cassandra.thrift.Cassandra$Client.recv_batc=
h_mutate(Cassandra.java:796)
>> =A0 =A0 =A0 =A0at org.apache.cassandra.thrift.Cassandra$Client.batch_mut=
ate(Cassandra.java:772)
>>
>> I changed the RpcTimeoutInMillis to 60 seconds with no changes. =A0What
>> configuration changes should i make when doing intensive write
>> operations using batch mutate?
>>
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>