From user-return-27379-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Tue Jul 3 02:10:27 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3DCD69F8A for ; Tue, 3 Jul 2012 02:10:27 +0000 (UTC) Received: (qmail 47039 invoked by uid 500); 3 Jul 2012 02:10:25 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 47015 invoked by uid 500); 3 Jul 2012 02:10:24 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 47005 invoked by uid 99); 3 Jul 2012 02:10:24 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Jul 2012 02:10:24 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [216.70.64.45] (HELO n15.mail01.mtsvc.net) (216.70.64.45) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Jul 2012 02:10:14 +0000 Received: from cl34.gs01.gridserver.com ([64.13.192.43]:50745) by n15.mail01.mtsvc.net with esmtps (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1SlsYr-0007OS-RP; Mon, 02 Jul 2012 22:09:54 -0400 Received: from c-24-7-86-20.hsd1.ca.comcast.net ([24.7.86.20]:45389 helo=[192.168.26.101]) by cl34.gs01.gridserver.com with esmtpsa (TLS-1.0:DHE_RSA_AES_256_CBC_SHA:32) (Exim 4.69) (envelope-from ) id 1SlsYq-0007U2-R3; Mon, 02 Jul 2012 19:09:53 -0700 Message-ID: <4FF25470.6030605@syncopated.net> Date: Mon, 02 Jul 2012 19:09:52 -0700 From: Deno Vichas User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:13.0) Gecko/20120614 Thunderbird/13.0.1 MIME-Version: 1.0 To: user@cassandra.apache.org CC: aaron morton Subject: Re: hector timeouts References: <4FEBFB05.6000206@syncopated.net> <4FECAA5C.1010605@syncopated.net> In-Reply-To: Content-Type: multipart/alternative; boundary="------------070304010403080604030007" X-Authenticated-User: 32415 deno@syncopated.net X-MT-ID: d18d1aefa44d3b049b46df41b9e219702ba9cf79 This is a multi-part message in MIME format. --------------070304010403080604030007 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit is anybody using kafka? what other options is there? currently i need to do around 50,000 (is that a lot?) a minute. On 7/1/2012 11:39 AM, aaron morton wrote: > Using Cassandra as a queue is generally thought of as a bas idea, > owing to the high delete workload. Levelled compaction handles it > better but it is still no the best approach. > > Depending on your needs consider running > http://incubator.apache.org/kafka/ > >> could you share some details on this? we're using hector and we see >> random timeout warns in the logs and not sure how to address them. > First determine if they are server side or client side timeouts. Then > determine what the query was. > > Cheers > > ----------------- > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com > > On 29/06/2012, at 7:02 AM, Deno Vichas wrote: > >> On 6/28/2012 9:37 AM, David Leimbach wrote: >>> >>> That coupled with Hector timeout issues became a real problem for us. >> >> could you share some details on this? we're using hector and we see >> random timeout warns in the logs and not sure how to address them. >> >> >> thanks, >> deno > --------------070304010403080604030007 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit
is anybody using kafka?  what other options is there?  currently i need to do around 50,000 (is that a lot?) a minute.


On 7/1/2012 11:39 AM, aaron morton wrote:
Using Cassandra as a queue is generally thought of as a bas idea, owing to the high delete workload. Levelled compaction handles it better but it is still no the best approach. 

Depending on your needs consider running http://incubator.apache.org/kafka/ 

could you share some details on this?  we're using hector and we see random timeout warns in the logs and not sure how to address them.
First determine if they are server side or client side timeouts. Then determine what the query was. 

Cheers

-----------------
Aaron Morton
Freelance Developer
@aaronmorton

On 29/06/2012, at 7:02 AM, Deno Vichas wrote:

On 6/28/2012 9:37 AM, David Leimbach wrote:

That coupled with Hector timeout issues became a real problem for us.

could you share some details on this?  we're using hector and we see random timeout warns in the logs and not sure how to address them.


thanks,
deno



--------------070304010403080604030007--