From user-return-31688-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Wed Feb 6 13:16:15 2013 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D48F6E19F for ; Wed, 6 Feb 2013 13:16:15 +0000 (UTC) Received: (qmail 1821 invoked by uid 500); 6 Feb 2013 13:16:13 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 1630 invoked by uid 500); 6 Feb 2013 13:16:13 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 1599 invoked by uid 99); 6 Feb 2013 13:16:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Feb 2013 13:16:12 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of timwintle@gmail.com designates 74.125.82.53 as permitted sender) Received: from [74.125.82.53] (HELO mail-wg0-f53.google.com) (74.125.82.53) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Feb 2013 13:16:04 +0000 Received: by mail-wg0-f53.google.com with SMTP id fn15so1092881wgb.32 for ; Wed, 06 Feb 2013 05:15:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:subject:from:to:date:in-reply-to:references :content-type:x-mailer:content-transfer-encoding:mime-version; bh=9BbQqxMtT183CZOHy5lKl16ESpeXcufGRidcxql1xUQ=; b=wptpU8wBSZbq8ZzCHJypF4aFjRcIEG83ylSkUAutlkOfqLZ6oG/s85szbsx+oWvy7m 9py9SjXapY9mPfNFmaQ7FWLQDE7SSmQqmEm/gRF6TZLL73/wtFvyi2Rd5NPGUx0wM1nZ 16OA+DzcyMpqOGfl7FghOskqixreT2S02cyzif0GZTLlmw9sIk+peLaPX54D6hedKd42 a6sI9CLVcIx3cajq7J2miaSX6KsuW/rtX+qGOFc7FY6lR1nRNnDIftLYVB+P6Pxj0miE JqVz3Za2u5JeMkhXuk/Jb1hifVK1gRhnjKzcrA5o2r7huyzeKMhGqAV08bblC93xwFX9 CzWA== X-Received: by 10.180.75.110 with SMTP id b14mr4989064wiw.21.1360156542720; Wed, 06 Feb 2013 05:15:42 -0800 (PST) Received: from [172.16.1.85] (87-194-110-230.bethere.co.uk. [87.194.110.230]) by mx.google.com with ESMTPS id s10sm3201507wiw.4.2013.02.06.05.15.41 (version=SSLv3 cipher=RC4-SHA bits=128/128); Wed, 06 Feb 2013 05:15:42 -0800 (PST) Message-ID: <1360156541.29873.21.camel@tim-desktop> Subject: Re: Pycassa vs YCSB results. From: Tim Wintle To: user@cassandra.apache.org Date: Wed, 06 Feb 2013 13:15:41 +0000 In-Reply-To: References: <46354466-86CD-4B14-82B3-4070791E9714@thelastpickle.com> <1360060470.14547.24.camel@tim-desktop> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.2.3-0ubuntu6 Content-Transfer-Encoding: 7bit Mime-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org On Tue, 2013-02-05 at 13:51 -0500, Edward Capriolo wrote: > Without stating the obvious, if you are interested in scale, then why > pick python?. I would (kind of) agree with this point.. If you absolutely need performance here then python isn't the right choice. If, however, you are currently working with python and the question was just "why is pycassa not as fast as YCSB, can I make it faster" then I'd say the fact it was only a constant factor of 2 slower shows it's perfectly possible to stick with python. FYI the setup I'm using to write data to Cassandra is based around a series of 0mq applications - the actual loader is in python, but filtering steps before that are (partly) in C. Tim