Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 10D5BE478 for ; Tue, 22 Jan 2013 19:05:59 +0000 (UTC) Received: (qmail 33288 invoked by uid 500); 22 Jan 2013 19:05:57 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 33238 invoked by uid 500); 22 Jan 2013 19:05:57 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 33229 invoked by uid 99); 22 Jan 2013 19:05:57 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Jan 2013 19:05:57 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com designates 209.85.212.170 as permitted sender) Received: from [209.85.212.170] (HELO mail-wi0-f170.google.com) (209.85.212.170) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Jan 2013 19:05:51 +0000 Received: by mail-wi0-f170.google.com with SMTP id hq7so3687568wib.5 for ; Tue, 22 Jan 2013 11:05:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type; bh=SUZhSTa26pB5lTP5fdMm6fZfWuVsmRrRnTQPIaSUm34=; b=FLq3WbgJa2D7e+6gptS1rU78vbHo9y23D7lYk5yPE9xv/W607evHXdVoZsHYFuIFmZ L+/tGpW0nCv/vhXmAwlmhQG7A0XmU3XXZ8jh2R8lPuaqcS1mXs/KsPd7yyd66mwNDfKG kC8czetYxqyZjYidWKn0VEdHOCeQ+hGjpETDgteNZ7XlOWO6/b1BkHrSdlCOVSK7g3Fz x+4xARide391dLvv3Xf4Q9HlwOai0omaPOvQLnFCLajGcuxADA3emPxeNjviq+phuBVv ThGngqSUtgLzBdLspaRD1wtGjl4dKpGjMHv+r5FQXkss/PJ7E3lIbndXck8E9alSrSdj mFdA== MIME-Version: 1.0 X-Received: by 10.194.57.206 with SMTP id k14mr34342535wjq.26.1358881530663; Tue, 22 Jan 2013 11:05:30 -0800 (PST) Received: by 10.216.73.194 with HTTP; Tue, 22 Jan 2013 11:05:29 -0800 (PST) In-Reply-To: References: Date: Tue, 22 Jan 2013 11:05:29 -0800 Message-ID: Subject: Re: write throughput in cassandra, understanding hbase From: Ted Yu To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=047d7ba97e88ed543f04d3e54260 X-Virus-Checked: Checked by ClamAV on apache.org --047d7ba97e88ed543f04d3e54260 Content-Type: text/plain; charset=ISO-8859-1 The graph cited below was more than 1 year old. FYI On Tue, Jan 22, 2013 at 11:01 AM, S Ahmed wrote: > Just to be clear, I realize benchmarks are not always the best way to gauge > performance etc. since there are many factors involved, but I have > generally seen a big diff in write throughput between the two (of the > bencharks that I have read). > > For example: > http://www.cubrid.org/blog/dev-platform/nosql-benchmarking/(chart: > http://www.cubrid.org/wp-content/uploads/2011/09/db-test-results.png) > > > > > > On Tue, Jan 22, 2013 at 1:46 PM, Jean-Daniel Cryans >wrote: > > > On Tue, Jan 22, 2013 at 10:38 AM, S Ahmed wrote: > > > I've read articles online where I see cassandra doing like 20K writers > > per > > > second, and hbase around 2-3K. > > > > Numbers with 0 context don't mean much, if at all. > > > > > > > > I understand both systems have their strenghts, but I am curious as to > > what > > > is holding hbase from reaching similiar results? > > > > > > Is it HDFS that is the issue? Or hbase does certain things (to its > > > advantage) that slows the write path down? > > > > Our writes are generally quite fast, I think at the moment some > > improvements can be made at the client level. I did some tests last > > year and I could get better throughput with the asynchbase client > > compared to the normal Java client because the former has call queues > > per region server. Both tests were using the same region servers, > > uploading the same data set. > > > > J-D > > > --047d7ba97e88ed543f04d3e54260--