Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7F2ABE45E for ; Tue, 22 Jan 2013 19:03:34 +0000 (UTC) Received: (qmail 17906 invoked by uid 500); 22 Jan 2013 19:03:32 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 17781 invoked by uid 500); 22 Jan 2013 19:03:32 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 17773 invoked by uid 99); 22 Jan 2013 19:03:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Jan 2013 19:03:32 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [72.30.239.136] (HELO nm32-vm0.bullet.mail.bf1.yahoo.com) (72.30.239.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Jan 2013 19:03:22 +0000 Received: from [98.139.212.150] by nm32.bullet.mail.bf1.yahoo.com with NNFMP; 22 Jan 2013 19:03:01 -0000 Received: from [98.139.212.210] by tm7.bullet.mail.bf1.yahoo.com with NNFMP; 22 Jan 2013 19:03:01 -0000 Received: from [127.0.0.1] by omp1019.mail.bf1.yahoo.com with NNFMP; 22 Jan 2013 19:03:00 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 989919.1993.bm@omp1019.mail.bf1.yahoo.com Received: (qmail 64029 invoked by uid 60001); 22 Jan 2013 19:03:00 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1358881380; bh=/w/sQAeYHOOKr0HPDeyqRleMe3gxtV3vxw2e9u9Xt7I=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=5u/URvfnvDH00n8CiVfVpPBAtazvCw+sIqpXX2JfpdwLTS11+A4NMKEdozP5G+0YUQ7N9HwaTIPjjgffYW85vDHwS/1hLJFHRf8xiffKBSIapxQy6/b1Ng8edXVYxV9jJmqGrftWZVQS8s+9odihJazxsZKYifoGfk2NZKiUpS0= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-RocketYMMF:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=jJYveCNk/uTlo87wevH89s+ugObozXMh+zaT5lHwSu8cc58ElzrkNOmlzGOOCkqr6+W43RemmljfN1VGnEnwB4ByHUp6Om6HD1GBXlqdhLb9Mduo7irwcnwY2yxGn85F1WE/fKPYvwv1/H2M6GrYJ97tbmvT6XZCHlDiF6Lkl6U=; X-YMail-OSG: 9iRWEhMVM1lt5owkgatagUY256CAPbgf8F1pYhv40Ybu2tK o6dcyc7BLxAiL2FR3MMLaDpL7RhFj5twkOfGk.83ythuO1qqtEyIydIPzMFI AJ5gVRuuF05.nV3QLWnWcCBBN84z5YSQbiHAGYF0aoYr36EvMFgDBrJSydPA .dLPqO8oAVdn78wP1xaZm7zwvLcoAFXv.dG9yNphPWmZlD4LFLVP7iOg.ZMm BY1leF.R4y7168YX.d2C4NJpGjWM5OGVFCqKFwBSNZMj8DGfMIhyrCCFk7Fd p1vrgsCCoJj44QBACXaeIjHTw1l_3O5P_w6dJi1ereeoecBN85x9jd2znihE Q8n811dRgHCf8tvqGQVmUedF1gDXX8ICw_TtYIUnG7oxWO73YyPVjdkgv4Y_ Y9.KDE9VWOb3vfJXmgfZUbgLXi9VhT.hUkXCdjRS0lqTFn22j94csUbmdQ2Z D66_EOJGaU34bQ7FkkfM9CMwm7nLeMNOQrJMDqXkGhCr2OTTaGLRUwwUUAMz Zdyu_h7xO6t4wgIU- Received: from [107.3.190.75] by web140602.mail.bf1.yahoo.com via HTTP; Tue, 22 Jan 2013 11:03:00 PST X-Rocket-MIMEInfo: 001.001,V2hlcmUgZG8geW91IHNlZSB0aGF0IEhCYXNlIGlzIGRvaW5nIG9ubHkgMi0zayB3cml0ZXMvcz8KSG93IHdhcyB0aGUgZGF0YSBkaXN0cmlidXRlZD8gV2FzIHRoZSB0YWJsZSBzcGxpdD8KQ2Fzc2FuZHJhIHVzZXMgYSByYW5kb20gcGFydGl0aW9uZXIgYnkgZGVmYXVsdCwgd2hpY2ggd2lsbCBuaWNlbHkgZGlzdHJpYnV0ZSB0aGUgZGF0YSBvdmVyIHRoZSBjbHVzdGVyIGJ1dCB3b24ndCBhbGxvdyB0byBwZXJmb3JtIHJhbmdlIHNjYW5zIG92ZXIgeW91ciBkYXRhLgpIQmFzZSBhbHdheXMgcGFydGl0aW9ucyABMAEBAQE- X-RocketYMMF: lhofhansl X-Mailer: YahooMailWebService/0.8.130.496 References: Message-ID: <1358881380.57085.YahooMailNeo@web140602.mail.bf1.yahoo.com> Date: Tue, 22 Jan 2013 11:03:00 -0800 (PST) From: lars hofhansl Reply-To: lars hofhansl Subject: Re: write throughput in cassandra, understanding hbase To: "user@hbase.apache.org" In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-118416272-892707874-1358881380=:57085" X-Virus-Checked: Checked by ClamAV on apache.org ---118416272-892707874-1358881380=:57085 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Where do you see that HBase is doing only 2-3k writes/s?=0AHow was the data= distributed? Was the table split?=0ACassandra uses a random partitioner by= default, which will nicely distribute the data over the cluster but won't = allow to perform range scans over your data.=0AHBase always partitions by k= ey ranges, so that the keys can the range scanned. If that is not done corr= ectly and you create monotonically increasing keys, you'll hotspot a single= region server.=0A=0AEven then, you can do more than this on single RegionS= erver.=0A=0AAlso note that many of the benchmarks have agendas and cherry p= ick the results.=0AThey probably "forgot" to disabled Nagle's and to distri= bute the table correctly.=0A=0A-- Lars=0A=0A=0A=0A_________________________= _______=0A From: S Ahmed =0ATo: user@hbase.apache.org= =0ASent: Tuesday, January 22, 2013 10:38 AM=0ASubject: RE: write throughpu= t in cassandra, understanding hbase=0A =0AI've read articles online where I= see cassandra doing like 20K writers per=0Asecond, and hbase around 2-3K.= =0A=0AI understand both systems have their strenghts, but I am curious as t= o what=0Ais holding hbase from reaching similiar results?=0A=0AIs it HDFS t= hat is the issue?=A0 Or hbase does certain things (to its=0Aadvantage) that= slows the write path down? ---118416272-892707874-1358881380=:57085--