Return-Path: Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: (qmail 98251 invoked from network); 23 Jun 2010 16:45:19 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 23 Jun 2010 16:45:19 -0000 Received: (qmail 8218 invoked by uid 500); 23 Jun 2010 16:45:19 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 8110 invoked by uid 500); 23 Jun 2010 16:45:18 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 8102 invoked by uid 99); 23 Jun 2010 16:45:18 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 16:45:18 +0000 X-ASF-Spam-Status: No, hits=-0.6 required=10.0 tests=AWL,FREEMAIL_FROM,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jdcryans@gmail.com designates 209.85.160.169 as permitted sender) Received: from [209.85.160.169] (HELO mail-gy0-f169.google.com) (209.85.160.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 16:45:12 +0000 Received: by gyg4 with SMTP id 4so4538818gyg.14 for ; Wed, 23 Jun 2010 09:44:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:sender:received :in-reply-to:references:date:x-google-sender-auth:message-id:subject :from:to:content-type:content-transfer-encoding; bh=avjSXD+PCIvVLxgUkp8Ka+X1u1be85rs9YzkPzBQ5Rw=; b=JazwfA0Bxjww4Prqpf2hi5yPXn2jBII7xnllEdaJcKPdgrxsjupsi+KOFba4FU27oy 8CKSyWyk0kPPtxAN1I/a7sW3k6UyY00rXd+yqNXWmHa0eLIxpsi8oAGpTn59nbIqWmPx 1l9np7Evd9UqEnRsQv5SbkAxtum77SmhAlsIs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=U7Rnm4TlaHpHF5SFTNgwjJndjdsknaBtqyByWpCjFIiu8SJAdli/gUdgr3aXPlQ16v w9eN2aJK05ThFKbYHh3CJMECeJG3liWZzL/kMCKV+Lka6VO0hPyVmU0uKTRmLsfoEWES pmJ496tMyNE9RC40hucT0gbtSSgL4rXiV+8yg= MIME-Version: 1.0 Received: by 10.229.224.196 with SMTP id ip4mr4267723qcb.129.1277311490570; Wed, 23 Jun 2010 09:44:50 -0700 (PDT) Sender: jdcryans@gmail.com Received: by 10.229.221.205 with HTTP; Wed, 23 Jun 2010 09:44:50 -0700 (PDT) In-Reply-To: References: Date: Wed, 23 Jun 2010 09:44:50 -0700 X-Google-Sender-Auth: pQzrrcSUzNrws7AGglibaQQWp8Y Message-ID: Subject: Re: Why data read performs better than data write in HBase? From: Jean-Daniel Cryans To: dev@hbase.apache.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable When I run PE, random/seqRead are always much slower than random/seqWrite so it seems to be something about your env or you are confused by the output of that test. What are the numbers you see? J-D On Wed, Jun 23, 2010 at 5:32 AM, =E5=8F=B2=E8=8B=B1=E6=9D=B0 wrote: > Hi, All > =C2=A0 =C2=A0Recently I did some tests on HBase, using the performance ev= eluation > package =C2=A0in HBase 0.20.3. There are some situations I can't understa= nd. I > found that read perform better than write, no matter sequential read or > random read during the test. But in BigTable's paper, writes perform bett= er > than reads, because each tablet server appends all incoming writes to a > single commit log and uses group commit to stream these writes efficientl= y > to GFS. In HBase, we set the autoFlush=3Dfalse, and the flush size is 64M= , so > writes should perform better than reads, but the result is just the > opposite. Please help me to explain this phenomenon, thanks a lot! > > Yingjie >