Return-Path: Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: (qmail 10901 invoked from network); 23 Jun 2010 12:32:43 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 23 Jun 2010 12:32:43 -0000 Received: (qmail 17560 invoked by uid 500); 23 Jun 2010 12:32:43 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 17294 invoked by uid 500); 23 Jun 2010 12:32:40 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 17278 invoked by uid 99); 23 Jun 2010 12:32:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 12:32:39 +0000 X-ASF-Spam-Status: No, hits=4.4 required=10.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of shiyingjie1983@gmail.com designates 209.85.211.194 as permitted sender) Received: from [209.85.211.194] (HELO mail-yw0-f194.google.com) (209.85.211.194) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 12:32:31 +0000 Received: by ywh32 with SMTP id 32so3534875ywh.5 for ; Wed, 23 Jun 2010 05:32:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=3GH8MWyEO2ErWdjpWVepX1Phuxey+YLrr+QI78vrng4=; b=t7OOpXYlYT1ozfk0e9wxF7NS236PwyXJnY7zFC0R5F2+SgEn2GJ4JZ+UIp37MbfPoS vZ2s40E5DG9o7S+hnjhVPqpvY35Izm+86KeqNjGjfKd6tIKWRPnKw+4FjupzVdvEyC2e e4PL0m1enaOcWou0WNMD3g2y0Ncx7+JBi/WmE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=nEIzcEwmjHmCyn4SXPGLo6NxVaETtg4YcGRp4XvSOx/vwh1mvkS7gB5/8lTHcRs/kJ YHMP7RXECdIS1F4m/vjRUhBntd7aliUvnrAetIgPnt27q9rVHDXguO70mis/0yNOuQbS 1chTx/4MdUXks0iACILVkVnWOvN5ejhhJKlxw= MIME-Version: 1.0 Received: by 10.101.177.39 with SMTP id e39mr6389452anp.8.1277296330816; Wed, 23 Jun 2010 05:32:10 -0700 (PDT) Received: by 10.101.129.36 with HTTP; Wed, 23 Jun 2010 05:32:10 -0700 (PDT) Date: Wed, 23 Jun 2010 20:32:10 +0800 Message-ID: Subject: Why data read performs better than data write in HBase? From: =?GB2312?B?yrfTor3c?= To: dev@hbase.apache.org Content-Type: multipart/alternative; boundary=00163691fb38123c710489b1ba42 X-Virus-Checked: Checked by ClamAV on apache.org --00163691fb38123c710489b1ba42 Content-Type: text/plain; charset=ISO-8859-1 Hi, All Recently I did some tests on HBase, using the performance eveluation package in HBase 0.20.3. There are some situations I can't understand. I found that read perform better than write, no matter sequential read or random read during the test. But in BigTable's paper, writes perform better than reads, because each tablet server appends all incoming writes to a single commit log and uses group commit to stream these writes efficiently to GFS. In HBase, we set the autoFlush=false, and the flush size is 64M, so writes should perform better than reads, but the result is just the opposite. Please help me to explain this phenomenon, thanks a lot! Yingjie --00163691fb38123c710489b1ba42--