Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2DD3418E96 for ; Mon, 14 Dec 2015 06:12:33 +0000 (UTC) Received: (qmail 80653 invoked by uid 500); 14 Dec 2015 06:12:32 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 80557 invoked by uid 500); 14 Dec 2015 06:12:32 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 80545 invoked by uid 99); 14 Dec 2015 06:12:32 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Dec 2015 06:12:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id C02A0C0856 for ; Mon, 14 Dec 2015 06:12:31 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.999 X-Spam-Level: ** X-Spam-Status: No, score=2.999 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id mQFEw9dOWqTL for ; Mon, 14 Dec 2015 06:12:30 +0000 (UTC) Received: from mail-io0-f173.google.com (mail-io0-f173.google.com [209.85.223.173]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 61335429C4 for ; Mon, 14 Dec 2015 06:12:30 +0000 (UTC) Received: by iofo67 with SMTP id o67so33095378iof.3 for ; Sun, 13 Dec 2015 22:12:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:content-type; bh=3393xgEUc2D4glGwCyv2fmw8mpMncc5C1rrYwNFtjT8=; b=L/tt5GddmOBkATlaN/Ve1jYONeY4qI00Qydx6asBgpjds0FRcZmoc0v+IWgqKCok5j fSzHhVeGd1aazN4Lo0+bTHNL/ZiookFlsgJRdn7tu41BSWNo4+ELIf5UXnv+sh64zpHN i/O5CaF9b72nH8BakqvzRakM9J5MSqt1qC9TBqmt6TbVR3mSJlo3D1nR6ZCmau0bbxJ9 yw6DyYExIxbTnfVQJPW21usdLGP/QIk6f5W5u+QTQJ1bWqhOeIGG5x3LgZw5dSzfxjla /xUKQ4u+afRS6hqnO3n4GdAShwcUD3DKbEw2xz4R+ntLDpjmQDg3vFajYmD6vIKcv05z wM8A== MIME-Version: 1.0 X-Received: by 10.107.41.146 with SMTP id p140mr27980105iop.80.1450073543875; Sun, 13 Dec 2015 22:12:23 -0800 (PST) Sender: saint.ack@gmail.com Received: by 10.64.167.134 with HTTP; Sun, 13 Dec 2015 22:12:23 -0800 (PST) In-Reply-To: References: Date: Sun, 13 Dec 2015 22:12:23 -0800 X-Google-Sender-Auth: p0ibrDqMJX-feSMb045EfOJ6ZOo Message-ID: Subject: Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0) From: Stack To: HBase Dev List Content-Type: multipart/alternative; boundary=001a1141fac87b20a30526d58efd --001a1141fac87b20a30526d58efd Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Tue, Sep 8, 2015 at 2:01 AM, =E9=88=B4=E6=9C=A8=E4=BF=8A=E8=A3=95 wrote: > ... > > Also we wrote performance test code for increment operation that included > 100 threads and ran it in local mode. > > The result is shown below: > > CDH5.3.1(HBase0.98.6) > Throughput(op/s): 12757, Latency(ms): 7.975072509210629 > > CDH5.4.5(HBase1.0.0) > Throughput(op/s): 2027, Latency(ms): 49.11840157868772 > > Do you have this program Toshihiro Suzuki still? May I see it? I am interested in seeing what the 100 threads are doing, if they are all updating the same Cell or if they are spread over many rows (I see master branch is more than 2x slower than 0.94 if all threads are contending on a single Cell but if not contending, master seems faster -- I must be doing something wrong over in my experiments on HBASE-14460). I would also be interested in what you loading is like in production if you can describe it at all (send me offlist if you'd rather talk about it in public). In production, can you tell how much slowdown you are seeing? Is it 2x or 7x as per your test program? Thank you, St.Ack > > Thanks, > > Toshihiro Suzuki > --001a1141fac87b20a30526d58efd--