Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 0EFC5200B27 for ; Wed, 22 Jun 2016 11:09:28 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 0D8CF160A35; Wed, 22 Jun 2016 09:09:28 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 53A04160A2E for ; Wed, 22 Jun 2016 11:09:27 +0200 (CEST) Received: (qmail 41731 invoked by uid 500); 22 Jun 2016 09:09:26 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 41719 invoked by uid 99); 22 Jun 2016 09:09:25 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jun 2016 09:09:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 79661C0DF4 for ; Wed, 22 Jun 2016 09:09:25 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.129 X-Spam-Level: ** X-Spam-Status: No, score=2.129 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id GQ1aCFYu3XrA for ; Wed, 22 Jun 2016 09:09:24 +0000 (UTC) Received: from mail-yw0-f178.google.com (mail-yw0-f178.google.com [209.85.161.178]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 5A4D55FB60 for ; Wed, 22 Jun 2016 09:09:24 +0000 (UTC) Received: by mail-yw0-f178.google.com with SMTP id b72so37104974ywa.3 for ; Wed, 22 Jun 2016 02:09:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=9fINRSSY+KSeCdK8/jLVTlzLcjUeoYgCZnkfeGwobss=; b=RuqCGrk4SxkZED6T7tBM2rNhoMqX2GIf7IuTTXMix9hsnEHtGzwrqMu/HaBuCY1CcY bc8FRfXU9dRalpYwNW+my1jfWqsExe6ZMGeSGTZdLs6gyjbdg2/Dq9HzKR66Cy6REbXA iBobRLZO9aHVu7yNvA0c7woLxF5k3rrERvoLhF3ufjEX0sjIK3lCiFG7ljq5K5tfqmB3 7f8FsSqVoPV/Xd5FZsyUUD/AsiRhkp04qXqhkzrNtGhkZTGK/ptTpGb3fzg37HgeQs0U xv4deRD5kXpxr0LGeh37WvLEqdGx7+d0wtKQcQ46SJunxYKhwGx7NKNJsyYQywH4BALi J3iA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=9fINRSSY+KSeCdK8/jLVTlzLcjUeoYgCZnkfeGwobss=; b=LtDUDd0/bBybStpaLmTaWVr4b0lPllEwTqc3NmqPbhIYLhc/D6aesLdwxeIiZut71J rScYBm7CErYGjRGQQ3LBpHQ0rKtKc7s7XPRfzDxvt1McEneqprvwgfrTSGcSCFGBxB6P hxBShnK5yhUnbuykuQ7/xyMNiKwizP+UYNwoiDnlhIPHkwvF575MBfzuRnfivsWL9KVH iCRHWOWu5Bz1oIjahsBXq43Ab6uHyDhG7LfRL1aBsbjKMhSEurPtSN3vNbLd/jXtIHAu svSSrk7n66BUNOrnWjKmUCrLVoqTYjJyTYmndt73ZK82oGfIPiPiEf1wgYXtF6erkLJU A2Gw== X-Gm-Message-State: ALyK8tLOey4WxT20M0DPpVHEQVvNwmGL4nxiBXYCmz240YdijhHAsY5pICtT1Ssg5N3Rhlaqa7wLvjCZnA91uA== X-Received: by 10.37.75.1 with SMTP id y1mr14526601yba.8.1466586563116; Wed, 22 Jun 2016 02:09:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.94.136 with HTTP; Wed, 22 Jun 2016 02:09:22 -0700 (PDT) In-Reply-To: References: <8D2A77AD-9923-4DDD-95C9-F8967EE55660@gmail.com> From: Heng Chen Date: Wed, 22 Jun 2016 17:09:22 +0800 Message-ID: Subject: Re: hbase get big table problem To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=94eb2c095ffa2084330535da4b5f archived-at: Wed, 22 Jun 2016 09:09:28 -0000 --94eb2c095ffa2084330535da4b5f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable 8000/200 =3D 40, if your table balance enough, each RS will serve 40 requests per second, that is OK for RS. Have you try set xmn smaller to reduce young generation? 2016-06-22 16:12 GMT+08:00 jinhong lu : > 400 regions, 8000 eps for the whole table. hbase 1.0, AND heap > -Xmx32G,-Xms32G, -Xmn4G > > Thanks, > lujinhong > > > =E5=9C=A8 2016=E5=B9=B46=E6=9C=8822=E6=97=A5=EF=BC=8C15:53=EF=BC=8CHeng= Chen =E5=86=99=E9=81=93=EF=BC=9A > > > > How many regions do you have for the table? 8000 qps for one RS or for > the > > whole table? What's your java heap size now? and what's your hbase > > version? > > > > > > 2016-06-22 12:39 GMT+08:00 jinhong lu : > > > >> I got a cluster of 200 regionserver, and one of the tables is about 3T > and > >> 5 billion lines. Is it possible to get about 8000 Gets per second(abou= t > >> 100,000 lines)? > >> > >> I found YOUNG GC occurs every several senconds, each GC cost about > >> 1second. if I set -Xmn bigger, the GC occurs every several minutes, bu= t > >> each GC cost more time. > >> > >> Any suggetion? thanks. > >> > >> > >> > >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > >> Thanks, > >> lujinhong > >> > >> > > --94eb2c095ffa2084330535da4b5f--