Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1BE4F17B06 for ; Thu, 12 Mar 2015 02:35:23 +0000 (UTC) Received: (qmail 51952 invoked by uid 500); 12 Mar 2015 02:35:21 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 51890 invoked by uid 500); 12 Mar 2015 02:35:21 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 51878 invoked by uid 99); 12 Mar 2015 02:35:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Mar 2015 02:35:20 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of alex.baranov.v@gmail.com designates 209.85.215.46 as permitted sender) Received: from [209.85.215.46] (HELO mail-la0-f46.google.com) (209.85.215.46) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Mar 2015 02:35:16 +0000 Received: by labgq15 with SMTP id gq15so12911874lab.1 for ; Wed, 11 Mar 2015 19:34:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CWmNjAMUjfZoKMUgf1+1ES3cvoJGP4/FLHNhC9sqrBM=; b=lAoHo8be1W7aD8wcQ0kH5O8gKe3bWiS334jQdPk5bRqnJw1Iv+CUiL67JYo/mFS6dv 5IRxH9sBFR7pJSdVHKHu28j7tfwMIKv1k2W0xk7cgmV7PQCWaY3fXYQTwbL5LryKaC4K RqyjYWuUsJ8KYeqSclrszt7je/U3YVKO85aXOyPWp5fe5MqCk8aPYamxkwDOrbQi06gF U+4DbzuOxepjmHVAZHsPSFGiZW74v+BHPxUD1IBrqKVGb2rzI/tq7UjUNXtDlFRZoEUF epsemVTELC5PvnaDqP2GFH2kI4DJb+zFcPZAU8gOBZkvo5Se/7OC7aH1CWEo2kpM8MPk hA5A== MIME-Version: 1.0 X-Received: by 10.152.28.5 with SMTP id x5mr36465120lag.112.1426127650278; Wed, 11 Mar 2015 19:34:10 -0700 (PDT) Received: by 10.25.140.77 with HTTP; Wed, 11 Mar 2015 19:34:10 -0700 (PDT) In-Reply-To: <4018d503.12dc5.14c0bb5cc2d.Coremail.c77_cn@163.com> References: <427168010.3150002.1426029691090.JavaMail.yahoo@mail.yahoo.com> <4929db06.6a45.14c070b3a63.Coremail.c77_cn@163.com> <4018d503.12dc5.14c0bb5cc2d.Coremail.c77_cn@163.com> Date: Wed, 11 Mar 2015 19:34:10 -0700 Message-ID: Subject: Re: Re: Re: Re: Why can the capacity of a table with TTL grow continuously? From: Alex Baranau To: user@hbase.apache.org Cc: lars hofhansl Content-Type: multipart/alternative; boundary=089e0160a708ffd5cc05110e3743 X-Virus-Checked: Checked by ClamAV on apache.org --089e0160a708ffd5cc05110e3743 Content-Type: text/plain; charset=ISO-8859-1 I'd try that. Please come back with results. Also, if possible it will be useful (at least for the important jira mentioned by Nick) if you can share the stats on the regions (size, store files #) before and after the procedure. Note (as Lars said): "careful, this ... can put some load on the net/disks". One more note: only increasing hbase.hregion.max.filesize may not help to completely avoid the same situation in future. It's hard to tell, but if you have what I'm thinking, I'd say data distribution pattern has greater affect. Though it will be mitigated to some extend by upping the region size. Alex Baranau -- http://cdap.io - open source framework to build and run data applications on Hadoop & HBase On Wed, Mar 11, 2015 at 7:00 PM, David chen wrote: > hbase.store.delete.expired.storefile is true in file > hbase-0.98.5/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compaction/CompactionConfigureation.java, > the reference code is 83th line as follows: > shouldDeleteExpired = > conf.getBoolean("hbase.store.delete.expired.storefile", true); > > > The region number have grown from 16 to 263 over the past seven months, > maybe the hbase.hregion.max.filesize value(4G) is a bit small. It looks > likely that the solution is to adjust hbase.hregion.max.filesize bigger and > merge the adjacent regions. > Any other ideas to suggest? > > > > > > > > > --089e0160a708ffd5cc05110e3743--