Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B769F10622 for ; Fri, 21 Feb 2014 10:38:39 +0000 (UTC) Received: (qmail 24982 invoked by uid 500); 21 Feb 2014 10:38:36 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 24326 invoked by uid 500); 21 Feb 2014 10:38:33 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 24318 invoked by uid 99); 21 Feb 2014 10:38:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Feb 2014 10:38:32 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yongyong313@gmail.com designates 209.85.220.54 as permitted sender) Received: from [209.85.220.54] (HELO mail-pa0-f54.google.com) (209.85.220.54) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Feb 2014 10:38:27 +0000 Received: by mail-pa0-f54.google.com with SMTP id fa1so3274019pad.41 for ; Fri, 21 Feb 2014 02:38:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=e1VMkRPzz2WOaY2CnlH+az0/h6zGgPjVO47+P37Dw5k=; b=sfIIRaZZpu8H/cpvZIgQLzOiA2xERfhd+KiziHVu2RzAX94yr+Ysw9ida4nsSM1Cx4 wewoVnAe7Yjf8HFz89OW+7cz0fZ4TJi6ASXaS351kAwo45xcAjq3/RVTEKpL0uaUL0VW tvoWFPsNkxqr3YkE/juBKNQm2H5dYrORIB7EI5WMUGXtI2i3qq9t9oNPrF1jsLyhsX2d DpFj2btFE2QW/ujc9P6zbmEAwzrBEBrI0Ai0vTreEmFSDWFskSyr95s3t9lp6A0Zc/L2 qQUvnThD2q53LUo4DcIiyfQjDZUMKz/ErkNY7SgdZsdaNj5KO95NGEovLD0xrxLgU7AT 8KVg== MIME-Version: 1.0 X-Received: by 10.66.240.4 with SMTP id vw4mr8455241pac.26.1392979087528; Fri, 21 Feb 2014 02:38:07 -0800 (PST) Received: by 10.66.163.71 with HTTP; Fri, 21 Feb 2014 02:38:07 -0800 (PST) In-Reply-To: References: Date: Fri, 21 Feb 2014 11:38:07 +0100 Message-ID: Subject: Re: When should we trigger a major compaction? From: yonghu To: user@hbase.apache.org Content-Type: multipart/alternative; boundary=047d7b15a9a5b1182804f2e8371a X-Virus-Checked: Checked by ClamAV on apache.org --047d7b15a9a5b1182804f2e8371a Content-Type: text/plain; charset=ISO-8859-1 Before you want to trigger major compaction, let's first explain why do we need major compaction. The major compaction will cause 1. delete the data which is masked by tombstone; 2. delete the data which has expired ttl; 3. compact several small hfiles into a single larger one. I didn't quite understand what do you mean by "use num of storefiles", why this? On Fri, Feb 21, 2014 at 10:50 AM, Ramon Wang wrote: > Hi Guys > > We disabled the automatically major compaction setting in our HBase > cluster, so we want to something which can tell us when should we do major > compaction, we were thinking to use "num of storefiles", but we cannot find > any APIs or any JMX settings which can be used for it, please share us some > ideas on how to do it, thanks in advance. > > Cheers > Ramon > --047d7b15a9a5b1182804f2e8371a--