Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ACC1510E56 for ; Tue, 10 Sep 2013 04:03:03 +0000 (UTC) Received: (qmail 57406 invoked by uid 500); 10 Sep 2013 04:02:58 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 57322 invoked by uid 500); 10 Sep 2013 04:02:53 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 57314 invoked by uid 99); 10 Sep 2013 04:02:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Sep 2013 04:02:50 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of premal.j.shah@gmail.com designates 209.85.212.53 as permitted sender) Received: from [209.85.212.53] (HELO mail-vb0-f53.google.com) (209.85.212.53) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 10 Sep 2013 04:02:45 +0000 Received: by mail-vb0-f53.google.com with SMTP id i3so4487596vbh.26 for ; Mon, 09 Sep 2013 21:02:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=Ctb0jTVDjhFOCbwUDkFxNlvNv6RaXFHhOysELa4yVls=; b=M74LssRUN6WV7WhXvJUr3UlpUC5JE6BijnahHG/OSih8kcxL7Yda91JjTwnnj6ZYXk fZOKUIB2cG6pFf1foMSop0vbhwhnxlxByzfaTjrV2vHYCzTPSvPhnd9forPsXF4RVtqc gUPwJrLrJvgz12ex4omuLBK7IvHDfuzOSV6+mNLmqL9+3Cfro0vi4Zq9oknuVSuZ4ZJ6 LVdI3BL+hxyisTz3NgWZTFOpKcIxjuQJtDuFC7MOP103APZfjYs3NOLCnkb8Ueulwi41 7PF5DHkybL0gXiNvNT/Sws1Ad8euVKWNwVqJBWsx4LteR/Wlqof33v8UQ/FoSRSiA06e MZQQ== MIME-Version: 1.0 X-Received: by 10.59.8.232 with SMTP id dn8mr20542455ved.8.1378785744487; Mon, 09 Sep 2013 21:02:24 -0700 (PDT) Received: by 10.220.7.140 with HTTP; Mon, 9 Sep 2013 21:02:24 -0700 (PDT) Date: Mon, 9 Sep 2013 21:02:24 -0700 Message-ID: Subject: Tables gets Major Compacted even if they haven't changed From: Premal Shah To: user Content-Type: multipart/alternative; boundary=047d7bd75d5c85b80504e5ff92de X-Virus-Checked: Checked by ClamAV on apache.org --047d7bd75d5c85b80504e5ff92de Content-Type: text/plain; charset=ISO-8859-1 Hi, We have a bunch on tables in our HBase cluster. We have a script which makes sure all of them get Major Compacted once every 2 days. There are 2 things I'm observing 1) Table X has not updated in a month. We have not inserted, updated or deleted data. However, it still major compacts every 2 days. All the regions in this table have only 1 store file. 2) Table Y has a few regions where the rowkey is essentially a timestamp. So, we only write to 1 region at a time. Over time, the region splits, and then we write the one of the split regions. Now, whenever we major compact the table, all regions get major compacted. Only 1 region has more than 1 store file, every other region has exactly once. Is there a way to avoid compaction of regions that have not changed? We are using HBase 0.94.11 -- Regards, Premal Shah. --047d7bd75d5c85b80504e5ff92de--