Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3308DB9F7 for ; Thu, 12 Jan 2012 19:04:07 +0000 (UTC) Received: (qmail 71703 invoked by uid 500); 12 Jan 2012 19:04:05 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 71630 invoked by uid 500); 12 Jan 2012 19:04:04 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 71616 invoked by uid 99); 12 Jan 2012 19:04:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jan 2012 19:04:03 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ivarley@salesforce.com designates 64.18.3.36 as permitted sender) Received: from [64.18.3.36] (HELO exprod8og118.obsmtp.com) (64.18.3.36) by apache.org (qpsmtpd/0.29) with SMTP; Thu, 12 Jan 2012 19:03:56 +0000 Received: from exsfm-hub5.internal.salesforce.com ([204.14.239.233]) by exprod8ob118.postini.com ([64.18.7.12]) with SMTP ID DSNKTw8uhl9wJj0jXI4aSAVgrmEj6cn2PBPI@postini.com; Thu, 12 Jan 2012 11:03:35 PST Received: from EXSFM-MB01.internal.salesforce.com ([10.1.127.45]) by exsfm-hub5.internal.salesforce.com ([10.1.127.5]) with mapi; Thu, 12 Jan 2012 11:03:34 -0800 From: Ian Varley To: "user@hbase.apache.org" Date: Thu, 12 Jan 2012 11:03:33 -0800 Subject: Re: does increasing region filesize followed by major compactions supposed to reduce number of regions? Thread-Topic: does increasing region filesize followed by major compactions supposed to reduce number of regions? Thread-Index: AczRXOFdxsksprMfTqe8rRJwVMdzJA== Message-ID: <3A61B61E-FDC1-4DC4-B069-DBE7A447995A@salesforce.com> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_3A61B61EFDC14DC4B069DBE7A447995Asalesforcecom_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_3A61B61EFDC14DC4B069DBE7A447995Asalesforcecom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Vinod, The answers to your questions (and so many more!) are easily found in the H= Base Reference Guide: http://hbase.apache.org/book.html#schema.versions "Excess versions are removed during major compactions." - Ian "Doug Meil" Varley ;) On Jan 12, 2012, at 10:59 AM, T Vinod Gupta wrote: Thanks ill take a look.. meanwhile, i just decreased the versions for my column families from 3 to 1 and triggered another compaction. does this make hbase delete the previous versions and keep only the latest one? thanks On Thu, Jan 12, 2012 at 10:57 AM, kisalay > wrote: Vinod, U will have to do merge of the regions after the major compact to decrease the number of regions that you have. You can do either an online or an offline merge. You can pickup the online merge jruby script from the jira https://issues.apache.org/jira/browse/HBASE-1621 ~Kisalay On Fri, Jan 13, 2012 at 12:13 AM, T Vinod Gupta wrote: so there is no way to make the regions merge since they are much below region max size? On Thu, Jan 12, 2012 at 10:40 AM, Doug Meil >wrote: Major compactions don't change the number of regions. On 1/12/12 1:35 PM, "T Vinod Gupta" > wrote: this is probably a rookie question. but my understanding is that if i increase the region max file size and then initiate major compaction manually, the number of regions should ideally go down by the factor by which i increased the region max file size. isn't that true? im not seeing that happening. ofcourse, my compaction is still underway - so i don't know if ill see region count decrease at the very end of it. major compaction does do region merging right? thanks --_000_3A61B61EFDC14DC4B069DBE7A447995Asalesforcecom_--