Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@locus.apache.org Received: (qmail 25494 invoked from network); 2 Oct 2008 22:04:05 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 2 Oct 2008 22:04:05 -0000 Received: (qmail 92775 invoked by uid 500); 2 Oct 2008 22:04:03 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 92756 invoked by uid 500); 2 Oct 2008 22:04:03 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 92742 invoked by uid 99); 2 Oct 2008 22:04:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Oct 2008 15:04:03 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Oct 2008 22:03:09 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 3EEF0234C215 for ; Thu, 2 Oct 2008 15:03:44 -0700 (PDT) Message-ID: <707805962.1222985024256.JavaMail.jira@brutus> Date: Thu, 2 Oct 2008 15:03:44 -0700 (PDT) From: "Andrew Purtell (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-902) Add force major compaction and force split to UI In-Reply-To: <950836415.1222407824377.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636482#action_12636482 ] Andrew Purtell commented on HBASE-902: -------------------------------------- HStore has a reference to its HRI but not to the HRegion. Instead of using HRI I could just convert the reference that HStore has to the region to HRegion and fix up the affected code. Don't know about metautils. If a HStore still holds references, the split request will be ignored. The only thing the "force split' request does differently is ask that the HStore max file size be effectively considered to be 1. If the regionserver is already part way into the split, it should be ignored also but I'll double check this. compactSplitThread and children should handle the case already. If not they should. > Add force major compaction and force split to UI > ------------------------------------------------ > > Key: HBASE-902 > URL: https://issues.apache.org/jira/browse/HBASE-902 > Project: Hadoop HBase > Issue Type: Improvement > Reporter: stack > Assignee: Andrew Purtell > Attachments: 902-1.patch > > > Would help debugging or at start of big upload or if we have a hot region we want to distribute over the cluster if we could just manually force the splitting of regions. > I thought it would be just a little messing in jsp but its a bit more than that. > Actual decision to split is made down in guts of the Store. Won't split if any references still around and a file must be > maxsize. > Chatting w/ Jon Gray, could set a flag on the region that we want to split. Could do this from UI (Can get to HRegion instance from HRS instance in HRS jsp). Stores have references to their hosting regions (I think). When figuring if we're to split, check the force split flag up in the hosting region. > To get the flag checked, safest way is to just force a flush (Otherwise, have to mess w/ locks in the compact/splitter thread). Registering a flush request on a region is easy enough to do. Its a public method on HRS (or HR). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.