Return-Path: Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: (qmail 89923 invoked from network); 4 Mar 2011 02:57:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Mar 2011 02:57:19 -0000 Received: (qmail 35271 invoked by uid 500); 4 Mar 2011 02:57:19 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 35234 invoked by uid 500); 4 Mar 2011 02:57:18 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 35198 invoked by uid 99); 4 Mar 2011 02:57:18 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Mar 2011 02:57:18 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Mar 2011 02:57:18 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 5DDDB4ECDA for ; Fri, 4 Mar 2011 02:56:38 +0000 (UTC) Date: Fri, 4 Mar 2011 02:56:38 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: <1317477982.12847.1299207398381.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1464689894.11968.1298499278602.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] Commented: (HBASE-3559) Move report of split to master OFF the heartbeat channel MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002422#comment-13002422 ] Hudson commented on HBASE-3559: ------------------------------- Integrated in HBase-TRUNK #1767 (See [https://hudson.apache.org/hudson/job/HBase-TRUNK/1767/]) > Move report of split to master OFF the heartbeat channel > -------------------------------------------------------- > > Key: HBASE-3559 > URL: https://issues.apache.org/jira/browse/HBASE-3559 > Project: HBase > Issue Type: Task > Reporter: stack > Assignee: stack > Attachments: 3559-v3.txt, 3559.txt > > > The heartbeat in hbase is about to go away. See hbase-1502. This issue is about moving the report of a split region off the heartbeat channel. This work needs to be done before I can finish up hbase-1502. > Here is a provisional 'design' for how report of split to master will now work. > Instead of riding a split message on the regionserver to master heartbeat, the regionserver will put up a znode under (the badly named) 'unassigned' directory; i.e. the regionserver will put the region into 'transition' (RIT). Usually the master does all RIT machinations. Splits will be an exception. > The regionserver will move the znode through two states: SPLITTING and SPLIT. The master will clean up the SPLIT znode on receipt of child changed callback. > There will be no extra data in the SPLITTING znode beyond the SPLITTING state name. The SPLIT znode will contain the name of the split daughters. > Any region in RIT will block the balancer running. This could be an issue if lots of splits going on across a cluster. > Master will need to handle new SPLIT and SPLITTING states and that another may have already written the RIT (unit tests). > As before, regionserver figures region to split and runs CompactSplitThread#split. As before, this invokes SplitTransaction with its prepare, execute and when necessary rollback phase. Into the execute we'll add the setting of SPLITTING znode into RIT. The execution will end with setting the SPLIT znode state. Master will read and clear the SPLIT state when done. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira