Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@locus.apache.org Received: (qmail 63470 invoked from network); 29 May 2008 19:04:10 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 29 May 2008 19:04:10 -0000 Received: (qmail 75707 invoked by uid 500); 29 May 2008 19:04:11 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 75663 invoked by uid 500); 29 May 2008 19:04:11 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 75622 invoked by uid 99); 29 May 2008 19:04:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 May 2008 12:04:11 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 29 May 2008 19:03:23 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 110BF234C12F for ; Thu, 29 May 2008 12:03:45 -0700 (PDT) Message-ID: <2061526825.1212087825068.JavaMail.jira@brutus> Date: Thu, 29 May 2008 12:03:45 -0700 (PDT) From: "Jean-Daniel Cryans (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Commented: (HBASE-533) Region Historian In-Reply-To: <627389295.1205969907421.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12600883#action_12600883 ] Jean-Daniel Cryans commented on HBASE-533: ------------------------------------------ bq. Lets get the migration added before we apply? Unless you want to do that as separate task. If so, open new issue and I'll commit this. Yes, before. bq. Does the region run merges? You should add flush. Do you mean RegionServer in the above rather than Regions? package region bq. There are no creations any more. Is that because happens elsewhere - in parent? - so doesn't show in a particular region. There is, look at a region that was created with a table. Regions that are created from a split don't pass by HRegion.createHRegion. Rebooting your cluster will also put creations in all regions. I'm OK with the rest. > Region Historian > ---------------- > > Key: HBASE-533 > URL: https://issues.apache.org/jira/browse/HBASE-533 > Project: Hadoop HBase > Issue Type: Wish > Reporter: Bryan Duxbury > Assignee: Jean-Daniel Cryans > Priority: Minor > Attachments: hbase-533-v1-fix.patch, hbase-533-v1.patch, hbase-533-v2.patch > > > Whenever we try to debug region splitting, assignment, compaction, etc. issues, we always end up having to look in 1-20 different log files for cryptic names of regions and try to piece together the chain of events ourselves. This is a challenging at best effort most of the time. > What would be very useful would be a new utility I've nicknamed the Region Historian. You give it the text name of a region, and it will track down the log messages relevant to it in the master and regionserver logs. Then, it will interleave the messages in such a way that the timestamps correctly list the order of events. The result is a log summary that accurately describes what happened to a region during it's lifetime, making it much easier to try and figure out where something went wrong. > Other things it could do would be replace cryptic log messages with simple events like "the region was split into a and b", "the region was assigned to server x", and trace the lineage of a region backwards to its parent before it came into existence. > I'm sure there are other things we would think up that would be useful as well. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.