Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 02A9C17919 for ; Sat, 8 Nov 2014 09:55:35 +0000 (UTC) Received: (qmail 97663 invoked by uid 500); 8 Nov 2014 09:55:34 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 97616 invoked by uid 500); 8 Nov 2014 09:55:34 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 97605 invoked by uid 99); 8 Nov 2014 09:55:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 08 Nov 2014 09:55:34 +0000 Date: Sat, 8 Nov 2014 09:55:34 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-12424) Finer grained logging and metrics for split transactions MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203350#comment-14203350 ] Hudson commented on HBASE-12424: -------------------------------- SUCCESS: Integrated in HBase-0.98 #666 (See [https://builds.apache.org/job/HBase-0.98/666/]) Amend HBASE-12424 Finer grained logging and metrics for split transactions; Hadoop 1 build fixes (apurtell: rev 25bc762ba6f058e7e76ae9134f3e4f637db044b1) * hbase-hadoop1-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java * hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitRequest.java * hbase-common/src/main/java/org/apache/hadoop/hbase/util/Strings.java > Finer grained logging and metrics for split transactions > -------------------------------------------------------- > > Key: HBASE-12424 > URL: https://issues.apache.org/jira/browse/HBASE-12424 > Project: HBase > Issue Type: Improvement > Reporter: Andrew Purtell > Assignee: Andrew Purtell > Fix For: 2.0.0, 0.98.8, 0.99.2 > > Attachments: 0001-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch, 0002-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch, 0003-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch, HBASE-12424-0.98.patch, HBASE-12424-addendum.patch, HBASE-12424.patch, HBASE-12424.patch, HBASE-12424.patch, HowHBaseRegionSplitsareImplemented.pdf > > > A split transaction is a complex orchestration of activity between the RegionServer, Master, ZooKeeper, and HDFS NameNode. We have some visibility into the time taken by various phases of the split transaction in the logs. We will see "Starting split of region $PARENT" before the transaction begins, before the parent is offlined. Later we will see "Opening $DAUGHTER" as one of the last steps in the transaction, this is after the parent has been flushed, offlined, and closed. Finally ""Region split, hbase:meta updated, and report to master ... Split took $TIME" after all steps are complete and including the total running time of the transaction. > For debugging the cause(s) of long running split transactions it would be useful to know the distribution of time spent in all of the phases of the split transaction. -- This message was sent by Atlassian JIRA (v6.3.4#6332)