hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12424) Finer grained logging and metrics for split transactions
Date Fri, 07 Nov 2014 22:21:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202819#comment-14202819

Hudson commented on HBASE-12424:

SUCCESS: Integrated in HBase-TRUNK #5754 (See [https://builds.apache.org/job/HBase-TRUNK/5754/])
HBASE-12424 Finer grained logging and metrics for split transactions (apurtell: rev 7718390703fb3c193ea58d5287250e14002e9852)
* hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitRequest.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionCoprocessorHost.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
* hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java

> Finer grained logging and metrics for split transactions
> --------------------------------------------------------
>                 Key: HBASE-12424
>                 URL: https://issues.apache.org/jira/browse/HBASE-12424
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>             Fix For: 2.0.0, 0.98.8, 0.99.2
>         Attachments: 0001-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch,
0002-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch, 0003-HBASE-12424-Finer-grained-logging-and-metrics-for-sp.patch,
HBASE-12424-0.98.patch, HBASE-12424.patch, HBASE-12424.patch, HBASE-12424.patch, HowHBaseRegionSplitsareImplemented.pdf
> A split transaction is a complex orchestration of activity between the RegionServer,
Master, ZooKeeper, and HDFS NameNode. We have some visibility into the time taken by various
phases of the split transaction in the logs. We will see "Starting split of region $PARENT"
before the transaction begins, before the parent is offlined. Later we will see "Opening $DAUGHTER"
as one of the last steps in the transaction, this is after the parent has been flushed, offlined,
and closed. Finally ""Region split, hbase:meta updated, and report to master ... Split took
$TIME" after all steps are complete and including the total running time of the transaction.

> For debugging the cause(s) of long running split transactions it would be useful to know
the distribution of time spent in all of the phases of the split transaction. 

This message was sent by Atlassian JIRA

View raw message