hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-11702) Better introspection of long running compactions
Date Mon, 11 Aug 2014 23:26:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093494#comment-14093494
] 

Andrew Purtell edited comment on HBASE-11702 at 8/11/14 11:25 PM:
------------------------------------------------------------------

Attached patch produces output like:

{noformat}
2014-08-11 16:20:59,739 DEBUG [regionserver8120-smallCompactions-1407799153313]
compactions.Compactor: Compaction progress: 1441233/2197437 (65.59%),
rate=322.72 kB/sec
{noformat}

Status logging code is only active if DEBUG log level is enabled, and will only print once
per minute per compactor thread.


was (Author: apurtell):
Attached patch produces output like:

{noformat}
2014-08-11 16:20:59,739 DEBUG [regionserver8120-smallCompactions-1407799153313] compactions.Compactor:
Compaction progress: 1441233/2197437 (65.59%), rate=322.72 kB/sec
{noformat}

Status logging code is only active if DEBUG log level is enabled, and will only print once
per minute per compactor thread.

> Better introspection of long running compactions
> ------------------------------------------------
>
>                 Key: HBASE-11702
>                 URL: https://issues.apache.org/jira/browse/HBASE-11702
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>             Fix For: 0.99.0, 2.0.0, 0.98.6
>
>         Attachments: HBASE-11702.patch
>
>
> For better introspection of long running compactions, periodically print compaction progress
for a file at DEBUG level (thread name, file path, total compacted KVs, total compacted bytes,
completion percent, rate) and expose regionserver wide compaction metrics (KVs compacted and
bytes compacted) as Hadoop value metrics.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message