hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11979) Compaction progress reporting is wrong
Date Thu, 04 Dec 2014 01:33:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233777#comment-14233777
] 

Andrew Purtell commented on HBASE-11979:
----------------------------------------

[~esteban], for the short term we could simply disable where we report compaction progress
in logs and on the UI, but keep the metrics even if broken because someone might be using
them - until estimation is improved. That wouldn't be necessary if a better fix is at hand,
but if not, let's do something smaller and resolve this.

> Compaction progress reporting is wrong
> --------------------------------------
>
>                 Key: HBASE-11979
>                 URL: https://issues.apache.org/jira/browse/HBASE-11979
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Andrew Purtell
>            Assignee: Esteban Gutierrez
>            Priority: Minor
>             Fix For: 1.0.0, 2.0.0, 0.98.9
>
>
> This is a long standing problem and previously could be observed in regionserver metrics,
but, we recently added logging for long running compactions, and this has exposed the issue
in a new way, e.g.
> {noformat}
> 2014-09-15 14:20:59,450 DEBUG [regionserver8120-largeCompactions-1410813534627]
> compactions.Compactor: Compaction progress: 22683625/6808179 (333.18%), rate=162.08 kB/sec
> {noformat}
> The 'rate' reported in such logging is consistent and what we were really after, but
the progress indication is clearly broken and should be fixed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message