hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16091) Canary takes lot more time when there are delete markers in the table
Date Tue, 05 Jul 2016 21:57:11 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363336#comment-15363336

Hudson commented on HBASE-16091:

SUCCESS: Integrated in HBase-1.4 #272 (See [https://builds.apache.org/job/HBase-1.4/272/])
HBASE-16091 Canary takes lot more time when there are delete markers in (apurtell: rev 8efc6148b9ccaa29d2608d1d7348d0d3c5d8158d)
* hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestCanaryTool.java
* hbase-common/src/main/java/org/apache/hadoop/hbase/HConstants.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/tool/Canary.java

> Canary takes lot more time when there are delete markers in the table
> ---------------------------------------------------------------------
>                 Key: HBASE-16091
>                 URL: https://issues.apache.org/jira/browse/HBASE-16091
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Vishal Khandelwal
>            Assignee: Vishal Khandelwal
>             Fix For: 2.0.0, 1.4.0, 0.98.21
>         Attachments: HBASE-16091.00.patch, HBASE-16091.01.patch, HBASE-16091.02.patch
> We have a table which has lot of delete markers and we running Canary test on a regular
interval sometimes tests are timing out because to reading first row would skip all these
delete markers. Since purpose of Canary is to find health of the region, i think keeping raw=true
would not defeat the purpose but provide good perf improvement. 
> Following are the example of one such scan where 
> without changing code it took 62.3 sec for onre region scan
> 2016-06-23 08:49:11,670 INFO  [pool-2-thread-1] tool.Canary - read from region  <tablename>.<region>
column family 0 in 62338ms
> whereas after setting raw=true, it reduced to 58ms
> 2016-06-23 08:45:20,259 INFO  [pool-2-thread-1] tests.Canary - read from region <tablename>.<region>
column family 0 in 58ms
> Taking this over multiple tables , with multiple region would be a good performance gain.

This message was sent by Atlassian JIRA

View raw message