hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12040) Performances issues with FilteredScanTest
Date Sun, 28 Sep 2014 15:09:34 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151121#comment-14151121
] 

stack commented on HBASE-12040:
-------------------------------

No worries [~jmspaggi] Thanks for doing these tests.  Lets see how your reruns do.  If close
enough, we can close this and instead take on a more extensive perf compare JIRA.  We need
to do it before 1.0 release.  These tests are a bit small.  1M and one client.  We should
probably do larger scale tests.

Here is from the commit just before 11331.  It looks like between this point and the 0.99.0,
we lost some randomread perf (thanks against [~jmspaggi] for getting us to dig in here) while
filteredScan was slower back then.  Let me try and get more detail on why.

{code}
099.before.filterscan.txt:2014-09-27 22:08:55,251 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 250721ms over 100 rows
099.before.filterscan.txt:2014-09-27 22:13:07,068 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 247603ms over 100 rows
099.before.filterscan.txt:2014-09-27 22:17:18,743 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 247378ms over 100 rows
099.before.filterscan.txt:2014-09-27 22:21:30,468 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 247487ms over 100 rows
099.before.filterscan.txt:2014-09-27 22:25:42,518 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 247838ms over 100 rows
099.before.randomread.txt:2014-09-27 22:34:07,019 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 412051ms over 1048576 rows
099.before.randomread.txt:2014-09-27 22:41:21,056 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 429792ms over 1048576 rows
099.before.randomread.txt:2014-09-27 22:47:37,499 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 372189ms over 1048576 rows
099.before.randomread.txt:2014-09-27 22:54:33,021 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 411320ms over 1048576 rows
099.before.randomread.txt:2014-09-27 23:01:36,469 INFO  [TestClient-0] hbase.PerformanceEvaluation:
Finished in 419260ms over 1048576 rows
{code}

> Performances issues with FilteredScanTest 
> ------------------------------------------
>
>                 Key: HBASE-12040
>                 URL: https://issues.apache.org/jira/browse/HBASE-12040
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.99.1
>            Reporter: Jean-Marc Spaggiari
>            Assignee: stack
>            Priority: Critical
>             Fix For: 0.98.7, 0.99.1
>
>         Attachments: at-HBASE-11331.html, pre-HBASE-11331.html
>
>
> While testing 0.99.0RC1 release performances, compared to 0.98.6, figured that:
> - FilteredScanTest is 100 times slower;
> - RandomReadTest is 1.5 times slower;
> - RandomSeekScanTest is 3.2 times slower;
> - RandomScanWithRange10Test is 1,2 times slower;
> - RandomScanWithRange100Test is 1,3 times slower;
> - RandomScanWithRange1000Test is 4 times slower;
> - SequentialReadTest is 1,7 times slower;
> - SequentialWriteTest is just a bit faster;
> - RandomWriteTest	 is just a bit faster;
> - GaussianRandomReadBenchmark is just a beat slower;
> - SequentialReadBenchmark is 1,1 times slower;
> - SequentialWriteBenchmark is 1,1 times slower;
> - UniformRandomReadBenchmark crashed;
> - UniformRandomSmallScan is 1,3 times slower.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message