hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Marc Spaggiari (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12040) Performances issues with FilteredScanTest
Date Sun, 28 Sep 2014 12:50:33 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151101#comment-14151101
] 

Jean-Marc Spaggiari commented on HBASE-12040:
---------------------------------------------

Ok. Stop spending to much time on that.

I retried few branches last night and figured that at some point, the SequentialWrite because
mapred by default and was --nomapred before.

However, in mapred mode it failed because it looks for the build jars to be in HDFS but is
stacktrace is lost into the gigantic log file where I just search for the "Finished" lines...

So sound like some FilteredScanTest are running against an empty table while some other are
running against a full table.

I will update the SequentialWrite part of the script and update my numbers for the 10 last
releases (At least up to where this mapred default value changed) I have tested, update the
numbers and report back here. I changed the priority as I have good suspucions that it's coming
from here and should not be a blocker anymore...

If that's the case, I'm very sorry about that!

> Performances issues with FilteredScanTest 
> ------------------------------------------
>
>                 Key: HBASE-12040
>                 URL: https://issues.apache.org/jira/browse/HBASE-12040
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.99.1
>            Reporter: Jean-Marc Spaggiari
>            Assignee: stack
>            Priority: Critical
>             Fix For: 0.98.7, 0.99.1
>
>         Attachments: at-HBASE-11331.html, pre-HBASE-11331.html
>
>
> While testing 0.99.0RC1 release performances, compared to 0.98.6, figured that:
> - FilteredScanTest is 100 times slower;
> - RandomReadTest is 1.5 times slower;
> - RandomSeekScanTest is 3.2 times slower;
> - RandomScanWithRange10Test is 1,2 times slower;
> - RandomScanWithRange100Test is 1,3 times slower;
> - RandomScanWithRange1000Test is 4 times slower;
> - SequentialReadTest is 1,7 times slower;
> - SequentialWriteTest is just a bit faster;
> - RandomWriteTest	 is just a bit faster;
> - GaussianRandomReadBenchmark is just a beat slower;
> - SequentialReadBenchmark is 1,1 times slower;
> - SequentialWriteBenchmark is 1,1 times slower;
> - UniformRandomReadBenchmark crashed;
> - UniformRandomSmallScan is 1,3 times slower.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message