hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-12040) Performances issues with FilteredScanTest
Date Tue, 30 Sep 2014 18:03:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14153469#comment-14153469
] 

Andrew Purtell edited comment on HBASE-12040 at 9/30/14 6:03 PM:
-----------------------------------------------------------------

Separate processes for NN, DN, ZK, HMaster, RS, HDFS 2.4.0, SCR enabled, 1 SSD. RS running
with 4 GB heap and LruBlockCache.

Setup: {{./bin/hbase pe -nomapred -compress=SNAPPY -presplit=10 sequentialWrite 1}} (-size
not available in 0.98 PE)

Run: Stop and start the RS. Then: {{sync; echo 3 | sudo tee /proc/sys/vm/drop_caches ; ./bin/hbase
pe -nomapred scanRange100 1}}

{noformat}
c220be9 [3 days ago] (HEAD, 0.98) HBASE-12110 Fix .arcconfig [Elliott Clark]
	hbase.PerformanceEvaluation: Finished TestClient-0 in 1296699ms over 1048576 rows

3645223 [4 weeks ago] (tag: 0.98.6RC2, tag: 0.98.6) Update CHANGES.txt for 0.98.
	hbase.PerformanceEvaluation: Finished TestClient-0 in 1316509ms over 1048576 row
{noformat}

Not enough data?

Let me create a table with 10x the number of rows.

Edit: Fix formatting


was (Author: apurtell):
Separate processes for NN, DN, ZK, HMaster, RS, HDFS 2.4.0, SCR enabled, 1 SSD. RS running
with 4 GB heap and LruBlockCache.

Setup: ./bin/hbase pe --nomapred --compress=SNAPPY --presplit=10 sequentialWrite 1 (--size
not available in 0.98 PE)

Run: Stop and start the RS. Then: sync; echo 3 | sudo tee /proc/sys/vm/drop_caches ; ./bin/hbase
pe --nomapred scanRange100 1

c220be9 [3 days ago] (HEAD, 0.98) HBASE-12110 Fix .arcconfig [Elliott Clark]
	hbase.PerformanceEvaluation: Finished TestClient-0 in 1296699ms over 1048576 rows

3645223 [4 weeks ago] (tag: 0.98.6RC2, tag: 0.98.6) Update CHANGES.txt for 0.98.
	hbase.PerformanceEvaluation: Finished TestClient-0 in 1316509ms over 1048576 row

Not enough data?

Let me create a table with 10x the number of rows.

> Performances issues with FilteredScanTest 
> ------------------------------------------
>
>                 Key: HBASE-12040
>                 URL: https://issues.apache.org/jira/browse/HBASE-12040
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.99.1
>            Reporter: Jean-Marc Spaggiari
>            Priority: Critical
>         Attachments: at-HBASE-11331.html, pre-HBASE-11331.html, ycsb-0.98.6.1-vs-0.98.7.pdf
>
>
> While testing 0.99.0RC1 release performances, compared to 0.98.6, figured that:
> - FilteredScanTest is 100 times slower;
> - RandomReadTest is 1.5 times slower;
> - RandomSeekScanTest is 3.2 times slower;
> - RandomScanWithRange10Test is 1,2 times slower;
> - RandomScanWithRange100Test is 1,3 times slower;
> - RandomScanWithRange1000Test is 4 times slower;
> - SequentialReadTest is 1,7 times slower;
> - SequentialWriteTest is just a bit faster;
> - RandomWriteTest	 is just a bit faster;
> - GaussianRandomReadBenchmark is just a beat slower;
> - SequentialReadBenchmark is 1,1 times slower;
> - SequentialWriteBenchmark is 1,1 times slower;
> - UniformRandomReadBenchmark crashed;
> - UniformRandomSmallScan is 1,3 times slower.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message