hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-13448) New Cell implementation with cached component offsets/lengths
Date Tue, 16 Jun 2015 12:51:01 GMT

     [ https://issues.apache.org/jira/browse/HBASE-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Anoop Sam John updated HBASE-13448:
    Attachment: HBASE-13448_V4.patch

Running PE test with scanRange10000 and rows set to 1000. Have 20 client threads.  So every
thread scanning 10K rows(cells) 1000 times. ie. Every thread doing 10 million cells read.
All cells are filtered using '--filterAll' option. All data is in L1 cache.
I have repeated this PE run for 5 times and taking avg of each threads avg total run time
(for 10 million cells)

Master - 17132.6
With patch - 15958.4

This mean a redution of ~7% in latency with patch.

Detailed thread timings
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 16529ms   
Max: 17617ms    Avg: 17331ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 16646ms   
Max: 17628ms    Avg: 17245ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 16346ms   
Max: 17193ms    Avg: 16902ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 16473ms   
Max: 17473ms    Avg: 17144ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 16396ms   
Max: 17382ms    Avg: 17041ms

With patch
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 15224ms   
Max: 16294ms    Avg: 15984ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 15048ms   
Max: 16334ms    Avg: 15908ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 15409ms   
Max: 16216ms    Avg: 15946ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 15574ms   
Max: 16402ms    Avg: 16118ms
[main] hbase.PerformanceEvaluation: [RandomScanWithRange10000Test]        Min: 15380ms   
Max: 16090ms    Avg: 15836ms

> New Cell implementation with cached component offsets/lengths
> -------------------------------------------------------------
>                 Key: HBASE-13448
>                 URL: https://issues.apache.org/jira/browse/HBASE-13448
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Scanners
>            Reporter: Anoop Sam John
>            Assignee: Anoop Sam John
>             Fix For: 2.0.0
>         Attachments: 13448-0.98.txt, HBASE-13448.patch, HBASE-13448_V2.patch, HBASE-13448_V3.patch,
HBASE-13448_V4.patch, gc.png, hits.png
> This can be extension to KeyValue and can be instantiated and used in read path.

This message was sent by Atlassian JIRA

View raw message