Mailing-List: contact hbase-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Message-ID: <1939160063.24631270770396600.JavaMail.jira@brutus.apache.org>
Date: Thu, 8 Apr 2010 23:46:36 +0000 (UTC)
From: "Jean-Daniel Cryans (JIRA)" <jira@apache.org>
To: hbase-issues@hadoop.apache.org
Subject: [jira] Updated: (HBASE-2346) Usage of FilterList slows down scans
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HBASE-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Daniel Cryans updated HBASE-2346:
--------------------------------------

    Attachment: HBASE-2346.patch

Creating a Configuration is super expensive, so this patch reuses the same static object. Discussing with Stack, we don't think there's any impact (apart from better speed). Here's the numbers I get from running the test with the patch:

{code}

Scan Null Filter (0): 123ms
Scan FilterList with Null Filter (0): 359ms
Scan Nested FilterList with Null Filter (0): 296ms
Scan Nested Nested FilterList with Null Filter (0): 293ms

Scan SingleColumValueFilter Equal (0): 124ms
Scan FilterList with SingleColumValueFilter Equal (0): 169ms
Scan Nested FilterList with SingleColumValueFilter Equal (0): 129ms
Scan Nested Nested FilterList with SingleColumValueFilter Equal (0): 126ms

Scan SingleColumValueFilter Not Equal (0): 136ms
Scan FilterList with SingleColumValueFilter Not Equal (0): 117ms
Scan Nested FilterList with SingleColumValueFilter Not Equal (0): 128ms
Scan Nested Nested FilterList with SingleColumValueFilter Not Equal (0): 207ms

Scan PrefixFilter (0): 155ms
Scan FilterList with PrefixFilter (0): 117ms
Scan Nested FilterList with PrefixFilter (0): 136ms
Scan Nested Nested FilterList with PrefixFilter (0): 106ms

Get: 440ms
{code}

> Usage of FilterList slows down scans
> ------------------------------------
>
>                 Key: HBASE-2346
>                 URL: https://issues.apache.org/jira/browse/HBASE-2346
>             Project: Hadoop HBase
>          Issue Type: Bug
>          Components: filters
>    Affects Versions: 0.20.3
>         Environment: Ubuntu 9.10
> Sund JDK 1.6.0_16
> HBase 0.20.3 (standalone and pseudo-distributed)
>            Reporter: Stefan Seelmann
>             Fix For: 0.20.4, 0.21.0
>
>         Attachments: HBASE-2346.patch, ScanFilterTest.java
>
>
> When using a FilterList the scan is much slower compared to a scan with only a single filter (tested SingleColumnValueFilter and PrefixFilter).
> The difference is extrem for very small ranges: if the range is only 10 rows the scan is 10 times slower when using the FilterList.
> Is the cause just GC or object serialization/deserialization?
> For a simple test I used the PerformanceEvaluation tool and created the TestTable with only 10(!) rows:
> $ bin/hbase org.apache.hadoop.hbase.PerformanceEvaluation --rows=10 sequentialWrite 1
> The attached test performs 100 scan using diffent filters. The filter is then wrapped into a FilterList (with only a single filter). This FilterList is then nested two more times into another FilterList. For each nested level the scan gets slower and slower.
> The test created the following output:
> Scan Null Filter (10): 391ms
> Scan FilterList with Null Filter (0): 4788ms
> Scan Nested FilterList with Null Filter (0): 8303ms
> Scan Nested Nested FilterList with Null Filter (0): 11915ms
> Scan SingleColumValueFilter Equal (0): 257ms
> Scan FilterList with SingleColumValueFilter Equal (0): 4121ms
> Scan Nested FilterList with SingleColumValueFilter Equal (0): 7965ms
> Scan Nested Nested FilterList with SingleColumValueFilter Equal (0): 11600ms
> Scan SingleColumValueFilter Not Equal (10): 912ms
> Scan FilterList with SingleColumValueFilter Not Equal (10): 4542ms
> Scan Nested FilterList with SingleColumValueFilter Not Equal (10): 8459ms
> Scan Nested Nested FilterList with SingleColumValueFilter Not Equal (10): 11513ms
> Scan PrefixFilter (10): 306ms
> Scan FilterList with PrefixFilter (10): 3695ms
> Scan Nested FilterList with PrefixFilter (10): 7762ms
> Scan Nested Nested FilterList with PrefixFilter (10): 11721ms
> Get: 245ms

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.