carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-382) Like Filter Query Optimization for Dictionary Columns
Date Fri, 04 Nov 2016 17:58:59 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637174#comment-15637174
] 

ASF GitHub Bot commented on CARBONDATA-382:
-------------------------------------------

GitHub user sujith71955 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/296

    [CARBONDATA-382]Like Filter Query Optimization for Dictionary Columns

    **Like Filter Query Optimization for Dictionary Columns**
    a) Added pushdown mechanism for the Like filters like startsWith,endsWith and contains
so that the respective filters will be processed in Carbon layer itself.
    b) This mechanism can provide significant gain in the performance of Like filter queries
applied in the dictionary since block and blocklet level pruning will be done in the carbon
layer before applying the filters in dictionary columns.
    c) Since three new expressions has been added in carbon layer the carbon will be applying
the expression only once for startsWith/endsWith/contains filter query, this will make the
dictionary lookup also once for applying the Like expression.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sujith71955/incubator-carbondata master_filterstartswith

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/296.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #296
    
----
commit 608906a25afc2bbabecfdd3c7bfa1351e83de9a0
Author: sujith71955 <sujithchacko.2010@gmail.com>
Date:   2016-11-04T17:36:18Z

    [CARBONDATA-382]Like Filter Query Optimization for Dictionary Columns

----


> Like Filter Query Optimization for Dictionary Columns
> -----------------------------------------------------
>
>                 Key: CARBONDATA-382
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-382
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Sujith
>            Assignee: Sujith
>
> Like Filter Query Optimization for Dictionary Columns
> a) Added pushdown mechanism for the Like filters like startsWith,endsWith and contains
so that the respective filters will be processed in Carbon layer itself.
> b) This mechanism can provide significant gain in the performance of Like filter queries
applied in the dictionary since block and blocklet level pruning  will be done in the carbon
layer before applying the filter.
> c) Since three new expressions has been added in carbon layer the carbon will be applying
the expression only once for startsWith/endsWith/contains filter query, this will make the
dictionary lookup also once for applying the expression.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message