carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sounakr <>
Subject [GitHub] incubator-carbondata pull request #878: Like Filter Pushdown
Date Thu, 04 May 2017 10:34:50 GMT
GitHub user sounakr opened a pull request:

    Like Filter Pushdown

    Problem : Like filter Pushdown.
    Analysis : Filter Predicates with Like expression are converted to StartWith or EndsWith
expression in spark. But the expression with StartsWith can be converted to LessThan and GreaterThan
Expression which can furthur boil down to Range Filter Optimization. 
    For e.g. 
    select * from t1 where empid like '1%';
    spark filter => StartsWith(empid, '1')
    carbon filter => empid GreaterThanEqual Expression '1' 
                             empid LessThan Expression '2'
    carbon range opt => Range Filters Conversion i.e. single expression '1' <= empid
< '2'
    Fix: a) Push Down Like Filters
           b) Avoid Row Level Evaluation in case Filter predicates on No Dictionary Greater
Than and Less Than Expression. 

You can merge this pull request into a Git repository by running:

    $ git pull like_pushdown

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #878
commit 8d40084ed62fe70ea099aeca3184347d2cd993b0
Author: sounakr <>
Date:   2017-05-04T04:46:19Z

    Like Filter Pushdown
    No Dictionary Handling in Greater and Less Than Expression


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message