carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CARBONDATA-278) IS NULL and IS NOT NULL shall be push down to carbon
Date Tue, 27 Sep 2016 11:26:20 GMT

    [ https://issues.apache.org/jira/browse/CARBONDATA-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525831#comment-15525831
] 

ASF GitHub Bot commented on CARBONDATA-278:
-------------------------------------------

GitHub user sujith71955 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/202

    [CARBONDATA-278] IS NULL and IS NOT NULL shall be push down to carbon

    **Current design** : As per the current design IS NULL and IS NOT NULL filter is been
handled by spark layer
    **Drawback** :  Block/Blocklet level pruning will not be possible if the filter is been
processed by spark layer
    **Proposed Improvement**:  IS NULL and IS NOT NULL shall be push down to carbon layer
since carbon layer can process these filters faster using block/block-let pruning , also while
processing filters in executers  carbon is applying binary search for applying filter values.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sujith71955/incubator-carbondata master_filterOptimizations

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/202.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #202
    
----
commit b89510679237d12763bf99402ada60a675b6dfc2
Author: sujith71955 <sujithchacko.2010@gmail.com>
Date:   2016-09-27T11:21:03Z

    [CARBONDATA-278] IS NULL and IS NOT NULL shall be push down to carbon layer since carbon
layer can process these filters faster using block/block-let pruning ,
     also while processing filters in executors carbon is applying binary search for applying
filter values.

----


> IS NULL and IS NOT NULL shall be push down to carbon
> ----------------------------------------------------
>
>                 Key: CARBONDATA-278
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-278
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Sujith
>            Assignee: Sujith
>            Priority: Minor
>
> IS NULL and IS NOT NULL shall be push down to carbon layer since carbon layer can process
these filters faster using block/block-let pruning , also while processing filters in executers
 carbon is applying binary search for applying filter values.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message