carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ravindra Pesala (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (CARBONDATA-2051) Added like query ends with and contains with filter push down suport to carbondata
Date Thu, 18 Jan 2018 17:30:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ravindra Pesala resolved CARBONDATA-2051.
-----------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.3.0

> Added like query ends with and contains with filter push down suport to carbondata
> ----------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-2051
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2051
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>            Priority: Major
>             Fix For: 1.3.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Problem
> Current like filter with start with expression is only pushed down to carbondata. In
case of ends with and contains like filter all the data is given back to spark and then spark
applies the filter on it.
> This behavior is fine for the queries which has lesser number of queried columns. But
as the number of columns and data increases there is performance impact because the data being
sent to spark becomes more thereby increasing the IO. 
> If like filter is push down then first filter column is read and blocks are pruned. In
this cases the data returned to the spark is after applying the filter and only blocklets
matching the data are fully read. This reduces IO and increases the query performance.
> Solution
> Modify code to push down like query with ends and contains with filter



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message