carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang Chen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-108) Remove unnecessary Project for CarbonScan
Date Sat, 26 Nov 2016 02:31:58 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Liang Chen updated CARBONDATA-108:
----------------------------------
    Affects Version/s: 0.2.0-incubating

> Remove unnecessary Project for CarbonScan
> -----------------------------------------
>
>                 Key: CARBONDATA-108
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-108
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: spark-integration
>    Affects Versions: 0.2.0-incubating
>            Reporter: Jacky Li
>            Assignee: Jacky Li
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> For this SQL:
> select ch, sum(c) from (select ch,count(1) as c from t1 group by ch) temp where c >
1 group by ch
> Physical plan is:
> == Physical Plan ==
> Limit 21
>  ConvertToSafe
>   CarbonDictionaryDecoder [CarbonDecoderRelation(Map(word#22 -> word#22, ch#23 ->
ch#23, value#24L -> value#24L),CarbonDatasourceRelation(`default`.`t1`,None))], ExcludeProfile(ArrayBuffer()),
CarbonAliasDecoderRelation()
>    TungstenAggregate(key=[ch#23], functions=[(sum(c#18L),mode=Final,isDistinct=false)],
output=[ch#23,_c1#25L])
>     TungstenAggregate(key=[ch#23], functions=[(sum(c#18L),mode=Partial,isDistinct=false)],
output=[ch#23,currentSum#48L])
>      Filter (c#18L > 1)
>       TungstenAggregate(key=[ch#23], functions=[(count(1),mode=Final,isDistinct=false)],
output=[ch#23,c#18L])
>        TungstenExchange hashpartitioning(ch#23)
>         TungstenAggregate(key=[ch#23], functions=[(count(1),mode=Partial,isDistinct=false)],
output=[ch#23,currentCount#52L])
>          Project [ch#23]
>           ConvertToSafe
>            CarbonScan [ch#23], (CarbonRelation default, t1, CarbonMetaData(ArrayBuffer(word,
ch),ArrayBuffer(value),org.carbondata.core.carbon.metadata.schema.table.CarbonTable@6034ef16,DictionaryMap(Map(word
-> true, ch -> true))), TableMeta(default_t1,/Users/jackylk/code/incubator-carbondata/target/store,org.carbondata.core.carbon.metadata.schema.table.CarbonTable@6034ef16,Partitioner(org.carbondata.spark.partition.api.impl.SampleDataPartitionerImpl,[Ljava.lang.String;@450458d7,1,[Ljava.lang.String;@f8a969d)),
None), true
> The Project is unnecessary since CarbonScan only scan the requested column



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message