kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhong Yanghong (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KYLIN-3512) No need to enable kylin.storage.hbase.endpoint-compress-result when the query is related to count distinct of bitmap
Date Fri, 24 Aug 2018 09:53:00 GMT

     [ https://issues.apache.org/jira/browse/KYLIN-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhong Yanghong updated KYLIN-3512:
----------------------------------
    Description: 
As we know, roaring bitmap will compress its contents. There's no need to use {{CompressionUtils.compress}}
to compress again the results of each region, which is time consuming and whose compression
ratio is low. One example is as follows:
                                  Etc message: start latency: 39@1,agg done@{color:#f79232}1094{color},cpuTime@1090,compress
done@{color:#f79232}4245{color},server stats done@4246
                                  endpoint.CubeVisitService: Size of final
result = {color:#f79232}61,157,510{color} ({color:#f79232}64,725,324{color} before compressing)

> No need to enable kylin.storage.hbase.endpoint-compress-result when the query is related
to count distinct of bitmap
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: KYLIN-3512
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3512
>             Project: Kylin
>          Issue Type: Improvement
>            Reporter: Zhong Yanghong
>            Assignee: Zhong Yanghong
>            Priority: Major
>
> As we know, roaring bitmap will compress its contents. There's no need to use {{CompressionUtils.compress}}
to compress again the results of each region, which is time consuming and whose compression
ratio is low. One example is as follows:
>                                   Etc message: start latency: 39@1,agg
done@{color:#f79232}1094{color},cpuTime@1090,compress done@{color:#f79232}4245{color},server
stats done@4246
>                                   endpoint.CubeVisitService: Size of
final result = {color:#f79232}61,157,510{color} ({color:#f79232}64,725,324{color} before compressing)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message