kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "柯南" <zzm_b...@qq.com>
Subject 回复: A problem about Global Dictionary and cube merge
Date Fri, 29 Sep 2017 02:37:09 GMT
Yes,I am careful to use GD. Could I have another way to instead of GD?
  

 

 ------------------ 原始邮件 ------------------
  发件人: "ShaoFeng Shi";<shaofengshi@apache.org>;
 发送时间: 2017年9月29日(星期五) 上午9:41
 收件人: "dev"<dev@kylin.apache.org>;
 
 主题: Re: A problem about Global Dictionary and cube merge

 

I see; Did you use GlobalDictionaryBuilder for a dimension column? The GD
should only be used for count distinct measure, not suitable for dimension
encoding.

2017-09-28 23:57 GMT+08:00 柯南 <zzm_bupt@qq.com>:

> Thank you for your reply!
>  I know this command.But Because its segment could not be merged, even if
> run this command ,the hbase tables could not be cleaned.
>
>
>
>
>  ------------------ 原始邮件 ------------------
>   发件人: "ShaoFeng Shi";<shaofengshi@apache.org>;
>  发送时间: 2017年9月28日(星期四) 晚上9:29
>  收件人: "dev"<dev@kylin.apache.org>;
>
>  主题: Re: A problem about Global Dictionary and cube merge
>
>
>
> You need run this:
> https://kylin.apache.org/docs21/howto/howto_cleanup_storage.html
>
> 2017-09-28 20:40 GMT+08:00 柯南 <zzm_bupt@qq.com>:
>
> > hi,all:
> >       Because of our yarn and hbase`s version limited,we deploy apache
> > kylin 1.6.0. For the correct result of 'count(distinct A_col)' across
> > segments, we must use Global Dictionary to A_col. When the cube contain
> > configuration of 'org.apache.kylin.dict.GlobalDictionaryBuilder', its
> > segment could not be merged.(AppendTrieDictionary class don`t support
> > getValueBytesFromIdImpl method and error is below) We will build the cube
> > every day, that means a new hbase table will be created every day. And
> the
> > segment could not be merged, that means the hbase tables could not be
> > cleaned. That`t terrible.Give me some advice?
> >      Thank you! Looking forward to your reply.
>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>



-- 
Best regards,

Shaofeng Shi 史少锋
Mime
  • Unnamed multipart/alternative (inline, 8-Bit, 0 bytes)
View raw message