kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ShaoFeng Shi <shaofeng...@apache.org>
Subject Re: [Discuss] Disable/hide "RAW" measure in Kylin web GUI
Date Mon, 27 Nov 2017 05:40:23 GMT
Last year I raised this discussion but didn't have follow-up action.

Now we see there are still some new users misuse this feature, and then
face performance and maintenance issues.

In Kylin 2.1, the new "query pushdown" feature can forward the Cube
unmatched queries to alternative query engines like Hive / SparkSQL. The
raw data query is just such a scenario.

So I think it is time to disable the RAW measure on Kylin now.  JIRA
created for it: https://issues.apache.org/jira/browse/KYLIN-3062

Please comment if you see any issue.

2016-12-19 22:03 GMT+08:00 Billy Liu <billyliu@apache.org>:

> The experimental mode is system wide feature toggle. I think case by case
> is more flexible. Most new features could have toggles, default are off.
>
> 2016-12-19 21:40 GMT+08:00 Luke Han <luke.hq@gmail.com>:
>
> > Beta or Experimental will also bring confusing for most of users.
> >
> > Maybe we could have something called "expert" or "experimental" model in
> > system configuration.
> >
> > User will not see such content since they will be hidden by default but
> > admin could set it to true if they confident to enable such features.
> >
> > How do you think?
> >
> >
> > Best Regards!
> > ---------------------
> >
> > Luke Han
> >
> > On Mon, Dec 19, 2016 at 11:24 AM, Xiaoyu Wang <wangxy.jd@gmail.com>
> wrote:
> >
> > > I’m sorry for too long not maintain it!
> > >
> > > I agree with liyang to give a label to the RAW measure “Beta” or
> others.
> > >
> > > I will improve it when I have time!
> > >
> > > 2016-12-19 10:21 GMT+08:00 Li Yang <liyang@apache.org>:
> > >
> > > > Or display the Raw with "Beta" or "Experimental" to warn user that it
> > is
> > > > not a mature feature?
> > > >
> > > > On Fri, Dec 16, 2016 at 12:30 PM, 康凯森 <kangkaisen@qq.com>
wrote:
> > > >
> > > > > +1.
> > > > > But the "RAW" measure is still some useful, we could improve it
> next
> > > year
> > > > > when we have time.
> > > > >
> > > > >
> > > > > ------------------ 原始邮件 ------------------
> > > > > 发件人: "ShaoFeng Shi";<shaofengshi@apache.org>;
> > > > > 发送时间: 2016年12月15日(星期四) 中午12:05
> > > > > 收件人: "dev"<dev@kylin.apache.org>;
> > > > >
> > > > > 主题: [Discuss] Disable/hide "RAW" measure in Kylin web GUI
> > > > >
> > > > >
> > > > >
> > > > > Hello developers and users,
> > > > >
> > > > > I have a proposal want to disucss here, which is about the "RAW"
> > > measure
> > > > in
> > > > > Kylin.
> > > > >
> > > > > The RAW measure was developed to solve the requirement for getting
> > raw
> > > > data
> > > > > when user drill down from high level to low levels. It's
> performance
> > > > would
> > > > > be much better than fetching from source like Hive, so some users
> > like
> > > > it.
> > > > > This blog introduces it:
> > > > > https://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/
> > > > >
> > > > > While it has some limitations:
> > > > > 1) always use dictionary encoding, which means it couldn't support
> > UHC;
> > > > > since raw columns usually be transaction IDs, numbers, etc, the
> > > building
> > > > > cost is much higher than ordinary dimensions;
> > > > > 2) the raw messages for a dimension combination are persisted in
> one
> > > big
> > > > > cell,; When too many rows dumped in one cell, will get
> BufferOverflow
> > > > > error. This couldn't be predicted, so for an modeler or analyst he
> > > > doesn't
> > > > > know whether this feature could work when he creates the cube.
> > > > > 3) seems no people maintains it;
> > > > >
> > > > > Based on above, I propose hiding this measure on Web GUI by
> default,
> > so
> > > > > avoiding confusing user; If someone hear and want to use this, he
> > still
> > > > can
> > > > > enable it by simply set in kylin.properties.
> > > > >
> > > > > Any input is welcomed.
> > > > >
> > > > > --
> > > > > Best regards,
> > > > >
> > > > > Shaofeng Shi 史少锋
> > > > >
> > > >
> > >
> >
>



-- 
Best regards,

Shaofeng Shi 史少锋

Mime
View raw message