From user-return-3417-archive-asf-public=cust-asf.ponee.io@kylin.apache.org Tue Aug 21 03:19:31 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 89B3D180663 for ; Tue, 21 Aug 2018 03:19:30 +0200 (CEST) Received: (qmail 73817 invoked by uid 500); 21 Aug 2018 01:19:29 -0000 Mailing-List: contact user-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kylin.apache.org Delivered-To: mailing list user@kylin.apache.org Received: (qmail 73808 invoked by uid 99); 21 Aug 2018 01:19:29 -0000 Received: from mail-relay.apache.org (HELO mailrelay2-lw-us.apache.org) (207.244.88.137) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Aug 2018 01:19:29 +0000 Received: from mail-pf1-f170.google.com (mail-pf1-f170.google.com [209.85.210.170]) by mailrelay2-lw-us.apache.org (ASF Mail Server at mailrelay2-lw-us.apache.org) with ESMTPSA id 81BEDA3B for ; Tue, 21 Aug 2018 01:19:28 +0000 (UTC) Received: by mail-pf1-f170.google.com with SMTP id l9-v6so7640513pff.9 for ; Mon, 20 Aug 2018 18:19:28 -0700 (PDT) X-Gm-Message-State: AOUpUlFBQUMN4BLR0ZjdQIEWkIcAsXhOwdHPkL5kZ4/p+INUSIcSWICT sGQiSBIaoD/ScV5QNJCqKgo7AZP2PS+jo58Sd+0= X-Google-Smtp-Source: AA+uWPy784j/QCtNuTTb4bqs6wqPZ/csuTau9kUt6nCb6+r9qWJlvunM1LHRinNcvtNNB4q0ZPqpV/zNoh955hLOlg8= X-Received: by 2002:a65:5205:: with SMTP id o5-v6mr45800943pgp.108.1534814367777; Mon, 20 Aug 2018 18:19:27 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a17:90a:1c0f:0:0:0:0 with HTTP; Mon, 20 Aug 2018 18:18:47 -0700 (PDT) In-Reply-To: References: From: ShaoFeng Shi Date: Tue, 21 Aug 2018 09:18:47 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: HBase table schema for cube data To: user Content-Type: multipart/alternative; boundary="000000000000300b4b0573e7d12c" --000000000000300b4b0573e7d12c Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Ashish, The slide is shared here, just FYI: https://www.slideshare.net/ShiShaoFeng1/apache-kylin-on-hbase-extreme-olap-= engine-for-big-data 2018-08-11 8:24 GMT+08:00 ShaoFeng Shi : > Sure, looking forward to your PoC result. Thank you Ashish! > > 2018-08-08 17:08 GMT+08:00 Ashish Singhi : > >> Hi Shaofeng, >> >> Yes, we are able to setup Kylin and build cubes. >> We are are doing a PoC, so still exploring things on it. Once we have >> concluded it, I will definitely share the use case here. >> >> Thanks, >> Ashish >> >> On Wed, Aug 8, 2018 at 2:33 PM, ShaoFeng Shi >> wrote: >> >>> Hi Ashish, >>> >>> 'GT' here stands for "GridTable", which is an abstract for Kylin's >>> storage layer; >>> >>> Yeah, the slides will be shared after the event. We may also update som= e >>> content to Kylin's documentation. >>> >>> Were you able to run Kylin successfully at your side? What's the >>> scenario that you hope Kylin can help? We'd like to get feedback from y= ou, >>> in a technical or business perspectives. Thanks! >>> >>> >>> 2018-08-07 23:25 GMT+08:00 Ashish Singhi >> >: >>> >>>> Hi Shaofeng, >>>> >>>> Thanks for the reply. >>>> I understand it now. >>>> >>>> I see a lot of 'GT' in class name, curious to know what it stands for = ? >>>> >>>> Good luck for your presentation. Unfortunately, I will not be able to >>>> make it this time. >>>> I hope your slides will uploaded somewhere from where we can refer it. >>>> >>>> Regards, >>>> Ashish >>>> >>>> >>>> >>>> On Tue, Aug 7, 2018 at 2:38 PM, ShaoFeng Shi >>>> wrote: >>>> >>>>> Hi Ashish, >>>>> >>>>> I'm preparing a slide for HBase Conference Asia 2018 next week. Here >>>>> are some bullets for it: >>>>> >>>>> >>>>> - Dimension values are encoded to bytes (via dictionary or others) >>>>> - Measures are serialized into bytes >>>>> - HBase Rowkey format: Shard ID (2 bytes) + Cuboid ID (8 bytes) + >>>>> Dimension values >>>>> - HBase Value: measure serialized bytes >>>>> - The HBase table is split into regions by Shard ID >>>>> >>>>> >>>>> You can refer to org.apache.kylin.cube.kv.RowKeyEncoder; >>>>> >>>>> 2018-08-06 23:49 GMT+08:00 Ashish Singhi : >>>>> >>>>>> Hi Team, >>>>>> >>>>>> Is there any blog or some one can tell me what is HBase schema of th= e >>>>>> table in which cube data is stored ? >>>>>> If you can point me to class also where the HBase rowkey and column >>>>>> value is formed will also be helpful. >>>>>> >>>>>> Thanks, >>>>>> Ashish >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Best regards, >>>>> >>>>> Shaofeng Shi =E5=8F=B2=E5=B0=91=E9=94=8B >>>>> >>>>> >>>> >>> >>> >>> -- >>> Best regards, >>> >>> Shaofeng Shi =E5=8F=B2=E5=B0=91=E9=94=8B >>> >>> >> > > > -- > Best regards, > > Shaofeng Shi =E5=8F=B2=E5=B0=91=E9=94=8B > > --=20 Best regards, Shaofeng Shi =E5=8F=B2=E5=B0=91=E9=94=8B --000000000000300b4b0573e7d12c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

2018-08-11 8:24 GMT+08:00 ShaoFeng Shi <shaofe= ngshi@apache.org>:
Sure, looking forward to your PoC result. Thank you Ashish!
<= div class=3D"HOEnZb">

2018-08-08 17:08 GMT+08:00 Ashish Singhi <ashi= shsinghi@apache.org>:
Hi Shaofeng,

Yes, we are able to setup Kylin= and build cubes.=C2=A0
We are are doing a PoC, so still explorin= g things on it. Once we have concluded it, I will definitely share the use = case here.

Thanks,
Ashish=C2=A0

On We= d, Aug 8, 2018 at 2:33 PM, ShaoFeng Shi <shaofengshi@apache.org&g= t; wrote:
Hi Ashi= sh,

'GT' here stands for "GridTable", = which is an abstract for Kylin's storage layer;

Yeah, the slides will be shared after the event. We may also update some = content to Kylin's documentation.

Were you abl= e to run Kylin successfully at your side? What's the scenario that you = hope Kylin can help? We'd like to get feedback from you, in a technical= or business perspectives. Thanks!


2018-08-07 23:25 GMT+08:00 Ashish Singhi <ashish.singhi.apache@gmail.com>:
Hi Shaofeng,

Thanks for t= he reply.
I understand it now.

I see a l= ot of 'GT' in class name, curious to know what it stands for ?

Good luck for your presentation. Unfortunately, I will= not be able to make it this time.=C2=A0
I hope your slides will = uploaded somewhere from where we can refer it.

Reg= ards,
Ashish



On Tue, Aug 7, 2018 at = 2:38 PM, ShaoFeng Shi <shaofengshi@apache.org> wrote:
Hi Ashish,

=
I'm preparing a slide for HBase Conference Asia 2018 next week. He= re are some bullets for it:

  • Dimension= values are encoded to bytes (via dictionary or others)
  • Measure= s are serialized into bytes
  • HBase Rowkey format: Shard ID (2 by= tes) + Cuboid ID (8 bytes) + Dimension values
  • HBase Value: meas= ure serialized bytes
  • The HBase table is split into regions by S= hard ID

You can refer to org.a= pache.kylin.cube.kv.RowKeyEncoder;

2018-08-= 06 23:49 GMT+08:00 Ashish Singhi <ashishsinghi@apache.org>:
Hi Team,

<= /div>
Is there any blog or some one can tell me what is HBase schema of= the table in which cube data is stored ?
If you can point me to = class also where the HBase rowkey and column value is formed will also be h= elpful.

Thanks,
Ashish



--
Best regards,

Shaofeng Shi =E5=8F=B2=E5=B0=91=E9=94=8B

=




--
Best regards,

Shaofeng Shi =E5=8F=B2=E5=B0=91= =E9=94=8B





--
=
Best regards,

<= /div>
Shaofeng Shi =E5=8F=B2=E5=B0=91=E9=94=8B




--
=
Best regards,

Shaofeng Sh= i =E5=8F=B2=E5=B0=91=E9=94=8B

--000000000000300b4b0573e7d12c--