Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id F1D0A200B92 for ; Wed, 28 Sep 2016 11:42:38 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id F0732160AD4; Wed, 28 Sep 2016 09:42:38 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C2583160AB4 for ; Wed, 28 Sep 2016 11:42:37 +0200 (CEST) Received: (qmail 29189 invoked by uid 500); 28 Sep 2016 09:42:36 -0000 Mailing-List: contact user-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kylin.apache.org Delivered-To: mailing list user@kylin.apache.org Received: (qmail 29180 invoked by uid 99); 28 Sep 2016 09:42:36 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Sep 2016 09:42:36 +0000 Received: from mail-yb0-f174.google.com (mail-yb0-f174.google.com [209.85.213.174]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 8DE141A0281 for ; Wed, 28 Sep 2016 09:42:36 +0000 (UTC) Received: by mail-yb0-f174.google.com with SMTP id z8so3383022ybh.3 for ; Wed, 28 Sep 2016 02:42:36 -0700 (PDT) X-Gm-Message-State: AA6/9RmUONDe13nkHs9/FlKtE74QqMn255HiCMuS3Zr5xlDcSPEW9GzBgrBLO3UT4LGEY6gKkgSFDr8gPXXdxg== X-Received: by 10.37.85.136 with SMTP id j130mr123540ybb.80.1475055755717; Wed, 28 Sep 2016 02:42:35 -0700 (PDT) MIME-Version: 1.0 Received: by 10.13.236.85 with HTTP; Wed, 28 Sep 2016 02:41:55 -0700 (PDT) In-Reply-To: References: From: ShaoFeng Shi Date: Wed, 28 Sep 2016 17:41:55 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Empty Cube To: user Content-Type: multipart/alternative; boundary=001a113e8a4c57f440053d8e2e9f archived-at: Wed, 28 Sep 2016 09:42:39 -0000 --001a113e8a4c57f440053d8e2e9f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I also encountered the "empty cube" issue in an environment yesterday; By checking Hive I found one of the sample table "DEFAULT.KYLIN_CATEGORY_GROUPINGS" has no record. Since the "kylin_sales" cube uses "inner" joins for all tables, causing the cube no data. After some troubleshoting I identify it is an issue of the "beeline" client (my env configures beeline as hive cli in kylin), when it executes the sample_cube/create_sample_tables.sql, the last line wasn't executed, which caused the csv file wasn't uploaded. By adding a blank line in the end of this sql file, it runs successfully. I will checkin this change in kylin soon. If you faced the same issue, please take a try. 2016-09-09 13:47 GMT+08:00 ShaoFeng Shi : > Hi Niasari, > > During the query time, Kylin will not touch Hive, all queries will go to > HBase, so you still get results on kylin_cal_dt; If you also want to remo= ve > that also in Kylin, please disable and then drop the cube. > > For the empty cube, it is possible and allowed in Kylin; Thinking that an > user uses incremental build, and for a time period there is no source dat= a, > so empty cube is expected. Of course you can configure Kylin to let it > report error when there is no source record, see: https://issues.apache. > org/jira/browse/KYLIN-1752 > > For the empty cube issue, I guess there is some thing wrong, making no > data be built into cube. If you want to get remote debug or support, plea= se > contact me offline. > > > > 2016-09-07 5:17 GMT+08:00 Niasari, Mehrdad : > >> The range is up to 2015 and that=E2=80=99s not the problem. >> >> >> >> The only query that doesn=E2=80=99t return zero/empty result is from tab= le >> kylin_cal_dt. When I delete this table from hive, still the result is no= t >> empty and Kylin doesn=E2=80=99t complain! Where does Kylin bring the dat= a of this >> table even when it=E2=80=99s not on hive? >> >> Also I checked the cube itself on Hbase and it=E2=80=99s empty. Any othe= r >> suggestion? Can it be because of some wrong configuration in connecting >> Kylin to Hive/Hbase? If that=E2=80=99s the case why it can create the cu= be >> successfully? >> >> >> >> Also I have a question regarding uuid. What is this for? >> >> I=E2=80=99m asking this cause I cannot fully understand that why you hav= e used a >> fixed value in sample cube json files (for example for kylin_sales_cube >> uuid is: =E2=80=9C2fbca32a-a33e-4b69-83dd-0bb8b1f8c53b=E2=80=9D). How co= me it doesn=E2=80=99t >> conflict if you run the sample cube multiple times? >> >> >> >> Thanks, >> >> Mehrdad >> >> >> >> *From:* ShaoFeng Shi [mailto:shaofengshi@apache.org] >> *Sent:* 2016, September, 01 9:01 PM >> >> *To:* user >> *Subject:* Re: Empty Cube >> >> >> >> ok; The table "kylin_sales" contains data for 2012 and 2013, so need mak= e >> sure the build range covers these years; please have a check and I guess= it >> is some minor mistake; BTW, empty cube will return zero since it doesn't >> have data. >> >> >> >> 2016-09-02 1:34 GMT+08:00 Niasari, Mehrdad : >> >> Thanks for the reply. >> >> >> >> There is no error in the log. Also I checked the hive tables and they ar= e >> not empty; I can run any query on them using Hue and work well. >> >> >> >> Also the size of cube in the cubes section in 0.00KB! But even with an >> empty cube the result of queries on the tables should not be empty/zero, >> right? >> >> Any other suggestion how to debug it? >> >> >> >> Thanks, >> >> Mehrdad >> >> >> >> *From:* ShaoFeng Shi [mailto:shaofengshi@apache.org] >> *Sent:* 2016, August, 31 9:04 PM >> *To:* user >> *Subject:* Re: Empty Cube >> >> >> >> Hi Mehrdad, >> >> >> >> When you run the query, is there any error reported in the logs/kylin.lo= g? >> >> >> >> If no error, please check whether the source hive table has data, you ca= n >> do this easily in hive, by running HQL "select * from default.kylin_sale= s >> limit 100"; it is very likely that the "sample.sh" failed to upload the >> file; if it is this case, you may need manually import the data files >> (sample_cube/data) to hive; >> >> >> >> 2016-09-01 4:06 GMT+08:00 Niasari, Mehrdad : >> >> Hi All, >> >> >> >> When I run the sample cube of Kylin the result is empty, i.e. the cube i= s >> computed successfully, the status is ready but nothing is in the cube an= d >> every query gets zero. >> >> Do you have any suggestion what can cause the problem? >> >> How should I debug it? >> >> >> >> Thanks, >> >> Mehrdad >> >> >> >> >> >> _______________________________________________________________________ >> >> If you received this email in error, please advise the sender (by return >> email or otherwise) immediately. You have consented to receive the attac= hed >> electronically at the above-noted email address; please retain a copy of >> this confirmation for future reference. >> >> Si vous recevez ce courriel par erreur, veuillez en aviser l'exp=C3=A9di= teur >> imm=C3=A9diatement, par retour de courriel ou par un autre moyen. Vous a= vez >> accept=C3=A9 de recevoir le(s) document(s) ci-joint(s) par voie =C3=A9le= ctronique =C3=A0 >> l'adresse courriel indiqu=C3=A9e ci-dessus; veuillez conserver une copie= de >> cette confirmation pour les fins de reference future. >> >> >> >> >> >> -- >> >> Best regards, >> >> >> >> Shaofeng Shi >> >> >> >> _______________________________________________________________________ >> >> If you received this email in error, please advise the sender (by return >> email or otherwise) immediately. You have consented to receive the attac= hed >> electronically at the above-noted email address; please retain a copy of >> this confirmation for future reference. >> >> Si vous recevez ce courriel par erreur, veuillez en aviser l'exp=C3=A9di= teur >> imm=C3=A9diatement, par retour de courriel ou par un autre moyen. Vous a= vez >> accept=C3=A9 de recevoir le(s) document(s) ci-joint(s) par voie =C3=A9le= ctronique =C3=A0 >> l'adresse courriel indiqu=C3=A9e ci-dessus; veuillez conserver une copie= de >> cette confirmation pour les fins de reference future. >> >> >> >> >> >> -- >> >> Best regards, >> >> >> >> Shaofeng Shi >> >> >> >> _______________________________________________________________________ >> >> If you received this email in error, please advise the sender (by return >> email or otherwise) immediately. You have consented to receive the attac= hed >> electronically at the above-noted email address; please retain a copy of >> this confirmation for future reference. >> >> Si vous recevez ce courriel par erreur, veuillez en aviser l'exp=C3=A9di= teur >> imm=C3=A9diatement, par retour de courriel ou par un autre moyen. Vous a= vez >> accept=C3=A9 de recevoir le(s) document(s) ci-joint(s) par voie =C3=A9le= ctronique =C3=A0 >> l'adresse courriel indiqu=C3=A9e ci-dessus; veuillez conserver une copie= de >> cette confirmation pour les fins de reference future. >> >> > > > -- > Best regards, > > Shaofeng Shi > > --=20 Best regards, Shaofeng Shi =E5=8F=B2=E5=B0=91=E9=94=8B --001a113e8a4c57f440053d8e2e9f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I also encountered the "empty cube" issue in an = environment yesterday; By checking Hive I found one of the sample table &qu= ot;DEFAULT.KYLIN_CATEGORY_GROUPINGS" has no record. Since the "ky= lin_sales" cube uses "inner" joins for all tables, causing t= he cube no data.

After some troubleshoting I identify it= is an issue of the "beeline" client (my env configures beeline a= s hive cli in kylin), when it executes the sample_cube/create_sample_tables= .sql, the last line wasn't executed, which caused the csv file wasn'= ;t uploaded.

By adding a blank line in the end= of this sql file, it runs successfully. I will checkin this change in kyli= n soon. If you faced the same issue, please take a try.

2016-09-09 13:47 GMT+08:0= 0 ShaoFeng Shi <shaofengshi@apache.org>:
Hi Niasari,

During = the query time, Kylin will not touch Hive, all queries will go to HBase, so= you still get results on kylin_cal_dt; If you also want to remove that als= o in Kylin, please disable and then drop the cube.

For the empty cube, it is possible and allowed in Kylin; Thinking that an = user uses incremental build, and for a time period there is no source data,= so empty cube is expected. Of course you can configure Kylin to let it rep= ort error when there is no source record, see:=C2=A0https://issues.apac= he.org/jira/browse/KYLIN-1752

For the emp= ty cube issue, I guess there is some thing wrong, making no data be built i= nto cube. If you want to get remote debug or support, please contact me off= line.



2016-= 09-07 5:17 GMT+08:00 Niasari, Mehrdad <mehrdad.niasari@rbc.com&g= t;:

The range is up to 2015 a= nd that=E2=80=99s not the problem.

=C2=A0

The only query that doesn= =E2=80=99t return zero/empty result is from table kylin_cal_dt. When I dele= te this table from hive, still the result is not empty and Kylin doesn=E2=80=99t complain! Where does Kylin bring the data of this table ev= en when it=E2=80=99s not on hive?

Also I checked the cube i= tself on Hbase and it=E2=80=99s empty. Any other suggestion? Can it be beca= use of some wrong configuration in connecting Kylin to Hive/Hbase? If that=E2=80=99s the case why it can create the cube successfully?=

=C2=A0

Also I have a question re= garding uuid. What is this for?

I=E2=80=99m asking this c= ause I cannot fully understand that why you have used a fixed value in samp= le cube json files (for example for kylin_sales_cube uuid is: =E2=80=9C2fbc= a32a-a33e-4b69-83dd-0bb8b1f8c53b=E2=80=9D). How come it doesn=E2=80=99t conflict if you run the sample cube multiple t= imes?

=C2=A0

Thanks,

Mehrdad

=C2=A0

From: ShaoFeng= Shi [mailto:sh= aofengshi@apache.org]
Sent: 2016, September, 01 9:01 PM


To: user
Subject: Re: Empty Cube

=C2=A0

ok; The table "kylin_sales" contains data = for 2012 and 2013, so need make sure the build range covers these years; pl= ease have a check and I guess it is some minor mistake; BTW, empty cube wil= l return zero since it doesn't have data.

=C2=A0

2016-09-02 1:34 GMT+08:00 Niasari, Mehrdad <mehrdad.niasari@rbc= .com>:

Thanks for the reply.

=C2=A0

There is no error in the = log. Also I checked the hive tables and they are not empty; I can run any query on them using Hue and work well.

=C2=A0

Also the size of cube in = the cubes section in 0.00KB! But even with an empty cube the result of quer= ies on the tables should not be empty/zero, right?

Any other suggestion how = to debug it?

=C2=A0

Thanks,<= /u>

Mehrdad<= /u>

=C2=A0

From: ShaoFeng= Shi [mailto:sh= aofengshi@apache.org]
Sent: 2016, August, 31 9:04 PM
To: user
Subject: Re: Empty Cube

=C2=A0

Hi Mehrdad,

=C2=A0

When you run the query, is there any error reported = in the logs/kylin.log?

=C2=A0

If no error, please check whether the source hive ta= ble has data, you can do this easily in hive, by running HQL "select *= from default.kylin_sales limit 100"; it is very likely that the "sample.sh" failed to upload the file; if it is this ca= se, you may need manually import the data files =C2=A0(sample_cube/data) to= hive;=C2=A0

=C2=A0

2016-09-01 4:06 GMT+08:00 Niasari, Mehrdad <mehrdad.niasari@rbc= .com>:

Hi All,

=C2=A0

When I run the sample cube of Kylin the= result is empty, i.e. the cube is computed successfully, the status is ready but nothing is in the cube and every query gets zero.<= u>

Do you have any suggestion what can cau= se the problem?

How should I debug it?=

=C2=A0

Thanks,

Mehrdad

=C2=A0

=C2=A0

___________________________________= ____________________________________

If you received this email in error, ple= ase advise the sender (by return email or otherwise) immediately. You have = consented to receive the attached electronically at the above-noted email a= ddress; please retain a copy of this confirmation for future reference.

Si vous recevez ce courriel par erreur, = veuillez en aviser l'exp=C3=A9diteur imm=C3=A9diatement, par retour de = courriel ou par un autre moyen. Vous avez accept=C3=A9 de recevoir le(s) do= cument(s) ci-joint(s) par voie =C3=A9lectronique =C3=A0 l'adresse courriel indiqu=C3=A9e ci-dessus; veuillez conserver une copie de cette co= nfirmation pour les fins de reference future.



=C2=A0

--

Best regards,

=C2=A0

Shaofeng Shi

=C2=A0

___________________________________= ____________________________________

If you received this email in error, ple= ase advise the sender (by return email or otherwise) immediately. You have = consented to receive the attached electronically at the above-noted email a= ddress; please retain a copy of this confirmation for future reference.

Si vous recevez ce courriel par erreur, = veuillez en aviser l'exp=C3=A9diteur imm=C3=A9diatement, par retour de = courriel ou par un autre moyen. Vous avez accept=C3=A9 de recevoir le(s) do= cument(s) ci-joint(s) par voie =C3=A9lectronique =C3=A0 l'adresse courriel indiqu=C3=A9e ci-dessus; veuillez conserver une copie de cette co= nfirmation pour les fins de reference future.



=C2=A0

--

Best regards,

=C2=A0

Shaofeng Shi

=C2=A0

_____________________________________= __________________________________

If you received this email in error, pleas= e advise the sender (by return email or otherwise) immediately. You have co= nsented to receive the attached electronically at the above-noted email add= ress; please retain a copy of this confirmation for future reference.

Si vous recevez ce courriel par erreur, ve= uillez en aviser l'exp=C3=A9diteur imm=C3=A9diatement, par retour de co= urriel ou par un autre moyen. Vous avez accept=C3=A9 de recevoir le(s) docu= ment(s) ci-joint(s) par voie =C3=A9lectronique =C3=A0 l'adresse courrie= l indiqu=C3=A9e ci-dessus; veuillez conserver une copie de cette confirmati= on pour les fins de reference future.




--
Best regards,

Shaofeng Shi




--
=
Best regards,

Shaofeng Sh= i =E5=8F=B2=E5=B0=91=E9=94=8B

--001a113e8a4c57f440053d8e2e9f--