Return-Path: X-Original-To: apmail-kylin-user-archive@minotaur.apache.org Delivered-To: apmail-kylin-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 78DF5189D4 for ; Sat, 30 Jan 2016 07:14:29 +0000 (UTC) Received: (qmail 60252 invoked by uid 500); 30 Jan 2016 07:14:28 -0000 Delivered-To: apmail-kylin-user-archive@kylin.apache.org Received: (qmail 60166 invoked by uid 500); 30 Jan 2016 07:14:28 -0000 Mailing-List: contact user-help@kylin.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@kylin.apache.org Delivered-To: mailing list user@kylin.apache.org Received: (qmail 60063 invoked by uid 99); 30 Jan 2016 07:14:28 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Jan 2016 07:14:28 +0000 Received: from mail-qg0-f46.google.com (mail-qg0-f46.google.com [209.85.192.46]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id E06851A047E for ; Sat, 30 Jan 2016 07:14:27 +0000 (UTC) Received: by mail-qg0-f46.google.com with SMTP id o11so83016040qge.2 for ; Fri, 29 Jan 2016 23:14:27 -0800 (PST) X-Gm-Message-State: AG10YORZky8z8VY4iO8qD48Pjc14QeAAerGffHoG/k5qszkScrqtlT7S0t+zcNw18c4CLTjk6ZY3WPCG8kQbHQ== MIME-Version: 1.0 X-Received: by 10.140.143.68 with SMTP id 65mr17050257qhp.25.1454138067089; Fri, 29 Jan 2016 23:14:27 -0800 (PST) Received: by 10.55.173.134 with HTTP; Fri, 29 Jan 2016 23:14:27 -0800 (PST) In-Reply-To: <000001d159b8$cac92750$605b75f0$@iflytek.com> References: <46db01d159ab$6da2f1d0$48e8d570$@iflytek.com> <000001d159b8$cac92750$605b75f0$@iflytek.com> Date: Sat, 30 Jan 2016 15:14:27 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Intermediate table not found From: Li Yang To: "user@kylin.apache.org" Content-Type: multipart/alternative; boundary=001a11373a58f182d6052a87e601 --001a11373a58f182d6052a87e601 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Looks kylin didnt pick up the correct hive conf, thus didnt look into the right hive metastore and failed to find the table. To diagnose, run 'bin/find-hive-dependencies.sh' and check if reported classpath contains the right hive conf folder. On Thursday, January 28, 2016, jyzheng wrote: > > > I=E2=80=99m a newbie for kylin. After installing, I run sample.sh, then b= uild the > cube, but get the wrong message: > > > > java.io.IOException: > NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube= _desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 > table not found) > > at > org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputForm= at.java:97) > > at > org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputForm= at.java:51) > > at > org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactD= istinctColumnsJob.java:101) > > at > org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctC= olumnsJob.java:77) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) > > at > org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutabl= e.java:120) > > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecuta= ble.java:107) > > at > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultCha= inedExecutable.java:51) > > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecuta= ble.java:107) > > at > org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(Defau= ltScheduler.java:130) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java= :1145) > > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:615) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: > NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube= _desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 > table not found) > > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveM= etaStore.java:1569) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :57) > > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:606) > > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHan= dler.java:106) > > at com.sun.proxy.$Proxy49.get_table(Unknown Source) > > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaSto= reClient.java:1008) > > at > org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:191) > > at > org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(Initia= lizeInput.java:105) > > at > org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInp= ut.java:86) > > at > org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputForm= at.java:95) > > ... 13 more > > > > result code:2 > > [Issue 975 ] suggests "k= ylin.job.hive.database.for.intermediatetable" > =3D default. But I also get this error message. > > > > When I run `show tables` command, I can get the table > kylin_intermediate_kylin_sales_cube_desc_1970***, and can also get its > described info. > > > > Kylin version =3D 1.2 > > Hive version =3D 0.13.1-cdh5.3.2 > > Hbase version =3D 0.98.6+cdh5.3.2 > > Hadoop version =3D 2.5.0-cdh5.3.2 > > > --001a11373a58f182d6052a87e601 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Looks kylin didnt pick up the correct hive conf, thus didnt look into = the right hive metastore and failed to find the table.

=
To diagnose, run 'bin/find-hive-dependencies.sh' and check if = reported classpath contains the right hive conf folder.



On Thursday, January 28, 2016, jyzheng <jyzheng@iflytek.com> wrote:

=C2=A0

I=E2=80=99m a newbie for kylin. After insta= lling, I run sample.sh, then build the cube, but get the wrong message:<= /u>

=C2=A0

java.io.IOException: NoSuchObjectException(= message:default.kylin_intermediate_kylin_sales_cube_desc_19700101000000_201= 60101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table not found)=

= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hive.hcatalo= g.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)=

= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hive.hcatalo= g.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)=

= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.kylin.job.ha= doop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:10= 1)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.= kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.jav= a:77)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.ap= ache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hadoop.util.ToolRunner.r= un(ToolRunner.java:84)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 at org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceE= xecutable.java:120)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractEx= ecutable.java:107)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(Defau= ltChainedExecutable.java:51)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.job.execution.AbstractExecutable.execute(A= bstractExecutable.java:107)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRu= nner.run(DefaultScheduler.java:130)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0 at java.util.concurrent.ThreadPoolExecutor.runWorker(Thr= eadPoolExecutor.java:1145)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolE= xecutor.java:615)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= at java.lang.Thread.run(Thread.java:745)

Caused by: NoSuchObject= Exception(message:default.kylin_intermediate_kylin_sales_cube_desc_19700101= 000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table not found)=

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.ha= doop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1= 569)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.refle= ct.NativeMethodAccessorImpl.invoke0(Native Method)

=

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.NativeMethodAccessorImpl.i= nvoke(NativeMethodAccessorImpl.java:57)

=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 at sun.reflect.DelegatingMethodAccessorImpl.invoke= (DelegatingMethodAccessorImpl.java:43)

=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 at java.lang.reflect.Method.invoke(Method.java:606)

= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.hado= op.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)=

<= span lang=3D"EN-US" style=3D"font-size:10.0pt;font-family:Consolas;color:#3= 33333">=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at com.sun.proxy.$P= roxy49.get_table(Unknown Source)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.get= Table(HiveMetaStoreClient.java:1008)

=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 at org.apache.hive.hcatalog.common.HCatUtil.getTable(= HCatUtil.java:191)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(I= nitializeInput.java:105)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(In= itializeInput.java:86)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatI= nputFormat.java:95)

=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 ... 13 more

=C2=A0

result code:2=

[Issue 975] suggests &quo= t;kylin.job.hive.database.for.intermediatetable" =3D default. But I al= so get this error message.

=C2=A0

When I run `show tabl= es` command, I can get the table kylin_intermediate_kylin_sales_cube_desc_1= 970***, and can also get its described info.

=C2= =A0

Kylin version =3D 1.2

Hive version =3D= 0.13.1-cdh5.3.2

Hbase version =3D 0.98.6+cdh5.3.2

<= span lang=3D"EN-US" style=3D"font-size:14.0pt">Hadoop version =3D 2.5.0-cdh5.3.2

=C2=A0

--001a11373a58f182d6052a87e601--