Return-Path: X-Original-To: apmail-kylin-dev-archive@minotaur.apache.org Delivered-To: apmail-kylin-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 80FDE181DB for ; Mon, 11 May 2015 08:08:18 +0000 (UTC) Received: (qmail 8302 invoked by uid 500); 11 May 2015 08:08:18 -0000 Delivered-To: apmail-kylin-dev-archive@kylin.apache.org Received: (qmail 8245 invoked by uid 500); 11 May 2015 08:08:18 -0000 Mailing-List: contact dev-help@kylin.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@kylin.incubator.apache.org Delivered-To: mailing list dev@kylin.incubator.apache.org Received: (qmail 8232 invoked by uid 99); 11 May 2015 08:08:17 -0000 Received: from Unknown (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 11 May 2015 08:08:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id F396AC1241 for ; Mon, 11 May 2015 08:08:16 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.19 X-Spam-Level: *** X-Spam-Status: No, score=3.19 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_FONT_FACE_BAD=0.289, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=rocketmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id jNceYAllHBSd for ; Mon, 11 May 2015 08:08:06 +0000 (UTC) Received: from nm37-vm8.bullet.mail.ne1.yahoo.com (nm37-vm8.bullet.mail.ne1.yahoo.com [98.138.229.136]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id E3E1E24C66 for ; Mon, 11 May 2015 08:08:05 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rocketmail.com; s=s2048; t=1431331679; bh=Zgi4+GyB9aAkXUpp+5xFEIDmVYYp5LDz/fsJNUtRHGs=; h=Date:From:Reply-To:To:Cc:In-Reply-To:References:Subject:From:Subject; b=t1ao1gJo/pX4i5ysmqWm5w3YOX1rpaolOB12ieU6olY5ouZS3FuutfNttQXat7cPrMJtDCdF7zZZo3kgbMsofmsTW558O6tU36Aq6JnJ1z8iln4a0FkkEQOcPRu3fCXHwcvA1O1+30Gwf62q7uybkPZYFXUZJIez8drcQ0DwWYond7OTsMaDnbhaEpU7C9XvPYWT6rIwH86+Z5lLC0TpKEGWPnzHyHBqqk2DKn6euqjMEIkLcVVYYXHvZv0h7O5rATP+fw2hwm4DJIEKoWKKSzUUZAV+J53X8d8NMs37jyb+S5Nrg/SNx5m9LOTuGjXigI7dJspYA5wC0SS5GAY4Mw== Received: from [127.0.0.1] by nm37.bullet.mail.ne1.yahoo.com with NNFMP; 11 May 2015 08:07:59 -0000 Received: from [98.138.101.131] by nm37.bullet.mail.ne1.yahoo.com with NNFMP; 11 May 2015 08:05:06 -0000 Received: from [106.10.166.121] by tm19.bullet.mail.ne1.yahoo.com with NNFMP; 11 May 2015 08:05:01 -0000 Received: from [106.10.151.186] by tm10.bullet.mail.sg3.yahoo.com with NNFMP; 11 May 2015 08:05:00 -0000 Received: from [127.0.0.1] by omp1012.mail.sg3.yahoo.com with NNFMP; 11 May 2015 08:05:00 -0000 X-Yahoo-Newman-Property: ymail-4 X-Yahoo-Newman-Id: 427204.60689.bm@omp1012.mail.sg3.yahoo.com X-YMail-OSG: dH1Yat0VM1m0I1ADPxJEfRlxSsuZ0oEii8WWSIhU8HjFjjzCjZ81zDM3keTvEqV UA8Ctao7mOCXWJ9BETg47GfdxlOHkN7547FNkHxYd2VSFcjj6pA4GSAfJ0p4RYITip_L5tuyg9J4 rCwVzeBDQM8JEpKsjmBZynWLPqWpyHL46BLmGIMGnHWKz_OV9ZBO0VECh4lJw1Oou31wfsDIqE.c X8K6d9Ea.Un.JvHg15W8yyzaNIv70k42LXru31teuYvtpLOtOaN2rtMVBnuxHqPV9QhPgpnGTKGO vDLM9L2a0SwoJoVF9Ov2KhViaPCPvRtXh_ovz0U8qWQZEPSKPjuM2aTmifq9ozAowNHTwAI2ACI_ tjYq2VtXVcF_OvXg_L_jW1x4opC11p4I4QZ7b_PHzR8AxLM1MUJk_iNAI8YtgdW8Vnwc.l8LWW.X _vvQEF1jRLMQHCcYBf6TQnGy4HC2oY9GnvxJDWtXBWZYHd_4xrAWDT7egUaH8H9zpF6I1vzgiWjD AYgc1SglMKYT2r6DpnCIW_lOYKL7EbfAGpACDrKbtel96D435zHpgFK0- Received: by 106.10.196.95; Mon, 11 May 2015 08:04:59 +0000 Date: Mon, 11 May 2015 08:04:58 +0000 (UTC) From: Abhijit Deka Reply-To: Abhijit Deka To: hongbin ma Cc: "Shi, Shaofeng" , "dev@kylin.incubator.apache.org" Message-ID: <582977941.2528652.1431331499191.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: <274125455.1635682.1431072259733.JavaMail.yahoo@mail.yahoo.com> References: <274125455.1635682.1431072259733.JavaMail.yahoo@mail.yahoo.com> Subject: Re: Cube build failed MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_2528651_984271998.1431331499190" ------=_Part_2528651_984271998.1431331499190 Content-Type: multipart/alternative; boundary="----=_Part_2528650_1213072254.1431331499168" ------=_Part_2528650_1213072254.1431331499168 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Everyone, I migrated to CDH 5.4.0 and the cube builds fine.Both the sample example an= d my customized one are building. But when I try to query I couldn't see any table on the left side panel.The= query is failing with log: Error instantiating JsonCustomSchema(name=3DDEFAULT)=20 I have restarted KYLIN to check if it works.Attaching screenshot.Please let= me know how to proceed. =C2=A0Regards Abhijit DekaComputer ScientistAdobe SystemsBangalore Ph-+91 80884 39067=20 On Friday, 8 May 2015 1:04 AM, Abhijit Deka wrote: =20 Thanks.I'll try with the latest=C2=A0Regards Abhijit DekaComputer ScientistAdobe SystemsBangalore Ph-+91 80884 39067=20 On Friday, 8 May 2015 1:26 PM, hongbin ma wrote= : =20 to be honest we barely had the bandwidth to test on chd,i would recommend = the latest cdh On Fri, May 8, 2015 at 3:54 PM, Abhijit Deka = wrote: Please let me know which version of CHD should I download.(tested with all = the Kylin components)=C2=A0Regards Abhijit DekaComputer ScientistAdobe SystemsBangalore Ph-+91 80884 39067=20 On Friday, 8 May 2015 12:33 PM, hongbin ma wrot= e: =20 hi,cdh 5.1 is using hive 0.12, however we require 0.14 at leastto save all= the troubles, you can change to hdp 2.2 if possible On Fri, May 8, 2015 at 2:52 PM, Abhijit Deka = wrote: Hi, That issue is resolved when i moved from External table. but I am getitng a new error now .In the same build step I am getting this java.lang.IncompatibleClassChangeError: Found class org.apache.hive.hcatalo= g.data.transfer.ReaderContext, but interface was expected =09at org.apache.kylin.dict.lookup.HiveTableReader.initialize(HiveTableRead= er.java:85) =09at org.apache.kylin.dict.lookup.HiveTableReader.(HiveTableReader.j= ava:74) =09at org.apache.kylin.dict.lookup.HiveTableReader.(HiveTableReader.j= ava:60) =09at org.apache.kylin.dict.lookup.HiveTable.getReader(HiveTable.java:66) =09at org.apache.kylin.dict.DictionaryGenerator.loadColumnValues(Dictionary= Generator.java:173) =09at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryG= enerator.java:112) =09at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryMan= ager.java:172) =09at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:15= 4) =09at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dicti= onaryGeneratorCLI.java:53) =09at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dicti= onaryGeneratorCLI.java:42) =09at org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictio= naryJob.java:53) =09at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) =09at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) =09at org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellE= xecutable.java:63) =09at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExe= cutable.java:107) =09at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(Defaul= tChainedExecutable.java:50) =09at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExe= cutable.java:107) =09at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(D= efaultScheduler.java:132) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1145) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:615) =09at java.lang.Thread.run(Thread.java:745)Do you know what is causing this= error?=20 Regards Abhijit DekaComputer ScientistAdobe SystemsBangalore Ph-+91 80884 39067=20 On Friday, 8 May 2015 11:09 AM, hongbin ma wrot= e: =20 what will you get if you run=C2=A0hadoop fs -cat=C2=A0/user/hive/warehouse= /glaastest_dim_vendor ? On Fri, May 8, 2015 at 1:37 PM, Abhijit Deka = wrote: Hi Shi, It's Hive.=C2=A0Regards Abhijit DekaComputer ScientistAdobe SystemsBangalore Ph-+91 80884 39067=20 On Friday, 8 May 2015 10:09 AM, "Shi, Shaofeng" wro= te: =20 What=E2=80=99s the owner info for hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_vendor ? Didn=E2=80=99t see it here. On 5/8/15, 12:35 PM, "Abhijit Deka" wrote: >Hi Bin, >Thanks for the reply.I have already mentioned that I have verified and >the file exists in HDFS.But the owner is Hive not Cloudera. >drwxrwxrwx=C2=A0 - hive=C2=A0 =C2=A0 hive=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 0 2015-05-07 04:22 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_product >drwxrwxrwx=C2=A0 - hive=C2=A0 =C2=A0 hive=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 0 2015-05-07 04:20 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_fact >drwxrwxrwx=C2=A0 - cloudera supergroup=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0= 2015-05-04 07:18 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_cal_dt >drwxrwxrwx=C2=A0 - cloudera supergroup=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0= 2015-05-04 07:18 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_category_groupin >gs >drwxrwxrwx=C2=A0 - cloudera supergroup=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0= 2015-05-04 07:18 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_sales > >For the example bundled with Kylin the user is Cloudera. Is it some kind >of permission issue I am running into.Meanwhile i'll try to run it with >hive table (not external) > > Regards >Abhijit DekaComputer ScientistAdobe SystemsBangalore >Ph-+91 80884 39067 > > >=C2=A0 =C2=A0 On Friday, 8 May 2015 6:59 AM, hongbin ma >wrote: >=C2=A0=20 > > for all the lookup tables, for example glaastest_dim_vendor=C2=A0 in your >case, kylin asks hive the hdfs location of it, and will try to read the >hdfs file directly. >it seems hive returned the location: >hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_vendor >does , but the file does not exist. can you verify why hive returned such >location(as you described it's a external table in hbase?) >An alternative is that you convert all the lookup tables into >non-external tables >On Thu, May 7, 2015 at 4:40 PM, Abhijit Deka > wrote: > >Forgot to add the machine info.I am running it in CHD 5.1.0 >virtualbox.Not a cluster. > Regards >Abhijit DekaComputer ScientistAdobe SystemsBangalore >Ph-+91 80884 39067 > > >=C2=A0 =C2=A0 On Thursday, 7 May 2015 1:36 AM, Abhijit Deka > wrote: > > > Hi, >I am new to Kylin and i was trying out a simple cube.I did the below >steps.Please let me know if i have done anything wrong. >1.Done ETL in Pig.2.Stored the Fact and Dim tables in Hbase.3.Created >external table in Hive to query the data and also use in Kylin4.Created >the cube as instructed in documentation.5.Build the cube. >But the cube build failed in 3rd step. >Below are the logs >java.io.FileNotFoundException: File >hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_vendor >does not exist. >=C2=A0 =C2=A0 at=20 >org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(Distribute >dFileSystem.java:654) >=C2=A0 =C2=A0 at=20 >org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSys >tem.java:102) >=C2=A0 =C2=A0 at=20 >org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSyst >em.java:712) >=C2=A0 =C2=A0 at=20 >org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSyst >em.java:708) >=C2=A0 =C2=A0 at=20 >org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver >.java:81) >=C2=A0 =C2=A0 at=20 >org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSys >tem.java:708) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.dict.lookup.HiveTable.findOnlyFile(HiveTable.java:116) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.dict.lookup.HiveTable.computeHDFSLocation(HiveTable.java: >107) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.dict.lookup.HiveTable.getHDFSLocation(HiveTable.java:83) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.dict.lookup.HiveTable.getFileTable(HiveTable.java:76) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.dict.lookup.HiveTable.getSignature(HiveTable.java:71) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager. >java:164) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:154) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dictionary >GeneratorCLI.java:53) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dictionary >GeneratorCLI.java:42) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictionaryJ >ob.java:53) >=C2=A0 =C2=A0 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) >=C2=A0 =C2=A0 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecut >able.java:63) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab >le.java:107) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChai >nedExecutable.java:50) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab >le.java:107) >=C2=A0 =C2=A0 at=20 >org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(Defaul >tScheduler.java:132) >=C2=A0 =C2=A0 at=20 >java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: >1145) >=C2=A0 =C2=A0 at=20 >java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java >:615) >=C2=A0 =C2=A0 at java.lang.Thread.run(Thread.java:745) >Now when I check for the file in HDFS the file is there but it looks like >a permission issue.(??) >drwxrwxrwx=C2=A0 - hive=C2=A0 =C2=A0 hive=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 0 2015-05-07 04:22 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_product >drwxrwxrwx=C2=A0 - hive=C2=A0 =C2=A0 hive=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 0 2015-05-07 04:20 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_fact >drwxrwxrwx=C2=A0 - cloudera supergroup=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0= 2015-05-04 07:18 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_cal_dt >drwxrwxrwx=C2=A0 - cloudera supergroup=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0= 2015-05-04 07:18 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_category_groupin >gs >drwxrwxrwx=C2=A0 - cloudera supergroup=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0= 2015-05-04 07:18 >hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_sales >How do i solve this issue.Thanks in advance. > Regards >Abhijit DekaComputer ScientistAdobe SystemsBangalore > > >=C2=A0=20 > > > >--=20 >Regards, >Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE >Apache Kylin: http://kylin.io >Github: https://github.com/binmahone > >=C2=A0=20 =20 --=20 Regards, Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE Apache Kylin: http://kylin.io Github: https://github.com/binmahone=20 =20 --=20 Regards, Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE Apache Kylin: http://kylin.io Github: https://github.com/binmahone=20 =20 --=20 Regards, Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE Apache Kylin: http://kylin.io Github: https://github.com/binmahone=20 =20 ------=_Part_2528650_1213072254.1431331499168 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Everyone,
<= br>
I migrated to CDH 5.4.= 0 and the cube builds fine.
Both the sample example and my customized one are building.
But when I try to query I couldn't= see any table on the left side panel.The query is failing with log:

Error instantiating JsonCustomSchema(name=3DDEFAULT)
=

<= /div>
I have restarted KYLIN to check if it work= s.Attaching screenshot.
Please let = me know how to proceed.

=
3D"Inline
=3D"Inline3D"Inline
 
Regards
=
Ab= hijit Deka
Computer Scientist
Adobe Systems
Bangalore
<= div id=3D"yui_3_16_0_1_1431347200829_13372" style=3D"font-family:arial, hel= vetica, sans-serif;"> sans-serif" size= =3D"2">
Ph-+91 8= 0884 39067


<= br>
On Friday, 8 May 2015 1:04 AM, Abhijit Deka <abhijit.deka@= rocketmail.com> wrote:


Thanks.I'll t= ry with the latest
 
= Regards
=

Abhijit Dek= a
Computer= Scientist
Adobe Systems
Bangalore
sans-serif" size=3D"2">
Ph-+91 80884 39067


= On Friday, 8 May 2015 1:26 PM, hongbin ma= <mahongbin@apache.org> wrote:

to = be honest we barely had the bandwidth to test on chd,
i would recommend the latest cdh

On Fri, = May 8, 2015 at 3:54 PM, Abhijit Deka <abhijit.deka@rocketmai= l.com> wrote:
Please let me= know which version of CHD should I download.(tested with all the Kylin com= ponents)
&= nbsp;
Regards

Abhijit Deka
Computer Scientis= t
Adobe Systems
Bangalore
sans-serif" size=3D"2">



On Friday, 8 May 2015 12:33 PM, hongbin ma <mahongbin@apache.org> wrote:


hi,
to save all the troubles,= you can change to hdp 2.2 if possible

<= div>
On Fri, May 8, 2015 at 2:52 PM, Abhijit Deka <= ;abhij= it.deka@rocketmail.com> wrote:
Hi,

That issue is re= solved when i moved from External table.

but I am getitng a new error now .In the same build step = I am getting this

java.=
lang.IncompatibleClassChangeError: Found class org.apache.hive.hcatalog.dat=
a.transfer.ReaderContext, but interface was expected
=09at org.apache.kylin.dict.lookup.HiveTableReader.initialize(HiveTableRead=
er.java:85)
=09at org.apache.kylin.dict.lookup.HiveTableReader.<init>(HiveTableRe=
ader.java:74)
=09at org.apache.kylin.dict.lookup.HiveTableReader.<init>(HiveTableRe=
ader.java:60)
=09at org.apache.kylin.dict.lookup.HiveTable.getReader(HiveTable.java:66)
=09at org.apache.kylin.dict.DictionaryGenerator.loadColumnValues(Dictionary=
Generator.java:173)
=09at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryG=
enerator.java:112)
=09at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryMan=
ager.java:172)
=09at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:15=
4)
=09at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dicti=
onaryGeneratorCLI.java:53)
=09at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dicti=
onaryGeneratorCLI.java:42)
=09at org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictio=
naryJob.java:53)
=09at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
=09at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
=09at org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellE=
xecutable.java:63)
=09at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExe=
cutable.java:107)
=09at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(Defaul=
tChainedExecutable.java:50)
=09at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExe=
cutable.java:107)
=09at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(D=
efaultScheduler.java:132)
=09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.=
java:1145)
=09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor=
.java:615)
=09at java.lang.Thread.run(Thread.java:745)
Do yo= u know what is causing this error?

Regards

Abhijit Deka
Computer Scientist
Adobe Systems
Bangalore
sans-se= rif" size=3D"2">




what will you get if you run 
hadoop fs -cat /user/hive/warehouse/= glaastest_dim_vendor ?

On Fri, May 8, 2015 at 1:37 PM, Abhijit Deka <= abhiji= t.deka@rocketmail.com> wrote:
Hi Shi,

It's Hive.
 
Regards

Abhijit Deka
Computer Scientist
Adobe Systems
Banga= lore
<= font face=3D"arial, helvetica, sans-serif" size=3D"2">
=



=
On Friday, 8 May 2015 10:0= 9 AM, "Shi, Shaofeng" <sh= aoshi@ebay.com> wrote:


What=E2=80=99s the owner info for
hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_d= im_vendor ?
Didn=E2=80=99t see it here.

On 5/8/15, 12:35 PM, "Abhijit Deka" <abhijit.deka@roc= ketmail.com> wrote:

>Hi Bin,=
>Thanks for the reply.I have already mentioned that I= have verified and
>the file exists in HDFS.But the ow= ner is Hive not Cloudera.
>drwxrwxrwx  - hive&nb= sp;   hive                0 2= 015-05-07 04:22
>hdfs://quickstart.cloudera:8020/user/= hive/warehouse/glaastest_dim_product
>drwxrwxrwx = - hive    hive             =   0 2015-05-07 04:20
>hdfs://quickstart.cloudera= :8020/user/hive/warehouse/glaastest_fact
>drwxrwxrwx&n= bsp; - cloudera supergroup          0 2015-05-04 = 07:18
>hdfs://quickstart.cloudera:8020/user/hive/wareh= ouse/kylin_cal_dt
>drwxrwxrwx  - cloudera superg= roup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_category_gro= upin
>gs
>drwxrwxrwx  - clo= udera supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_= sales
>
>For the example bundled = with Kylin the user is Cloudera. Is it some kind
>of p= ermission issue I am running into.Meanwhile i'll try to run it with
>hive table (not external)
>
> Regards
>Abhijit DekaComputer ScientistAdo= be SystemsBangalore
>Ph-+91 80884 39067
>
>
>    On Friday, 8 May 2015 6:59 AM, h= ongbin ma <mahong= bin@apache.org>
>wrote:
>&= nbsp;
>
> for all the lookup ta= bles, for example glaastest_dim_vendor  in your
>= case, kylin asks hive the hdfs location of it, and will try to read the
>hdfs file directly.
>it seems hive = returned the location:
>hdfs://quickstart.cloudera:802= 0/user/hive/warehouse/glaastest_dim_vendor
>does , but= the file does not exist. can you verify why hive returned such
>location(as you described it's a external table in hbase?)
>An alternative is that you convert all the lookup tables i= nto
>non-external tables
>On Thu,= May 7, 2015 at 4:40 PM, Abhijit Deka
><abhijit.deka@rock= etmail.com> wrote:
>
>Forg= ot to add the machine info.I am running it in CHD 5.1.0
&= gt;virtualbox.Not a cluster.
> Regards
>Abhijit DekaComputer ScientistAdobe SystemsBangalore
>Ph-+91 80884 39067<= br clear=3D"none">>
>
>  =   On Thursday, 7 May 2015 1:36 AM, Abhijit Deka
>= ;<a= bhijit.deka@rocketmail.com> wrote:
>
>
> Hi,
>I am new to= Kylin and i was trying out a simple cube.I did the below
>steps.Please let me know if i have done anything wrong.
>1.Done ETL in Pig.2.Stored the Fact and Dim tables in Hbase.3.Creat= ed
>external table in Hive to query the data and also = use in Kylin4.Created
>the cube as instructed in docum= entation.5.Build the cube.
>But the cube build failed = in 3rd step.
>Below are the logs
>= ;java.io.FileNotFoundException: File
>hdfs://quickstar= t.cloudera:8020/user/hive/warehouse/glaastest_dim_vendor
= >does not exist.
>    at
>org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(Dist= ribute
>dFileSystem.java:654)
>&n= bsp;   at
>org.apache.hadoop.hdfs.DistributedFil= eSystem.access$600(DistributedFileSys
>tem.java:102)>    at
>org.apache.had= oop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSyst
>em.java:712)
>    at
>org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedF= ileSyst
>em.java:708)
>  &nb= sp; at
>org.apache.hadoop.fs.FileSystemLinkResolver.r= esolve(FileSystemLinkResolver
>.java:81)
>    at
>org.apache.hadoop.hdfs.Dis= tributedFileSystem.listStatus(DistributedFileSys
>tem.= java:708)
>    at
>org= .apache.kylin.dict.lookup.HiveTable.findOnlyFile(HiveTable.java:116)
>    at
>org.apache.kylin.di= ct.lookup.HiveTable.computeHDFSLocation(HiveTable.java:
&= gt;107)
>    at
>org.a= pache.kylin.dict.lookup.HiveTable.getHDFSLocation(HiveTable.java:83)
>    at
>org.apache.kylin.di= ct.lookup.HiveTable.getFileTable(HiveTable.java:76)
>&= nbsp;   at
>org.apache.kylin.dict.lookup.HiveTab= le.getSignature(HiveTable.java:71)
>    at <= br clear=3D"none">>org.apache.kylin.dict.DictionaryManager.buildDictiona= ry(DictionaryManager.
>java:164)
>= ;    at
>org.apache.kylin.cube.CubeManager.= buildDictionary(CubeManager.java:154)
>    a= t
>org.apache.kylin.cube.cli.DictionaryGeneratorCLI.p= rocessSegment(Dictionary
>GeneratorCLI.java:53)
>    at
>org.apache.kylin.cu= be.cli.DictionaryGeneratorCLI.processSegment(Dictionary
&= gt;GeneratorCLI.java:42)
>    at
>org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(Crea= teDictionaryJ
>ob.java:53)
> = ;   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>    at org.apache.hadoop.util.ToolRunner.run(Too= lRunner.java:84)
>    at
= >org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExe= cut
>able.java:63)
>   = at
>org.apache.kylin.job.execution.AbstractExecutabl= e.execute(AbstractExecutab
>le.java:107)
>    at
>org.apache.kylin.job.execu= tion.DefaultChainedExecutable.doWork(DefaultChai
>nedE= xecutable.java:50)
>    at
>org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExe= cutab
>le.java:107)
>   = ; at
>org.apache.kylin.job.impl.threadpool.DefaultSch= eduler$JobRunner.run(Defaul
>tScheduler.java:132)
>    at
>java.util.concurr= ent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1145)
>    at
>ja= va.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java>:615)
>    at java.lang.= Thread.run(Thread.java:745)
>Now when I check for the = file in HDFS the file is there but it looks like
>a pe= rmission issue.(??)
>drwxrwxrwx  - hive  &n= bsp; hive                0 2015-05= -07 04:22
>hdfs://quickstart.cloudera:8020/user/hive/w= arehouse/glaastest_dim_product
>drwxrwxrwx  - hi= ve    hive               = ; 0 2015-05-07 04:20
>hdfs://quickstart.cloudera:8020/= user/hive/warehouse/glaastest_fact
>drwxrwxrwx  = - cloudera supergroup          0 2015-05-04 07:18<= br clear=3D"none">>hdfs://quickstart.cloudera:8020/user/hive/warehouse/k= ylin_cal_dt
>drwxrwxrwx  - cloudera supergroup&n= bsp;         0 2015-05-04 07:18
>h= dfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_category_groupin>gs
>drwxrwxrwx  - cloudera = supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_sales<= br clear=3D"none">>How do i solve this issue.Thanks in advance.
> Regards
>Abhijit DekaComputer Scientist= Adobe SystemsBangalore
>
>
> 
>
>
>
>--
>Regards,<= br clear=3D"none">>Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE
>Apache Kylin: http://kylin.io
>Githu= b: https://github.com/binmahone
><= br clear=3D"none">> 





--
Regards,

Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE=
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone





--
Regards,

Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE=
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone





--
Regards,

Bin Mahone | =E9=A9=AC=E6=B4=AA=E5=AE=BE=
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone




------=_Part_2528650_1213072254.1431331499168-- ------=_Part_2528651_984271998.1431331499190--