kylin-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhijit Deka <abhijit.d...@rocketmail.com>
Subject Re: Cube build failed
Date Fri, 08 May 2015 06:52:58 GMT
Hi,
That issue is resolved when i moved from External table.
but I am getitng a new error now .In the same build step I am getting this
java.lang.IncompatibleClassChangeError: Found class org.apache.hive.hcatalog.data.transfer.ReaderContext,
but interface was expected
	at org.apache.kylin.dict.lookup.HiveTableReader.initialize(HiveTableReader.java:85)
	at org.apache.kylin.dict.lookup.HiveTableReader.<init>(HiveTableReader.java:74)
	at org.apache.kylin.dict.lookup.HiveTableReader.<init>(HiveTableReader.java:60)
	at org.apache.kylin.dict.lookup.HiveTable.getReader(HiveTable.java:66)
	at org.apache.kylin.dict.DictionaryGenerator.loadColumnValues(DictionaryGenerator.java:173)
	at org.apache.kylin.dict.DictionaryGenerator.buildDictionary(DictionaryGenerator.java:112)
	at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:172)
	at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:154)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:53)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
	at org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictionaryJob.java:53)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
	at org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)Do you know what is causing this error? 

Regards
Abhijit DekaComputer ScientistAdobe SystemsBangalore
Ph-+91 80884 39067 


     On Friday, 8 May 2015 11:09 AM, hongbin ma <mahongbin@apache.org> wrote:
   

 what will you get if you run hadoop fs -cat /user/hive/warehouse/glaastest_dim_vendor ?
On Fri, May 8, 2015 at 1:37 PM, Abhijit Deka <abhijit.deka@rocketmail.com> wrote:

Hi Shi,
It's Hive. Regards
Abhijit DekaComputer ScientistAdobe SystemsBangalore
Ph-+91 80884 39067 


     On Friday, 8 May 2015 10:09 AM, "Shi, Shaofeng" <shaoshi@ebay.com> wrote:
   

 What’s the owner info for
hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_vendor ?
Didn’t see it here.

On 5/8/15, 12:35 PM, "Abhijit Deka" <abhijit.deka@rocketmail.com> wrote:

>Hi Bin,
>Thanks for the reply.I have already mentioned that I have verified and
>the file exists in HDFS.But the owner is Hive not Cloudera.
>drwxrwxrwx  - hive    hive                0 2015-05-07 04:22
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_product
>drwxrwxrwx  - hive    hive                0 2015-05-07 04:20
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_fact
>drwxrwxrwx  - cloudera supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_cal_dt
>drwxrwxrwx  - cloudera supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_category_groupin
>gs
>drwxrwxrwx  - cloudera supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_sales
>
>For the example bundled with Kylin the user is Cloudera. Is it some kind
>of permission issue I am running into.Meanwhile i'll try to run it with
>hive table (not external)
>
> Regards
>Abhijit DekaComputer ScientistAdobe SystemsBangalore
>Ph-+91 80884 39067
>
>
>    On Friday, 8 May 2015 6:59 AM, hongbin ma <mahongbin@apache.org>
>wrote:
>  
>
> for all the lookup tables, for example glaastest_dim_vendor  in your
>case, kylin asks hive the hdfs location of it, and will try to read the
>hdfs file directly.
>it seems hive returned the location:
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_vendor
>does , but the file does not exist. can you verify why hive returned such
>location(as you described it's a external table in hbase?)
>An alternative is that you convert all the lookup tables into
>non-external tables
>On Thu, May 7, 2015 at 4:40 PM, Abhijit Deka
><abhijit.deka@rocketmail.com> wrote:
>
>Forgot to add the machine info.I am running it in CHD 5.1.0
>virtualbox.Not a cluster.
> Regards
>Abhijit DekaComputer ScientistAdobe SystemsBangalore
>Ph-+91 80884 39067
>
>
>    On Thursday, 7 May 2015 1:36 AM, Abhijit Deka
><abhijit.deka@rocketmail.com> wrote:
>
>
> Hi,
>I am new to Kylin and i was trying out a simple cube.I did the below
>steps.Please let me know if i have done anything wrong.
>1.Done ETL in Pig.2.Stored the Fact and Dim tables in Hbase.3.Created
>external table in Hive to query the data and also use in Kylin4.Created
>the cube as instructed in documentation.5.Build the cube.
>But the cube build failed in 3rd step.
>Below are the logs
>java.io.FileNotFoundException: File
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_vendor
>does not exist.
>    at 
>org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(Distribute
>dFileSystem.java:654)
>    at 
>org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSys
>tem.java:102)
>    at 
>org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSyst
>em.java:712)
>    at 
>org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSyst
>em.java:708)
>    at 
>org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver
>.java:81)
>    at 
>org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSys
>tem.java:708)
>    at 
>org.apache.kylin.dict.lookup.HiveTable.findOnlyFile(HiveTable.java:116)
>    at 
>org.apache.kylin.dict.lookup.HiveTable.computeHDFSLocation(HiveTable.java:
>107)
>    at 
>org.apache.kylin.dict.lookup.HiveTable.getHDFSLocation(HiveTable.java:83)
>    at 
>org.apache.kylin.dict.lookup.HiveTable.getFileTable(HiveTable.java:76)
>    at 
>org.apache.kylin.dict.lookup.HiveTable.getSignature(HiveTable.java:71)
>    at 
>org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.
>java:164)
>    at 
>org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:154)
>    at 
>org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dictionary
>GeneratorCLI.java:53)
>    at 
>org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(Dictionary
>GeneratorCLI.java:42)
>    at 
>org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictionaryJ
>ob.java:53)
>    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>    at 
>org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecut
>able.java:63)
>    at 
>org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab
>le.java:107)
>    at 
>org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChai
>nedExecutable.java:50)
>    at 
>org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutab
>le.java:107)
>    at 
>org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(Defaul
>tScheduler.java:132)
>    at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1145)
>    at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615)
>    at java.lang.Thread.run(Thread.java:745)
>Now when I check for the file in HDFS the file is there but it looks like
>a permission issue.(??)
>drwxrwxrwx  - hive    hive                0 2015-05-07 04:22
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_dim_product
>drwxrwxrwx  - hive    hive                0 2015-05-07 04:20
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/glaastest_fact
>drwxrwxrwx  - cloudera supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_cal_dt
>drwxrwxrwx  - cloudera supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_category_groupin
>gs
>drwxrwxrwx  - cloudera supergroup          0 2015-05-04 07:18
>hdfs://quickstart.cloudera:8020/user/hive/warehouse/kylin_sales
>How do i solve this issue.Thanks in advance.
> Regards
>Abhijit DekaComputer ScientistAdobe SystemsBangalore
>
>
>  
>
>
>
>-- 
>Regards,
>Bin Mahone | 马洪宾
>Apache Kylin: http://kylin.io
>Github: https://github.com/binmahone
>
>  



   



-- 
Regards,
Bin Mahone | 马洪宾
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone 

  
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message