kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From " lihenry (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-3051) build cube with hive-hbase table can not success at step dimension dictionary
Date Wed, 22 Nov 2017 01:59:00 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261845#comment-16261845
] 

 lihenry commented on KYLIN-3051:
---------------------------------

my kylin version is re-complied ,maybe i miss something when i complied?
here is the err
 hive.log:406 : error in initSerDe: java.lang.ClassNotFoundException Class org.apache.hadoop.hive.hbase.HBaseSerDe
not found
java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.hbase.HBaseSerDe not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2130)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:394)
	at org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:276)
	at org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:258)
	at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:605)
	at org.apache.hive.hcatalog.common.HCatUtil.extractSchema(HCatUtil.java:158)
	at org.apache.hive.hcatalog.mapreduce.HCatTableInfo.valueOf(HCatTableInfo.java:158)
	at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:110)
	at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:88)
	at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
	at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:61)
	at org.apache.hive.hcatalog.data.transfer.impl.HCatInputFormatReader.prepareRead(HCatInputFormatReader.java:65)
	at org.apache.kylin.source.hive.HiveTableReader.getHiveReaderContext(HiveTableReader.java:163)
	at org.apache.kylin.source.hive.HiveTableReader.initialize(HiveTableReader.java:78)
	at org.apache.kylin.source.hive.HiveTableReader.<init>(HiveTableReader.java:73)
	at org.apache.kylin.source.hive.HiveTableReader.<init>(HiveTableReader.java:59)
	at org.apache.kylin.source.hive.HiveTable.getReader(HiveTable.java:56)
	at org.apache.kylin.dict.DictionaryManager.buildDictFromReadableTable(DictionaryManager.java:300)
	at org.apache.kylin.dict.DictionaryManager.buildDictionary(DictionaryManager.java:292)
	at org.apache.kylin.cube.CubeManager.buildDictionary(CubeManager.java:223)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:71)
	at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:54)
	at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:66)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
	at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:142)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)


> build cube  with hive-hbase table can not success at step dimension dictionary
> ------------------------------------------------------------------------------
>
>                 Key: KYLIN-3051
>                 URL: https://issues.apache.org/jira/browse/KYLIN-3051
>             Project: Kylin
>          Issue Type: Test
>            Reporter:  lihenry
>
> We create a cube with hive-hbase table ,at step Build Dimension Dictionary. we got "error
initSerDe" .
> But i transform that table to a real hive table with hdfs file . then successed.
> my kylin is 2.0 and re-compiled with hbase1.0.2.
> if Community Edition KYLIN donot support hive-hbase table。
> or Commercial Edition can do this ?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message