kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Niasari, Mehrdad" <mehrdad.nias...@rbc.com>
Subject RE: NoClassFound: org.apache.hadoop.hive.serde2.typeinfo.TypeInfo
Date Mon, 11 Jul 2016 18:26:05 GMT
Sorry guys, I replied to the wrong email.

My problem is related to “table not found” problem.

I’ll send a separate email and explain more clearly there.

I’m so sorry for the wrong email again.
Thanks,
Mehrdad


From: Niasari, Mehrdad [mailto:mehrdad.niasari@rbc.com]
Sent: 2016, July, 11 2:22 PM
To: user@kylin.apache.org
Subject: RE: NoClassFound: org.apache.hadoop.hive.serde2.typeinfo.TypeInfo

More info on this issue:

When I run sample.sh, it can create the intermediate table in step 1 in hive, but it cannot
find it in step2.


From: Niasari, Mehrdad [mailto:mehrdad.niasari@rbc.com]
Sent: 2016, July, 11 2:13 PM
To: user@kylin.apache.org<mailto:user@kylin.apache.org>
Subject: RE: NoClassFound: org.apache.hadoop.hive.serde2.typeinfo.TypeInfo

Thanks Yang,

This problem is becoming a big issue for me. I checked hive_classpath value in find-hive_dependecy.sh
and everything seems fine. What is the correct value? How to check that?

Basically, How should I debug this problem?

I went through every single command of find-hive-dependecy.sh but still have no idea which
part caused the problem.

More information:
I’m using beeline instead of hive cli
Using kylin-1.5.2.1 and Hive 1.2.1.2.3.2.0-2950


From: Li Yang [mailto:liyang@apache.org]
Sent: 2016, July, 08 3:24 AM
To: user@kylin.apache.org<mailto:user@kylin.apache.org>
Subject: Re: NoClassFound: org.apache.hadoop.hive.serde2.typeinfo.TypeInfo

This kind of error is highly env related. Google "Kylin NoClassDefFoundError" and you will
find a few previous discussions.
The key point is "bin/find-hive-dependency.sh" must report correct hive classpath.

Yang

On Tue, Jul 5, 2016 at 10:28 PM, Niasari, Mehrdad <mehrdad.niasari@rbc.com<mailto:mehrdad.niasari@rbc.com>>
wrote:
Hi there,

I can successfully run Kylin’s sample cube on my local machine(HDP sandbox) but when I try
to run it on cluster I get this error in step 2(Extract Fact Table Distinct Columns):

java.lang.NoClassDefFoundError: org/apache/hadoop/hive/serde2/typeinfo/TypeInfo
        at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:81)
        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:111)
        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:91)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
        at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:118)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
        at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

I am using beeline and hiveserver2 if they make difference to the issue.

Any help to get rid of this error would be appreciated.

Thanks,
Mehrdad





_______________________________________________________________________

If you received this email in error, please advise the sender (by return email or otherwise)
immediately. You have consented to receive the attached electronically at the above-noted
email address; please retain a copy of this confirmation for future reference.

Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur immédiatement, par
retour de courriel ou par un autre moyen. Vous avez accepté de recevoir le(s) document(s)
ci-joint(s) par voie électronique à l'adresse courriel indiquée ci-dessus; veuillez conserver
une copie de cette confirmation pour les fins de reference future.


_______________________________________________________________________

If you received this email in error, please advise the sender (by return email or otherwise)
immediately. You have consented to receive the attached electronically at the above-noted
email address; please retain a copy of this confirmation for future reference.

Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur immédiatement, par
retour de courriel ou par un autre moyen. Vous avez accepté de recevoir le(s) document(s)
ci-joint(s) par voie électronique à l'adresse courriel indiquée ci-dessus; veuillez conserver
une copie de cette confirmation pour les fins de reference future.

_______________________________________________________________________

If you received this email in error, please advise the sender (by return email or otherwise)
immediately. You have consented to receive the attached electronically at the above-noted
email address; please retain a copy of this confirmation for future reference.

Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur immédiatement, par
retour de courriel ou par un autre moyen. Vous avez accepté de recevoir le(s) document(s)
ci-joint(s) par voie électronique à l'adresse courriel indiquée ci-dessus; veuillez conserver
une copie de cette confirmation pour les fins de reference future.
_______________________________________________________________________
If you received this email in error, please advise the sender (by return email or otherwise)
immediately. You have consented to receive the attached electronically at the above-noted
email address; please retain a copy of this confirmation for future reference.  

Si vous recevez ce courriel par erreur, veuillez en aviser l'expéditeur immédiatement, par
retour de courriel ou par un autre moyen. Vous avez accepté de recevoir le(s) document(s)
ci-joint(s) par voie électronique à l'adresse courriel indiquée ci-dessus; veuillez conserver
une copie de cette confirmation pour les fins de reference future.
Mime
View raw message